2019-10-23T08:13:13.211 INFO:root:teuthology version: 1.0.0-5052ff0 2019-10-23T08:13:13.212 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.hUVaFw.tmp -- --verbose --lock --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} --name sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi --block --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi/4435270 2019-10-23T08:13:13.277 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-10-23T08:13:13.334 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi/4435270 branch: wip-sjust-testing2 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} email: null first_in_suite: false job_id: '4435270' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: centos os_version: '7.6' overrides: admin_socket: branch: wip-sjust-testing2 ceph: conf: global: mon client directed command retry: 5 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow requests sha1: 1214c80e358aa5969cb9e43aaf279e75b8989198 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 1214c80e358aa5969cb9e43aaf279e75b8989198 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sjust-testing2 sha1: 1214c80e358aa5969cb9e43aaf279e75b8989198 owner: scheduled_sjust@teuthology priority: 90 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 1214c80e358aa5969cb9e43aaf279e75b8989198 suite: rados suite_branch: wip-sjust-testing2 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1214c80e358aa5969cb9e43aaf279e75b8989198 tasks: - install: null - ceph: null - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.17304 2019-10-23T08:13:13.334 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa; will attempt to use it 2019-10-23T08:13:13.334 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa/tasks 2019-10-23T08:13:13.335 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-10-23T08:13:13.336 INFO:teuthology.task.internal:Checking packages... 2019-10-23T08:13:13.349 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '1214c80e358aa5969cb9e43aaf279e75b8989198' 2019-10-23T08:13:13.350 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-10-23T08:13:13.350 INFO:teuthology.packaging:ref: None 2019-10-23T08:13:13.350 INFO:teuthology.packaging:tag: None 2019-10-23T08:13:13.350 INFO:teuthology.packaging:branch: wip-sjust-testing2 2019-10-23T08:13:13.350 INFO:teuthology.packaging:sha1: 1214c80e358aa5969cb9e43aaf279e75b8989198 2019-10-23T08:13:13.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-sjust-testing2 2019-10-23T08:13:13.515 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-6281.g1214c80 2019-10-23T08:13:13.515 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-10-23T08:13:13.527 INFO:teuthology.task.internal:no buildpackages task found 2019-10-23T08:13:13.528 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-10-23T08:13:13.538 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-10-23T08:13:13.538 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-10-23T08:13:13.595 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:13:23.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:13:33.623 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:13:43.639 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:13:53.658 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:14:03.672 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:14:13.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-10-23T08:14:23.698 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:14:33.712 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:14:43.729 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:14:53.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:15:03.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:15:13.779 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:15:23.801 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:15:33.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:15:43.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-10-23T08:15:53.845 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_sjust@teuthology', 'description': '/home/teuthworker/archive/sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi/4435270', 'machine_type': 'smithi'} 2019-10-23T08:15:53.861 DEBUG:teuthology.lock.ops:locked ubuntu@smithi062.front.sepia.ceph.com, ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:15:53.985 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-10-23T08:15:54.169 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 7.6 2019-10-23T08:15:54.174 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 7.6 2019-10-23T08:15:54.495 INFO:teuthology.orchestra.console:Power off smithi038 2019-10-23T08:15:54.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-10-23T08:15:54.549 INFO:teuthology.orchestra.console:Power off smithi062 2019-10-23T08:15:54.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-10-23T08:15:54.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:15:54.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:15:58.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:15:58.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:02.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:02.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:03.011 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2019-10-23T08:16:03.112 INFO:teuthology.orchestra.console:Power on smithi038 2019-10-23T08:16:03.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-10-23T08:16:03.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:06.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:07.172 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2019-10-23T08:16:07.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:07.273 INFO:teuthology.orchestra.console:Power on smithi062 2019-10-23T08:16:07.274 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-10-23T08:16:07.311 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:07.437 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2019-10-23T08:16:07.538 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2019-10-23T08:16:11.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-10-23T08:16:11.578 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2019-10-23T08:16:11.679 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2019-10-23T08:18:38.912 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:18:47.981 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:18:57.038 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:18:57.991 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:06.093 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:07.050 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:15.153 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:16.109 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:24.241 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:25.162 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:33.329 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:34.218 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:43.277 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:52.329 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:19:57.866 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:01.388 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:06.923 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:10.445 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:12.930 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:13.188 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.189 INFO:teuthology.orchestra.run.smithi038:> hostname 2019-10-23T08:20:13.629 INFO:teuthology.orchestra.run.smithi038.stdout:smithi141 2019-10-23T08:20:13.630 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.630 INFO:teuthology.orchestra.run.smithi038:> grep smithi141 /etc/hosts 2019-10-23T08:20:13.672 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2019-10-23T08:20:13.672 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.673 INFO:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2019-10-23T08:20:13.825 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.825 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi141/smithi038/g' /etc/hosts 2019-10-23T08:20:13.885 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.885 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.141/172.21.15.38/g' /etc/hosts 2019-10-23T08:20:13.939 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.939 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi141/smithi038/g' /etc/hostname 2019-10-23T08:20:13.992 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:13.993 INFO:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2019-10-23T08:20:14.046 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2019-10-23T08:20:14.050 DEBUG:teuthology.parallel:result is None 2019-10-23T08:20:42.309 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:42.309 INFO:teuthology.orchestra.run.smithi062:> hostname 2019-10-23T08:20:42.779 INFO:teuthology.orchestra.run.smithi062.stdout:smithi141 2019-10-23T08:20:42.779 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:42.779 INFO:teuthology.orchestra.run.smithi062:> grep smithi141 /etc/hosts 2019-10-23T08:20:42.827 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2019-10-23T08:20:42.828 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:42.828 INFO:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2019-10-23T08:20:42.932 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:42.932 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi141/smithi062/g' /etc/hosts 2019-10-23T08:20:43.023 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:43.023 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.141/172.21.15.62/g' /etc/hosts 2019-10-23T08:20:43.098 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:43.098 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi141/smithi062/g' /etc/hostname 2019-10-23T08:20:43.157 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:43.157 INFO:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2019-10-23T08:20:43.217 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2019-10-23T08:20:43.219 DEBUG:teuthology.parallel:result is None 2019-10-23T08:20:43.436 INFO:teuthology.lock.keys:Checking smithi038.front.sepia.ceph.com 2019-10-23T08:20:43.437 INFO:teuthology.lock.keys:New key found. Updating... 2019-10-23T08:20:43.466 INFO:teuthology.lock.keys:Checking smithi062.front.sepia.ceph.com 2019-10-23T08:20:43.466 INFO:teuthology.lock.keys:New key found. Updating... 2019-10-23T08:20:43.482 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2019-10-23T08:20:43.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:20:43.485 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:43.586 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:43.586 INFO:teuthology.orchestra.run.smithi038:> true 2019-10-23T08:20:43.976 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:43.976 INFO:teuthology.orchestra.run.smithi038:> uname -m 2019-10-23T08:20:44.063 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2019-10-23T08:20:44.063 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:44.063 INFO:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2019-10-23T08:20:44.141 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Linux" 2019-10-23T08:20:44.141 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="7 (Core)" 2019-10-23T08:20:44.141 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2019-10-23T08:20:44.141 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="7" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.centos.org/" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-10-23T08:20:44.142 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:20:44.143 INFO:teuthology.orchestra.run.smithi038.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-10-23T08:20:44.143 INFO:teuthology.orchestra.run.smithi038.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-10-23T08:20:44.143 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-10-23T08:20:44.143 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-10-23T08:20:44.143 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:20:44.144 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2019-10-23T08:20:44.167 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2019-10-23T08:20:44.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:20:44.168 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:44.253 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:44.253 INFO:teuthology.orchestra.run.smithi062:> true 2019-10-23T08:20:44.543 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:44.543 INFO:teuthology.orchestra.run.smithi062:> uname -m 2019-10-23T08:20:44.595 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2019-10-23T08:20:44.595 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:44.595 INFO:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2019-10-23T08:20:44.642 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Linux" 2019-10-23T08:20:44.643 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="7 (Core)" 2019-10-23T08:20:44.643 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2019-10-23T08:20:44.650 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2019-10-23T08:20:44.650 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="7" 2019-10-23T08:20:44.650 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-10-23T08:20:44.650 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2019-10-23T08:20:44.650 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-10-23T08:20:44.651 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.centos.org/" 2019-10-23T08:20:44.651 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-10-23T08:20:44.651 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:20:44.651 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-10-23T08:20:44.652 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-10-23T08:20:44.652 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-10-23T08:20:44.652 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-10-23T08:20:44.652 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:20:44.653 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2019-10-23T08:20:44.701 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-10-23T08:20:44.738 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSay8RRKHl6hyM/yoVefaYjw//r9Dn2++40dyF1+V3VAhuGIGPUfq6mlEBasCDma+WXZpngodPu1VAihHz353WeCUjwhPOc6021BlKg6kXkWS8FFXLjqcRZ2Vshdo30HdYR8pJmkQD2qjqtOVOBH2gIQCNKAPszEUwhEacmFZF5VD1CnmO4SRuMG32WUNCPlD3/VUyR++8xU+tOsJDssAKTMjo47HCXENz2cZ++hH0cyX2fi0W/gMoTWR8wD4rbKP+ETlwkmGitGj+CsEYEYvU3vE+2YJnvWJ5evOTizvLTv+hURnMgbcPAgWsXMq/W2BAwqZcqX8J2qmUxSbOpgrL smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSgWQejVaUiCNSgXu+Q8J4Rk7qRrkt7vCHePdxgHgdNt/dMTihayyyXohuwCikobvgXs5+75tRwdPdNbjJofG3OBSmNrpNVWAXceBPdI6nct7xulSo170MIfOySbgF/49+oPn1lsFOgC001erY7PRQhzbRCIOqYioypedMkmYk5EWK8yLm+w7iddrtCFTP2SGfXVJJj2Cbr7jm6O7Pv0MbybCUPhNeuHYAT/I1eLemT1t+//9fi1VxZ5shUrEWBYzlwTVROb7EOinjiBolBhmyGy8lp3gE0qR+9wdzxoCYEvtSTSwUqh6T+01sMyfZVBzqucbswvpZuJb/vNfe9Ejz 2019-10-23T08:20:44.739 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-10-23T08:20:44.799 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-10-23T08:20:44.828 INFO:teuthology.task.internal:Saving configuration 2019-10-23T08:20:44.852 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-10-23T08:20:44.860 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-10-23T08:20:44.874 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-10-23 08:15:53.850558', u'locked_by': u'scheduled_sjust@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi038.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxGd7mC9dt4Tq4ZC0MbYmAtZWn+kf3IBEGF2wFBrkSGGex6fufeaT+PO+CjEr2irtQeRdZwZ+CYa9Q7Gjpouxo=', u'description': u'/home/teuthworker/archive/sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi/4435270'} 2019-10-23T08:20:44.887 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-10-23 08:15:53.850539', u'locked_by': u'scheduled_sjust@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi062.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7+3HAeNv08TgxjjXYDp1Tv6aBYY5TnpctWEA/h9si9i7xzoJR77l4jO8Zm5mE9e2tcQDsbHLVBTkc4ZOHpdZM=', u'description': u'/home/teuthworker/archive/sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi/4435270'} 2019-10-23T08:20:44.887 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-10-23T08:20:44.906 INFO:teuthology.task.internal:roles: ubuntu@smithi038.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-10-23T08:20:44.906 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-10-23T08:20:44.906 INFO:teuthology.run_tasks:Running task console_log... 2019-10-23T08:20:45.089 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-10-23T08:20:45.089 INFO:teuthology.run_tasks:Running task internal.connect... 2019-10-23T08:20:45.099 INFO:teuthology.task.internal:Opening connections... 2019-10-23T08:20:45.099 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:20:45.101 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:45.210 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:20:45.211 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:20:45.313 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-10-23T08:20:45.322 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:45.323 INFO:teuthology.orchestra.run.smithi038:> uname -m 2019-10-23T08:20:45.499 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2019-10-23T08:20:45.499 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:45.500 INFO:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2019-10-23T08:20:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Linux" 2019-10-23T08:20:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="7 (Core)" 2019-10-23T08:20:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2019-10-23T08:20:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2019-10-23T08:20:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="7" 2019-10-23T08:20:45.548 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.centos.org/" 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-10-23T08:20:45.549 INFO:teuthology.orchestra.run.smithi038.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-10-23T08:20:45.550 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-10-23T08:20:45.550 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-10-23T08:20:45.550 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:20:45.550 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2019-10-23T08:20:45.575 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:45.575 INFO:teuthology.orchestra.run.smithi062:> uname -m 2019-10-23T08:20:45.651 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2019-10-23T08:20:45.651 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:45.652 INFO:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2019-10-23T08:20:45.700 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Linux" 2019-10-23T08:20:45.700 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="7 (Core)" 2019-10-23T08:20:45.700 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2019-10-23T08:20:45.701 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2019-10-23T08:20:45.701 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="7" 2019-10-23T08:20:45.701 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-10-23T08:20:45.701 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2019-10-23T08:20:45.701 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-10-23T08:20:45.701 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.centos.org/" 2019-10-23T08:20:45.702 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-10-23T08:20:45.702 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:20:45.702 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-10-23T08:20:45.702 INFO:teuthology.orchestra.run.smithi062.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-10-23T08:20:45.702 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-10-23T08:20:45.703 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-10-23T08:20:45.703 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:20:45.703 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2019-10-23T08:20:45.716 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-10-23T08:20:45.738 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-10-23T08:20:45.756 INFO:teuthology.task.internal:Checking for old test directory... 2019-10-23T08:20:45.756 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:45.756 INFO:teuthology.orchestra.run.smithi038:> test '!' -e /home/ubuntu/cephtest 2019-10-23T08:20:45.761 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:45.761 INFO:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2019-10-23T08:20:45.857 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-10-23T08:20:45.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-10-23T08:20:45.889 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:45.889 INFO:teuthology.orchestra.run.smithi038:> test -z $(ls -A /var/lib/ceph) 2019-10-23T08:20:45.899 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:45.900 INFO:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2019-10-23T08:20:45.992 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-10-23T08:20:46.046 INFO:teuthology.run_tasks:Running task kernel... 2019-10-23T08:20:46.111 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-10-23T08:20:46.112 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-10-23T08:20:46.112 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:20:46.112 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:46.113 INFO:teuthology.orchestra.run.smithi038:> sudo package-cleanup -y --oldkernels 2019-10-23T08:20:47.039 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:20:50.662 INFO:teuthology.orchestra.run.smithi038.stdout:No old kernels to remove 2019-10-23T08:20:50.680 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:20:50.681 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:20:50.681 INFO:teuthology.orchestra.run.smithi062:> sudo package-cleanup -y --oldkernels 2019-10-23T08:20:51.582 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:20:55.877 INFO:teuthology.orchestra.run.smithi062.stdout:No old kernels to remove 2019-10-23T08:20:55.889 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:55.889 INFO:teuthology.orchestra.run.smithi038:> uname -r 2019-10-23T08:20:55.991 INFO:teuthology.orchestra.run.smithi038.stdout:3.10.0-957.27.2.el7.x86_64 2019-10-23T08:20:55.991 INFO:teuthology.task.kernel:Running kernel on smithi038: 3.10.0-957.27.2.el7.x86_64 2019-10-23T08:20:55.991 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:20:55.991 INFO:teuthology.orchestra.run.smithi038:> sudo yum install -y kernel 2019-10-23T08:20:56.304 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:20:56.377 INFO:teuthology.orchestra.run.smithi038.stdout:Determining fastest mirrors 2019-10-23T08:20:56.544 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:20:56.545 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:20:56.545 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:20:56.547 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repos-va.psychz.net 2019-10-23T08:20:59.615 INFO:teuthology.orchestra.run.smithi038.stdout:1 packages excluded due to repository priority protections 2019-10-23T08:20:59.984 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:20:59.984 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:20:59.984 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.1.el7 will be installed 2019-10-23T08:21:00.252 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: linux-firmware >= 20190429-72 for package: kernel-3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:21:00.360 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:21:00.360 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package linux-firmware.noarch 0:20180911-69.git85c5d90.el7 will be updated 2019-10-23T08:21:00.385 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package linux-firmware.noarch 0:20190429-72.gitddde598.el7 will be an update 2019-10-23T08:21:01.460 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:21:02.044 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:02.045 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:21:02.052 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:02.053 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:21:02.053 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:21:02.053 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:21:02.053 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:21:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: kernel x86_64 3.10.0-1062.4.1.el7 updates 50 M 2019-10-23T08:21:02.054 INFO:teuthology.orchestra.run.smithi038.stdout:Updating for dependencies: 2019-10-23T08:21:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: linux-firmware noarch 20190429-72.gitddde598.el7 base 73 M 2019-10-23T08:21:02.054 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:02.055 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:21:02.055 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:21:02.055 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2019-10-23T08:21:02.055 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade ( 1 Dependent package) 2019-10-23T08:21:02.056 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:02.056 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 123 M 2019-10-23T08:21:02.056 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:21:02.057 INFO:teuthology.orchestra.run.smithi038.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-10-23T08:21:03.916 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:21:03.916 INFO:teuthology.orchestra.run.smithi038.stdout:Total 66 MB/s | 123 MB 00:01 2019-10-23T08:21:03.991 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:21:04.183 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:21:05.074 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:21:05.074 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:21:16.303 INFO:teuthology.orchestra.run.smithi038.stdout: Updating : linux-firmware-20190429-72.gitddde598.el7.noarch 1/3 2019-10-23T08:21:21.360 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : kernel-3.10.0-1062.4.1.el7.x86_64 2/3 2019-10-23T08:21:50.200 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : linux-firmware-20180911-69.git85c5d90.el7.noarch 3/3 2019-10-23T08:21:50.371 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : kernel-3.10.0-1062.4.1.el7.x86_64 1/3 2019-10-23T08:21:50.497 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : linux-firmware-20190429-72.gitddde598.el7.noarch 2/3 2019-10-23T08:21:50.868 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : linux-firmware-20180911-69.git85c5d90.el7.noarch 3/3 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout: kernel.x86_64 0:3.10.0-1062.4.1.el7 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Updated: 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout: linux-firmware.noarch 0:20190429-72.gitddde598.el7 2019-10-23T08:21:50.869 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:21:50.870 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:21:51.009 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:21:51.010 INFO:teuthology.orchestra.run.smithi038:> rpm -q kernel --last | head -n 1 2019-10-23T08:21:51.409 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Wed 23 Oct 2019 08:21:16 AM UTC 2019-10-23T08:21:51.413 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:21:51.414 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-957.27.2.el7.x86_64 Expected: 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:21:51.414 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:21:51.414 INFO:teuthology.orchestra.run.smithi062:> uname -r 2019-10-23T08:21:51.553 INFO:teuthology.orchestra.run.smithi062.stdout:3.10.0-957.27.2.el7.x86_64 2019-10-23T08:21:51.554 INFO:teuthology.task.kernel:Running kernel on smithi062: 3.10.0-957.27.2.el7.x86_64 2019-10-23T08:21:51.554 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:21:51.554 INFO:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2019-10-23T08:21:51.850 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:21:51.893 INFO:teuthology.orchestra.run.smithi062.stdout:Determining fastest mirrors 2019-10-23T08:21:52.083 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:21:52.084 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:21:52.084 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:21:52.085 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:21:55.245 INFO:teuthology.orchestra.run.smithi062.stdout:1 packages excluded due to repository priority protections 2019-10-23T08:21:55.621 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:21:55.622 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:21:55.622 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.1.el7 will be installed 2019-10-23T08:21:55.887 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: linux-firmware >= 20190429-72 for package: kernel-3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:21:55.987 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:21:55.987 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package linux-firmware.noarch 0:20180911-69.git85c5d90.el7 will be updated 2019-10-23T08:21:56.016 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package linux-firmware.noarch 0:20190429-72.gitddde598.el7 will be an update 2019-10-23T08:21:57.049 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:21:57.622 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:21:57.622 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 3.10.0-1062.4.1.el7 updates 50 M 2019-10-23T08:21:57.631 INFO:teuthology.orchestra.run.smithi062.stdout:Updating for dependencies: 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout: linux-firmware noarch 20190429-72.gitddde598.el7 base 73 M 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade ( 1 Dependent package) 2019-10-23T08:21:57.632 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:21:57.633 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 123 M 2019-10-23T08:21:57.633 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:21:57.633 INFO:teuthology.orchestra.run.smithi062.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-10-23T08:21:59.269 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:21:59.270 INFO:teuthology.orchestra.run.smithi062.stdout:Total 75 MB/s | 123 MB 00:01 2019-10-23T08:21:59.342 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:21:59.532 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:22:00.405 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:22:00.405 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:22:11.613 INFO:teuthology.orchestra.run.smithi062.stdout: Updating : linux-firmware-20190429-72.gitddde598.el7.noarch 1/3 2019-10-23T08:22:16.734 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-3.10.0-1062.4.1.el7.x86_64 2/3 2019-10-23T08:22:45.824 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : linux-firmware-20180911-69.git85c5d90.el7.noarch 3/3 2019-10-23T08:22:46.026 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-3.10.0-1062.4.1.el7.x86_64 1/3 2019-10-23T08:22:46.152 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : linux-firmware-20190429-72.gitddde598.el7.noarch 2/3 2019-10-23T08:22:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : linux-firmware-20180911-69.git85c5d90.el7.noarch 3/3 2019-10-23T08:22:46.508 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:22:46.508 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:22:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: kernel.x86_64 0:3.10.0-1062.4.1.el7 2019-10-23T08:22:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:22:46.509 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Updated: 2019-10-23T08:22:46.509 INFO:teuthology.orchestra.run.smithi062.stdout: linux-firmware.noarch 0:20190429-72.gitddde598.el7 2019-10-23T08:22:46.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:22:46.510 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:22:46.648 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:46.648 INFO:teuthology.orchestra.run.smithi062:> rpm -q kernel --last | head -n 1 2019-10-23T08:22:47.046 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Wed 23 Oct 2019 08:22:11 AM UTC 2019-10-23T08:22:47.048 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:47.048 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-957.27.2.el7.x86_64 Expected: 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:47.049 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-10-23T08:22:47.049 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-10-23T08:22:47.049 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-10-23T08:22:47.049 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-10-23T08:22:47.049 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi038.front.sepia.ceph.com, path=None, version=distro) 2019-10-23T08:22:47.049 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:47.049 INFO:teuthology.orchestra.run.smithi038:> rpm -q kernel --last | head -n 1 2019-10-23T08:22:47.423 INFO:teuthology.orchestra.run.smithi038.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Wed 23 Oct 2019 08:21:16 AM UTC 2019-10-23T08:22:47.424 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:47.424 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:47.425 INFO:teuthology.orchestra.run.smithi038:> sudo rpm -qi grub2 2019-10-23T08:22:47.605 INFO:teuthology.orchestra.run.smithi038.stdout:Name : grub2 2019-10-23T08:22:47.605 INFO:teuthology.orchestra.run.smithi038.stdout:Epoch : 1 2019-10-23T08:22:47.605 INFO:teuthology.orchestra.run.smithi038.stdout:Version : 2.02 2019-10-23T08:22:47.605 INFO:teuthology.orchestra.run.smithi038.stdout:Release : 0.76.el7.centos 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Architecture: x86_64 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Install Date: Wed 14 Aug 2019 05:05:05 PM UTC 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Group : System Environment/Base 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Size : 0 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:License : GPLv3+ 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-10-23T08:22:47.606 INFO:teuthology.orchestra.run.smithi038.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:Build Host : kbuilder.bsys.centos.org 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:Relocations : (not relocatable) 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:Packager : CentOS BuildSystem 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:Vendor : CentOS 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:URL : http://www.gnu.org/software/grub/ 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-10-23T08:22:47.607 INFO:teuthology.orchestra.run.smithi038.stdout:Description : 2019-10-23T08:22:47.608 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:22:47.608 INFO:teuthology.orchestra.run.smithi038.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-10-23T08:22:47.608 INFO:teuthology.orchestra.run.smithi038.stdout:customizable bootloader with modular architecture. It supports a rich 2019-10-23T08:22:47.608 INFO:teuthology.orchestra.run.smithi038.stdout:variety of kernel formats, file systems, computer architectures and 2019-10-23T08:22:47.608 INFO:teuthology.orchestra.run.smithi038.stdout:hardware devices. 2019-10-23T08:22:47.609 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-10-23T08:22:47.609 INFO:teuthology.task.kernel:Updating grub on smithi038 to boot 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:47.610 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:47.610 INFO:teuthology.orchestra.run.smithi038:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-10-23T08:22:48.084 INFO:teuthology.orchestra.run.smithi038.stderr:Generating grub configuration file ... 2019-10-23T08:22:48.239 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:48.262 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-10-23T08:22:48.593 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.27.2.el7.x86_64 2019-10-23T08:22:48.622 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initramfs-3.10.0-957.27.2.el7.x86_64.img 2019-10-23T08:22:48.668 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-10-23T08:22:48.692 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-10-23T08:22:48.731 INFO:teuthology.orchestra.run.smithi038.stderr:Found linux image: /boot/vmlinuz-0-rescue-48f603b7a56f4bb39f72becf12f3b725 2019-10-23T08:22:48.744 INFO:teuthology.orchestra.run.smithi038.stderr:Found initrd image: /boot/initramfs-0-rescue-48f603b7a56f4bb39f72becf12f3b725.img 2019-10-23T08:22:49.994 INFO:teuthology.orchestra.run.smithi038.stderr:done 2019-10-23T08:22:49.996 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:49.997 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:22:50.085 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.0p1vtlo9oE 2019-10-23T08:22:50.086 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:50.086 INFO:teuthology.orchestra.run.smithi038:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0p1vtlo9oE 2019-10-23T08:22:50.190 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:50.190 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.0p1vtlo9oE 2019-10-23T08:22:50.414 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.0p1vtlo9oE is 6KB 2019-10-23T08:22:50.524 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:50.524 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.0p1vtlo9oE 2019-10-23T08:22:50.613 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:50.613 INFO:teuthology.orchestra.run.smithi038:> sudo grub2-set-default 0 2019-10-23T08:22:50.811 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:22:50.811 INFO:teuthology.orchestra.run.smithi038:> sudo shutdown -r now 2019-10-23T08:22:50.816 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-10-23T08:22:50.816 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2019-10-23T08:22:50.816 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:50.816 INFO:teuthology.orchestra.run.smithi062:> rpm -q kernel --last | head -n 1 2019-10-23T08:22:51.177 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-3.10.0-1062.4.1.el7.x86_64 Wed 23 Oct 2019 08:22:11 AM UTC 2019-10-23T08:22:51.179 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:51.179 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:51.179 INFO:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2 2019-10-23T08:22:51.344 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2 2019-10-23T08:22:51.344 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2019-10-23T08:22:51.344 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.02 2019-10-23T08:22:51.344 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 0.76.el7.centos 2019-10-23T08:22:51.344 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Wed 14 Aug 2019 05:05:05 PM UTC 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Group : System Environment/Base 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 0 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-10-23T08:22:51.345 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : kbuilder.bsys.centos.org 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:Relocations : (not relocatable) 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : CentOS BuildSystem 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-10-23T08:22:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2019-10-23T08:22:51.347 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:22:51.347 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-10-23T08:22:51.347 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2019-10-23T08:22:51.347 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2019-10-23T08:22:51.347 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2019-10-23T08:22:51.348 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-10-23T08:22:51.352 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:51.353 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:51.353 INFO:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-10-23T08:22:51.845 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2019-10-23T08:22:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:22:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-10-23T08:22:52.348 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.27.2.el7.x86_64 2019-10-23T08:22:52.386 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-3.10.0-957.27.2.el7.x86_64.img 2019-10-23T08:22:52.431 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-10-23T08:22:52.457 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-10-23T08:22:52.484 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-0-rescue-48f603b7a56f4bb39f72becf12f3b725 2019-10-23T08:22:52.496 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initramfs-0-rescue-48f603b7a56f4bb39f72becf12f3b725.img 2019-10-23T08:22:53.682 INFO:teuthology.orchestra.run.smithi062.stderr:done 2019-10-23T08:22:53.684 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:53.684 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:22:53.744 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.XzVZfxm9Ep 2019-10-23T08:22:53.745 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:53.745 INFO:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XzVZfxm9Ep 2019-10-23T08:22:53.812 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:53.812 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.XzVZfxm9Ep 2019-10-23T08:22:53.934 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.XzVZfxm9Ep is 6KB 2019-10-23T08:22:54.001 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:54.001 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.XzVZfxm9Ep 2019-10-23T08:22:54.082 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:54.083 INFO:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 0 2019-10-23T08:22:54.348 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:54.348 INFO:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2019-10-23T08:22:54.353 INFO:teuthology.misc:Re-opening connections... 2019-10-23T08:22:54.353 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:22:54.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:22:54.354 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:22:54.355 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2019-10-23T08:22:54.355 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:22:54.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:22:54.364 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:22:54.465 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:22:54.465 INFO:teuthology.orchestra.run.smithi062:> true 2019-10-23T08:22:54.799 DEBUG:teuthology.misc:waited 0.446209192276 2019-10-23T08:22:55.801 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:22:55.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:22:55.802 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:22:55.807 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2019-10-23T08:22:55.807 DEBUG:teuthology.misc:waited 1.45406103134 2019-10-23T08:22:56.808 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:22:56.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:22:56.808 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:22:56.809 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.38 2019-10-23T08:22:56.810 DEBUG:teuthology.misc:waited 2.45662522316 2019-10-23T08:22:57.810 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:22:57.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:22:57.811 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:23:57.815 DEBUG:teuthology.orchestra.remote:timed out 2019-10-23T08:23:57.816 DEBUG:teuthology.misc:waited 63.4625711441 2019-10-23T08:23:58.816 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:23:58.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:23:58.817 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:24:58.818 DEBUG:teuthology.orchestra.remote:timed out 2019-10-23T08:24:58.820 DEBUG:teuthology.misc:waited 124.466938019 2019-10-23T08:24:59.821 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:24:59.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:24:59.822 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:24:59.962 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:24:59.963 INFO:teuthology.orchestra.run.smithi038:> true 2019-10-23T08:25:00.397 DEBUG:teuthology.misc:waited 126.043930054 2019-10-23T08:25:01.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-10-23T08:25:01.398 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.1.el7.x86_64"... 2019-10-23T08:25:01.398 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:01.399 INFO:teuthology.orchestra.run.smithi038:> uname -r 2019-10-23T08:25:01.498 INFO:teuthology.orchestra.run.smithi038.stdout:3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:25:01.498 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:25:01.499 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-10-23T08:25:01.499 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-10-23T08:25:01.499 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.1.el7.x86_64"... 2019-10-23T08:25:01.500 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:01.500 INFO:teuthology.orchestra.run.smithi062:> uname -r 2019-10-23T08:25:01.508 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-10-23T08:25:01.510 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 704, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 183, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 205, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 432, in run r.execute() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 102, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 493, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 806, in open_session timeout=timeout, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 933, in open_channel raise e error: [Errno 104] Connection reset by peer 2019-10-23T08:25:02.513 INFO:teuthology.misc:Re-opening connections... 2019-10-23T08:25:02.513 INFO:teuthology.misc:trying to connect to ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:25:02.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:25:02.515 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:25:02.622 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:02.623 INFO:teuthology.orchestra.run.smithi038:> true 2019-10-23T08:25:03.052 DEBUG:teuthology.misc:waited 0.53893494606 2019-10-23T08:25:04.053 INFO:teuthology.misc:trying to connect to ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:25:04.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:25:04.054 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:25:04.196 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:04.196 INFO:teuthology.orchestra.run.smithi062:> true 2019-10-23T08:25:04.606 DEBUG:teuthology.misc:waited 2.09260296822 2019-10-23T08:25:05.606 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-10-23T08:25:05.607 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.1.el7.x86_64"... 2019-10-23T08:25:05.607 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:05.607 INFO:teuthology.orchestra.run.smithi062:> uname -r 2019-10-23T08:25:05.711 INFO:teuthology.orchestra.run.smithi062.stdout:3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:25:05.711 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.1.el7.x86_64 2019-10-23T08:25:05.711 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-10-23T08:25:06.713 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-10-23T08:25:06.713 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:06.713 INFO:teuthology.orchestra.run.smithi038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-10-23T08:25:06.867 INFO:teuthology.orchestra.run.smithi038.stdout:ttyS1 2019-10-23T08:25:06.880 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-10-23T08:25:06.881 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:06.881 INFO:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-10-23T08:25:07.038 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2019-10-23T08:25:07.050 INFO:teuthology.run_tasks:Running task internal.base... 2019-10-23T08:25:07.059 INFO:teuthology.task.internal:Creating test directory... 2019-10-23T08:25:07.059 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.060 INFO:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-10-23T08:25:07.065 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:07.065 INFO:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-10-23T08:25:07.151 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-10-23T08:25:07.162 INFO:teuthology.run_tasks:Running task internal.archive... 2019-10-23T08:25:07.192 INFO:teuthology.task.internal:Creating archive directory... 2019-10-23T08:25:07.193 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.193 INFO:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-10-23T08:25:07.199 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:07.199 INFO:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-10-23T08:25:07.296 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-10-23T08:25:07.310 INFO:teuthology.task.internal:Enabling coredump saving... 2019-10-23T08:25:07.310 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.311 INFO:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-10-23T08:25:07.323 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:07.323 INFO:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-10-23T08:25:07.441 INFO:teuthology.orchestra.run.smithi038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-10-23T08:25:07.444 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-10-23T08:25:07.446 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-10-23T08:25:07.457 INFO:teuthology.task.internal:Configuring sudo... 2019-10-23T08:25:07.457 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.457 INFO:teuthology.orchestra.run.smithi038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-10-23T08:25:07.471 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:07.471 INFO:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-10-23T08:25:07.594 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-10-23T08:25:07.647 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-10-23T08:25:07.647 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.648 INFO:teuthology.orchestra.run.smithi038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-10-23T08:25:07.653 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:07.653 INFO:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-10-23T08:25:07.747 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.747 INFO:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-10-23T08:25:07.847 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.848 INFO:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-10-23T08:25:07.976 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:07.977 INFO:teuthology.orchestra.run.smithi038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-10-23T08:25:08.077 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:08.077 INFO:teuthology.orchestra.run.smithi038:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-10-23T08:25:08.193 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:08.193 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-10-23T08:25:08.297 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:08.297 INFO:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-10-23T08:25:08.414 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:08.415 INFO:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-10-23T08:25:08.540 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:08.540 INFO:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-10-23T08:25:08.640 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:08.641 INFO:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-10-23T08:25:08.747 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:08.747 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-10-23T08:25:08.848 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:08.849 INFO:teuthology.orchestra.run.smithi038:> sudo service rsyslog restart 2019-10-23T08:25:08.853 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:08.854 INFO:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2019-10-23T08:25:08.963 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-10-23T08:25:09.022 INFO:teuthology.orchestra.run.smithi038.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-10-23T08:25:09.090 INFO:teuthology.run_tasks:Running task internal.timer... 2019-10-23T08:25:09.098 INFO:teuthology.task.internal:Starting timer... 2019-10-23T08:25:09.098 INFO:teuthology.run_tasks:Running task pcp... 2019-10-23T08:25:09.159 INFO:teuthology.run_tasks:Running task selinux... 2019-10-23T08:25:09.170 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:09.170 INFO:teuthology.orchestra.run.smithi038:> sudo service auditd rotate 2019-10-23T08:25:09.360 INFO:teuthology.orchestra.run.smithi038.stdout:Rotating logs: [ OK ] 2019-10-23T08:25:09.363 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:09.363 INFO:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2019-10-23T08:25:09.530 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: [ OK ] 2019-10-23T08:25:09.533 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-10-23T08:25:09.534 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:09.534 INFO:teuthology.orchestra.run.smithi038:> /usr/sbin/getenforce 2019-10-23T08:25:09.634 INFO:teuthology.orchestra.run.smithi038.stdout:Permissive 2019-10-23T08:25:09.635 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:09.635 INFO:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2019-10-23T08:25:09.738 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2019-10-23T08:25:09.739 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi038.front.sepia.ceph.com': 'permissive'} 2019-10-23T08:25:09.739 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:09.739 INFO:teuthology.orchestra.run.smithi038:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-10-23T08:25:09.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-10-23T08:25:09.859 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:09.859 INFO:teuthology.orchestra.run.smithi062:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-10-23T08:25:09.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-10-23T08:25:09.972 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-10-23T08:25:09.973 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:25:09.973 INFO:teuthology.orchestra.run.smithi038:> sudo /usr/sbin/setenforce permissive 2019-10-23T08:25:10.096 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:25:10.096 INFO:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2019-10-23T08:25:10.240 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-10-23T08:25:10.254 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-10-23T08:25:10.289 INFO:teuthology.repo_utils:Fetching master from upstream 2019-10-23T08:25:10.417 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch master 2019-10-23T08:25:10.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'set_python_path.yml'}, {'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-10-23T08:25:10.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi038.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-10-23T08:25:10.952 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-10-23T08:25:14.912 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-10-23T08:25:14.935 INFO:teuthology.task.ansible.out: TASK [Check for /usr/bin/python] *********************************************** 2019-10-23T08:25:14.935 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:14 +0000 (0:00:00.072) 0:00:00.072 ***** 2019-10-23T08:25:17.132 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"discovered_interpreter_python": "/usr/bin/python"}, "changed": true, "cmd": "echo marco", "delta": "0:00:00.005711", "end": "2019-10-23 08:25:17.103765", "rc": 0, "start": "2019-10-23 08:25:17.098054", "stderr": "", "stderr_lines": [], "stdout": "marco", "stdout_lines": ["marco"]} 2019-10-23T08:25:17.205 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"discovered_interpreter_python": "/usr/bin/python"}, "changed": true, "cmd": "echo marco", "delta": "0:00:00.005191", "end": "2019-10-23 08:25:17.175713", "rc": 0, "start": "2019-10-23 08:25:17.170522", "stderr": "", "stderr_lines": [], "stdout": "marco", "stdout_lines": ["marco"]} 2019-10-23T08:25:17.223 INFO:teuthology.task.ansible.out: TASK [Set ansible_python_interpreter=/usr/bin/python3] ************************* 2019-10-23T08:25:17.224 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:17 +0000 (0:00:02.287) 0:00:02.360 ***** 2019-10-23T08:25:17.254 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:17.268 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:17.274 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-10-23T08:25:17.287 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:17 +0000 (0:00:00.063) 0:00:02.424 ***** 2019-10-23T08:25:17.303 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:17 +0000 (0:00:00.016) 0:00:02.440 ***** 2019-10-23T08:25:18.811 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-10-23T08:25:18.825 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_all_ipv4_addresses": ["172.21.15.62"], "ansible_all_ipv6_addresses": ["fe80::ec4:7aff:febb:d1c3"], "ansible_apparmor": {"status": "disabled"}, "ansible_architecture": "x86_64", "ansible_bios_date": "12/17/2015", "ansible_bios_version": "2.0", "ansible_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": "ttyS1,115200", "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_date_time": {"date": "2019-10-23", "day": "23", "epoch": "1571819118", "hour": "08", "iso8601": "2019-10-23T08:25:18Z", "iso8601_basic": "20191023T082518715024", "iso8601_basic_short": "20191023T082518", "iso8601_micro": "2019-10-23T08:25:18.715146Z", "minute": "25", "month": "10", "second": "18", "time": "08:25:18", "tz": "UTC", "tz_offset": "+0000", "weekday": "Wednesday", "weekday_number": "3", "weeknumber": "42", "year": "2019"}, "ansible_default_ipv4": {"address": "172.21.15.62", "alias": "enp3s0f1", "broadcast": "172.21.15.255", "gateway": "172.21.15.254", "interface": "enp3s0f1", "macaddress": "0c:c4:7a:bb:d1:c3", "mtu": 1500, "netmask": "255.255.240.0", "network": "172.21.0.0", "type": "ether"}, "ansible_default_ipv6": {"address": "fe80::ec4:7aff:febb:d1c3", "gateway": "fe80::327c:5e00:6487:71e0", "interface": "enp3s0f1", "macaddress": "0c:c4:7a:bb:d1:c3", "mtu": 1500, "prefix": "64", "scope": "link", "type": "ether"}, "ansible_device_links": {"ids": {"dm-0": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp"], "dm-1": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1"], "dm-2": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIrl"], "dm-3": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4"], "dm-4": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4M5k6LueTK 2019-10-23T08:25:18.826 INFO:teuthology.task.ansible.out:uLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr"], "nvme0n1": ["lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "sda": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "sda1": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"]}, "labels": {}, "masters": {"nvme0n1": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"]}, "uuids": {"dm-0": ["d3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b"], "dm-1": ["9d94d61b-6ff2-4df6-a5d7-dde722533a1e"], "dm-2": ["628f887b-3b78-46d8-bb4d-9a0064b6af15"], "dm-3": ["54cd6336-eb15-4664-bfdd-39f164a54798"], "dm-4": ["13cadbc7-0d9d-408e-9a4a-848b6a087cfc"], "sda1": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}}, "ansible_devices": {"dm-0": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp"], "labels": [], "masters": [], "uuids": ["d3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-1": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1"], "labels": [], "masters": [], "uuids": ["9d94d61b-6ff2-4df6-a5d7-dde722533a1e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-2": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIr 2019-10-23T08:25:18.828 INFO:teuthology.task.ansible.out:l"], "labels": [], "masters": [], "uuids": ["628f887b-3b78-46d8-bb4d-9a0064b6af15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-3": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4"], "labels": [], "masters": [], "uuids": ["54cd6336-eb15-4664-bfdd-39f164a54798"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-4": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr"], "labels": [], "masters": [], "uuids": ["13cadbc7-0d9d-408e-9a4a-848b6a087cfc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "nvme0n1": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mo 2019-10-23T08:25:18.829 INFO:teuthology.task.ansible.out:de": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "sda": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, "ansible_distribution": "CentOS", "ansible_distribution_file_parsed": true, "ansible_distribution_file_path": "/etc/redhat-release", "ansible_distribution_file_variety": "RedHat", "ansible_distribution_major_version": "7", "ansible_distribution_release": "Core", "ansible_distribution_version": "7", "ansible_dns": {"nameservers": ["172.21.0.1", "172.21.0.2"], "search": ["front.sepia.ceph.com", "sepia.ceph.com"]}, "ansible_domain": "front.sepia.ceph.com", "ansible_effective_group_id": 0, "ansible_effective_user_id": 0, "ansible_eno1": {"active": false, "device": "eno1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on 2019-10-23T08:25:18.830 INFO:teuthology.task.ansible.out:", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7a:a9:aa:14", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.0", "phc_index": 0, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_eno2": {"active": false, "device": "eno2", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": " 2019-10-23T08:25:18.832 INFO:teuthology.task.ansible.out:off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7a:a9:aa:15", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.1", "phc_index": 1, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_enp3s0f0": {"active": false, "device": "enp3s0f0", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksummin 2019-10-23T08:25:18.834 INFO:teuthology.task.ansible.out:g": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event"], "macadd 2019-10-23T08:25:18.835 INFO:teuthology.task.ansible.out:ress": "0c:c4:7a:bb:d1:c2", "module": "ixgbe", "mtu": 1500, "pciid": "0000:03:00.0", "phc_index": 2, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_enp3s0f1": {"active": true, "device": "enp3s0f1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event 2019-10-23T08:25:18.837 INFO:teuthology.task.ansible.out:"], "ipv4": {"address": "172.21.15.62", "broadcast": "172.21.15.255", "netmask": "255.255.240.0", "network": "172.21.0.0"}, "ipv6": [{"address": "fe80::ec4:7aff:febb:d1c3", "prefix": "64", "scope": "link"}], "macaddress": "0c:c4:7a:bb:d1:c3", "module": "ixgbe", "mtu": 1500, "pciid": "0000:03:00.1", "phc_index": 3, "promisc": false, "speed": 10000, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_env": {"HOME": "/root", "LANG": "en_US.UTF-8", "LOGNAME": "root", "MAIL": "/var/mail/ubuntu", "PATH": "/sbin:/bin:/usr/sbin:/usr/bin", "PWD": "/home/ubuntu", "QTDIR": "/usr/lib64/qt-3.3", "SHELL": "/bin/bash", "SHLVL": "1", "SUDO_COMMAND": "/bin/sh -c echo BECOME-SUCCESS-bighgmwvyinciiyvqjxpmtzrwhchxycg ; /usr/bin/python", "SUDO_GID": "1209", "SUDO_UID": "1000", "SUDO_USER": "ubuntu", "TERM": "unknown", "USER": "root", "USERNAME": "root", "XDG_SESSION_ID": "2", "_": "/usr/bin/python"}, "ansible_fibre_channel_wwn": [], "ansible_fips": false, "ansible_form_factor": "Other", "ansible_fqdn": "smithi062.front.sepia.ceph.com", "ansible_hostname": "smithi062", "ansible_hostnqn": "", "ansible_interfaces": ["enp3s0f1", "eno1", "eno2", "lo", "enp3s0f0"], "ansible_is_chroot": false, "ansible_iscsi_iqn": "", "ansible_kernel": "3.10.0-1062.4.1.el7.x86_64", "ansible_lo": {"active": true, "device": "lo", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off [fixed]", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "on [fixed]", "netns_local": "on [fixed]", "ntuple_filters": "off [fixed]", "receive_hashing": "off [fixed]", "rx_all": "off [fixed]", "rx_checksumming": "on [fixed]", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "off [fixed]", "rx_vlan_offload": "off [fixed]", 2019-10-23T08:25:18.840 INFO:teuthology.task.ansible.out:"rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on [fixed]", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on [fixed]", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_gre_segmentation": "off [fixed]", "tx_gso_partial": "off [fixed]", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_lockless": "on [fixed]", "tx_nocache_copy": "off [fixed]", "tx_scatter_gather": "on [fixed]", "tx_scatter_gather_fraglist": "on [fixed]", "tx_sctp_segmentation": "on", "tx_sit_segmentation": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "on", "tx_tcp_mangleid_segmentation": "on", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "off [fixed]", "tx_udp_tnl_segmentation": "off [fixed]", "tx_vlan_offload": "off [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "on", "vlan_challenged": "on [fixed]"}, "hw_timestamp_filters": [], "ipv4": {"address": "127.0.0.1", "broadcast": "host", "netmask": "255.0.0.0", "network": "127.0.0.0"}, "ipv6": [{"address": "::1", "prefix": "128", "scope": "host"}], "mtu": 65536, "promisc": false, "timestamping": ["rx_software", "software"], "type": "loopback"}, "ansible_local": {}, "ansible_lsb": {"codename": "Core", "description": "CentOS Linux release 7.6.1810 (Core)", "id": "CentOS", "major_release": "7", "release": "7.6.1810"}, "ansible_lvm": {"lvs": {"lv_1": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_2": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_3": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_4": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_5": {"size_g": "14.90", "vg": "vg_nvme"}}, "pvs": {"/dev/nvme0n1": {"free_g": "0.10", "size_g": "372.61", "vg": "vg_nvme"}}, "vgs": {"vg_nvme": {"free_g": "0.10", "num_lvs": "5", " 2019-10-23T08:25:18.841 INFO:teuthology.task.ansible.out:num_pvs": "1", "size_g": "372.61"}}}, "ansible_machine": "x86_64", "ansible_machine_id": "48f603b7a56f4bb39f72becf12f3b725", "ansible_memfree_mb": 31227, "ansible_memory_mb": {"nocache": {"free": 31484, "used": 414}, "real": {"free": 31227, "total": 31898, "used": 671}, "swap": {"cached": 0, "free": 0, "total": 0, "used": 0}}, "ansible_memtotal_mb": 31898, "ansible_mounts": [{"block_available": 227323609, "block_size": 4096, "block_total": 240324484, "block_used": 13000875, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967571, "inode_total": 61054976, "inode_used": 87405, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117502464, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}], "ansible_nodename": "smithi062.front.sepia.ceph.com", "ansible_os_family": "RedHat", "ansible_pkg_mgr": "yum", "ansible_proc_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": ["ttyS1,115200", "tty0", "ttyS1,115200"], "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_processor": ["0", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "1", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "2", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "3", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "4", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "5", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "6", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "7", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz"], "ansible_processor_cores": 4, "ansible_processor_count": 1, "ansible_processor_threads_per_core": 2, "ansible_processor_vcpus": 8, "ansible_product_name": "SYS-5018R-WR", "ansible_product_serial": "S188093X6125177", "ansible_product_uuid": "00000000-0000-0000-0000-0CC47AA9AA14", "ansible_product_version": "0123456789", "ansible_python": {"execu 2019-10-23T08:25:18.842 INFO:teuthology.task.ansible.out:table": "/usr/bin/python", "has_sslcontext": true, "type": "CPython", "version": {"major": 2, "micro": 5, "minor": 7, "releaselevel": "final", "serial": 0}, "version_info": [2, 7, 5, "final", 0]}, "ansible_python_version": "2.7.5", "ansible_real_group_id": 0, "ansible_real_user_id": 0, "ansible_selinux": {"config_mode": "permissive", "mode": "permissive", "policyvers": 31, "status": "enabled", "type": "targeted"}, "ansible_selinux_python_present": true, "ansible_service_mgr": "systemd", "ansible_ssh_host_key_ecdsa_public": "AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7+3HAeNv08TgxjjXYDp1Tv6aBYY5TnpctWEA/h9si9i7xzoJR77l4jO8Zm5mE9e2tcQDsbHLVBTkc4ZOHpdZM=", "ansible_ssh_host_key_ed25519_public": "AAAAC3NzaC1lZDI1NTE5AAAAIEErLAXT69Tll4TsPs8NAvSKu42h8Ju6zGpxTRXnezXx", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABAQDSgWQejVaUiCNSgXu+Q8J4Rk7qRrkt7vCHePdxgHgdNt/dMTihayyyXohuwCikobvgXs5+75tRwdPdNbjJofG3OBSmNrpNVWAXceBPdI6nct7xulSo170MIfOySbgF/49+oPn1lsFOgC001erY7PRQhzbRCIOqYioypedMkmYk5EWK8yLm+w7iddrtCFTP2SGfXVJJj2Cbr7jm6O7Pv0MbybCUPhNeuHYAT/I1eLemT1t+//9fi1VxZ5shUrEWBYzlwTVROb7EOinjiBolBhmyGy8lp3gE0qR+9wdzxoCYEvtSTSwUqh6T+01sMyfZVBzqucbswvpZuJb/vNfe9Ejz", "ansible_swapfree_mb": 0, "ansible_swaptotal_mb": 0, "ansible_system": "Linux", "ansible_system_capabilities": ["cap_chown", "cap_dac_override", "cap_dac_read_search", "cap_fowner", "cap_fsetid", "cap_kill", "cap_setgid", "cap_setuid", "cap_setpcap", "cap_linux_immutable", "cap_net_bind_service", "cap_net_broadcast", "cap_net_admin", "cap_net_raw", "cap_ipc_lock", "cap_ipc_owner", "cap_sys_module", "cap_sys_rawio", "cap_sys_chroot", "cap_sys_ptrace", "cap_sys_pacct", "cap_sys_admin", "cap_sys_boot", "cap_sys_nice", "cap_sys_resource", "cap_sys_time", "cap_sys_tty_config", "cap_mknod", "cap_lease", "cap_audit_write", "cap_audit_control", "cap_setfcap", "cap_mac_override", "cap_mac_admin", "cap_syslog", "35", "36+ep"], "ansible_system_capabilities_enforced": "True", "ansible_system_vendor": "Supe 2019-10-23T08:25:18.844 INFO:teuthology.task.ansible.out:rmicro", "ansible_uptime_seconds": 50, "ansible_user_dir": "/root", "ansible_user_gecos": "root", "ansible_user_gid": 0, "ansible_user_id": "root", "ansible_user_shell": "/bin/bash", "ansible_user_uid": 0, "ansible_userspace_architecture": "x86_64", "ansible_userspace_bits": "64", "ansible_virtualization_role": "host", "ansible_virtualization_type": "kvm", "gather_subset": ["all"], "module_setup": true}, "changed": false} 2019-10-23T08:25:18.854 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_all_ipv4_addresses": ["172.21.15.38"], "ansible_all_ipv6_addresses": ["fe80::ec4:7aff:febd:15fc"], "ansible_apparmor": {"status": "disabled"}, "ansible_architecture": "x86_64", "ansible_bios_date": "09/07/2015", "ansible_bios_version": "1.0c", "ansible_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": "ttyS1,115200", "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_date_time": {"date": "2019-10-23", "day": "23", "epoch": "1571819118", "hour": "08", "iso8601": "2019-10-23T08:25:18Z", "iso8601_basic": "20191023T082518734709", "iso8601_basic_short": "20191023T082518", "iso8601_micro": "2019-10-23T08:25:18.734837Z", "minute": "25", "month": "10", "second": "18", "time": "08:25:18", "tz": "UTC", "tz_offset": "+0000", "weekday": "Wednesday", "weekday_number": "3", "weeknumber": "42", "year": "2019"}, "ansible_default_ipv4": {"address": "172.21.15.38", "alias": "ens1f0", "broadcast": "172.21.15.255", "gateway": "172.21.15.254", "interface": "ens1f0", "macaddress": "0c:c4:7a:bd:15:fc", "mtu": 1500, "netmask": "255.255.240.0", "network": "172.21.0.0", "type": "ether"}, "ansible_default_ipv6": {"address": "fe80::ec4:7aff:febd:15fc", "gateway": "fe80::327c:5e00:6487:71e0", "interface": "ens1f0", "macaddress": "0c:c4:7a:bd:15:fc", "mtu": 1500, "prefix": "64", "scope": "link", "type": "ether"}, "ansible_device_links": {"ids": {"dm-0": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa"], "dm-1": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy"], "dm-2": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML"], "dm-3": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM"], "dm-4": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wxcXLE37e5OewfU 2019-10-23T08:25:18.856 INFO:teuthology.task.ansible.out:uI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs"], "nvme0n1": ["lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "sda": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "sda1": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"]}, "labels": {}, "masters": {"nvme0n1": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"]}, "uuids": {"dm-0": ["16c78bcb-656e-4175-9aba-b8bbee9a11d1"], "dm-1": ["bf102730-4a2c-442a-8fd0-fb53f015abb1"], "dm-2": ["fb710487-4043-45d5-8d67-9c19438f9404"], "dm-3": ["626003b6-1741-4127-a420-61310d26acbe"], "dm-4": ["d0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8"], "sda1": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}}, "ansible_devices": {"dm-0": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa"], "labels": [], "masters": [], "uuids": ["16c78bcb-656e-4175-9aba-b8bbee9a11d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-1": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy"], "labels": [], "masters": [], "uuids": ["bf102730-4a2c-442a-8fd0-fb53f015abb1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-2": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML"], "labels": [], "masters": [], "uuids": ["fb710487-4043-45d5 2019-10-23T08:25:18.857 INFO:teuthology.task.ansible.out:-8d67-9c19438f9404"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-3": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM"], "labels": [], "masters": [], "uuids": ["626003b6-1741-4127-a420-61310d26acbe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-4": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs"], "labels": [], "masters": [], "uuids": ["d0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "nvme0n1": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "51 2019-10-23T08:25:18.859 INFO:teuthology.task.ansible.out:2", "vendor": null, "virtual": 1}, "sda": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J33D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b5cd5"}}, "ansible_distribution": "CentOS", "ansible_distribution_file_parsed": true, "ansible_distribution_file_path": "/etc/redhat-release", "ansible_distribution_file_variety": "RedHat", "ansible_distribution_major_version": "7", "ansible_distribution_release": "Core", "ansible_distribution_version": "7", "ansible_dns": {"nameservers": ["172.21.0.1", "172.21.0.2"], "search": ["front.sepia.ceph.com", "sepia.ceph.com"]}, "ansible_domain": "front.sepia.ceph.com", "ansible_effective_group_id": 0, "ansible_effective_user_id": 0, "ansible_eno1": {"active": false, "device": "eno1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx 2019-10-23T08:25:18.861 INFO:teuthology.task.ansible.out:_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddr 2019-10-23T08:25:18.862 INFO:teuthology.task.ansible.out:ess": "0c:c4:7a:6b:fd:a2", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.0", "phc_index": 0, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_eno2": {"active": false, "device": "eno2", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7 2019-10-23T08:25:18.863 INFO:teuthology.task.ansible.out:a:6b:fd:a3", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.1", "phc_index": 1, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_ens1f0": {"active": true, "device": "ens1f0", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event"], "ipv4": {"address 2019-10-23T08:25:18.865 INFO:teuthology.task.ansible.out:": "172.21.15.38", "broadcast": "172.21.15.255", "netmask": "255.255.240.0", "network": "172.21.0.0"}, "ipv6": [{"address": "fe80::ec4:7aff:febd:15fc", "prefix": "64", "scope": "link"}], "macaddress": "0c:c4:7a:bd:15:fc", "module": "ixgbe", "mtu": 1500, "pciid": "0000:01:00.0", "phc_index": 2, "promisc": false, "speed": 10000, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_ens1f1": {"active": false, "device": "ens1f1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag 2019-10-23T08:25:18.866 INFO:teuthology.task.ansible.out:_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event"], "macaddress": "0c:c4:7a:bd:15:fd", "module": "ixgbe", "mtu": 1500, "pciid": "0000:01:00.1", "phc_index": 3, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_env": {"HOME": "/root", "LANG": "en_US.UTF-8", "LOGNAME": "root", "MAIL": "/var/mail/ubuntu", "PATH": "/sbin:/bin:/usr/sbin:/usr/bin", "PWD": "/home/ubuntu", "QTDIR": "/usr/lib64/qt-3.3", "SHELL": "/bin/bash", "SHLVL": "1", "SUDO_COMMAND": "/bin/sh -c echo BECOME-SUCCESS-ptqhthxfgheypexntxjqfadtdmixaewm ; /usr/bin/python", "SUDO_GID": "1209", "SUDO_UID": "1000", "SUDO_USER": "ubuntu", "TERM": "unknown", "USER": "root", "USERNAME": "root", "XDG_SESSION_ID": "3", "_": "/usr/bin/python"}, "ansible_fibre_channel_wwn": [], "ansible_fips": false, "ansible_form_factor": "Other", "ansible_fqdn": "smithi038.front.sepia.ceph.com", "ansible_hostname": "smithi038", "ansible_hostnqn": "", "ansible_interfaces": ["ens1f1", "eno1", "eno2", "lo", "ens1f0"], "ansible_is_chroot": false, "ansible_iscsi_iqn": "", "ansible_kernel": "3.10.0-1062.4.1.el7.x86_64", "ansible_lo": {"active": true, "device": "lo", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off [fixed]", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "on [fixed]", "netns_local": "on [fixed]", "ntuple_filters": "off [fixed]", "receive_hashing": "off [fixed]", "rx_all": "off [fixed]", "rx_checksumming": "on [fixed]", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "o 2019-10-23T08:25:18.868 INFO:teuthology.task.ansible.out:ff [fixed]", "rx_vlan_offload": "off [fixed]", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on [fixed]", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on [fixed]", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_gre_segmentation": "off [fixed]", "tx_gso_partial": "off [fixed]", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_lockless": "on [fixed]", "tx_nocache_copy": "off [fixed]", "tx_scatter_gather": "on [fixed]", "tx_scatter_gather_fraglist": "on [fixed]", "tx_sctp_segmentation": "on", "tx_sit_segmentation": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "on", "tx_tcp_mangleid_segmentation": "on", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "off [fixed]", "tx_udp_tnl_segmentation": "off [fixed]", "tx_vlan_offload": "off [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "on", "vlan_challenged": "on [fixed]"}, "hw_timestamp_filters": [], "ipv4": {"address": "127.0.0.1", "broadcast": "host", "netmask": "255.0.0.0", "network": "127.0.0.0"}, "ipv6": [{"address": "::1", "prefix": "128", "scope": "host"}], "mtu": 65536, "promisc": false, "timestamping": ["rx_software", "software"], "type": "loopback"}, "ansible_local": {}, "ansible_lsb": {"codename": "Core", "description": "CentOS Linux release 7.6.1810 (Core)", "id": "CentOS", "major_release": "7", "release": "7.6.1810"}, "ansible_lvm": {"lvs": {"lv_1": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_2": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_3": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_4": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_5": {"size_g": "14.90", "vg": "vg_nvme"}}, "pvs": {"/dev/nvme0n1": {"free_g": "3353.51", "size_g": "3726.02", "vg": "vg_nvme"}}, "vgs 2019-10-23T08:25:18.869 INFO:teuthology.task.ansible.out:": {"vg_nvme": {"free_g": "3353.51", "num_lvs": "5", "num_pvs": "1", "size_g": "3726.02"}}}, "ansible_machine": "x86_64", "ansible_machine_id": "48f603b7a56f4bb39f72becf12f3b725", "ansible_memfree_mb": 31229, "ansible_memory_mb": {"nocache": {"free": 31487, "used": 417}, "real": {"free": 31229, "total": 31904, "used": 675}, "swap": {"cached": 0, "free": 0, "total": 0, "used": 0}}, "ansible_memtotal_mb": 31904, "ansible_mounts": [{"block_available": 227323602, "block_size": 4096, "block_total": 240324484, "block_used": 13000882, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967567, "inode_total": 61054976, "inode_used": 87409, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117473792, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}], "ansible_nodename": "smithi038.front.sepia.ceph.com", "ansible_os_family": "RedHat", "ansible_pkg_mgr": "yum", "ansible_proc_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": ["ttyS1,115200", "tty0", "ttyS1,115200"], "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_processor": ["0", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "1", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "2", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "3", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "4", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "5", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "6", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "7", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz"], "ansible_processor_cores": 4, "ansible_processor_count": 1, "ansible_processor_threads_per_core": 2, "ansible_processor_vcpus": 8, "ansible_product_name": "SYS-5018R-WR", "ansible_product_serial": "S188093X5922729", "ansible_product_uuid": "00000000-0000-0000-0000-0CC47A6BFDA2", "ansible_pr 2019-10-23T08:25:18.870 INFO:teuthology.task.ansible.out:oduct_version": "0123456789", "ansible_python": {"executable": "/usr/bin/python", "has_sslcontext": true, "type": "CPython", "version": {"major": 2, "micro": 5, "minor": 7, "releaselevel": "final", "serial": 0}, "version_info": [2, 7, 5, "final", 0]}, "ansible_python_version": "2.7.5", "ansible_real_group_id": 0, "ansible_real_user_id": 0, "ansible_selinux": {"config_mode": "permissive", "mode": "permissive", "policyvers": 31, "status": "enabled", "type": "targeted"}, "ansible_selinux_python_present": true, "ansible_service_mgr": "systemd", "ansible_ssh_host_key_ecdsa_public": "AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxGd7mC9dt4Tq4ZC0MbYmAtZWn+kf3IBEGF2wFBrkSGGex6fufeaT+PO+CjEr2irtQeRdZwZ+CYa9Q7Gjpouxo=", "ansible_ssh_host_key_ed25519_public": "AAAAC3NzaC1lZDI1NTE5AAAAIK/leZ9Tp4MyUCFPMRZnGrwnnXi1ZoWRV0ltmLWhvQF5", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABAQDSay8RRKHl6hyM/yoVefaYjw//r9Dn2++40dyF1+V3VAhuGIGPUfq6mlEBasCDma+WXZpngodPu1VAihHz353WeCUjwhPOc6021BlKg6kXkWS8FFXLjqcRZ2Vshdo30HdYR8pJmkQD2qjqtOVOBH2gIQCNKAPszEUwhEacmFZF5VD1CnmO4SRuMG32WUNCPlD3/VUyR++8xU+tOsJDssAKTMjo47HCXENz2cZ++hH0cyX2fi0W/gMoTWR8wD4rbKP+ETlwkmGitGj+CsEYEYvU3vE+2YJnvWJ5evOTizvLTv+hURnMgbcPAgWsXMq/W2BAwqZcqX8J2qmUxSbOpgrL", "ansible_swapfree_mb": 0, "ansible_swaptotal_mb": 0, "ansible_system": "Linux", "ansible_system_capabilities": ["cap_chown", "cap_dac_override", "cap_dac_read_search", "cap_fowner", "cap_fsetid", "cap_kill", "cap_setgid", "cap_setuid", "cap_setpcap", "cap_linux_immutable", "cap_net_bind_service", "cap_net_broadcast", "cap_net_admin", "cap_net_raw", "cap_ipc_lock", "cap_ipc_owner", "cap_sys_module", "cap_sys_rawio", "cap_sys_chroot", "cap_sys_ptrace", "cap_sys_pacct", "cap_sys_admin", "cap_sys_boot", "cap_sys_nice", "cap_sys_resource", "cap_sys_time", "cap_sys_tty_config", "cap_mknod", "cap_lease", "cap_audit_write", "cap_audit_control", "cap_setfcap", "cap_mac_override", "cap_mac_admin", "cap_syslog", "35", "36+ep"], "ansible_system_capabil 2019-10-23T08:25:18.872 INFO:teuthology.task.ansible.out:ities_enforced": "True", "ansible_system_vendor": "Supermicro", "ansible_uptime_seconds": 64, "ansible_user_dir": "/root", "ansible_user_gecos": "root", "ansible_user_gid": 0, "ansible_user_id": "root", "ansible_user_shell": "/bin/bash", "ansible_user_uid": 0, "ansible_userspace_architecture": "x86_64", "ansible_userspace_bits": "64", "ansible_virtualization_role": "host", "ansible_virtualization_type": "kvm", "gather_subset": ["all"], "module_setup": true}, "changed": false} 2019-10-23T08:25:18.972 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:18 +0000 (0:00:01.667) 0:00:04.107 ***** 2019-10-23T08:25:19.004 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:18 +0000 (0:00:00.031) 0:00:04.139 ***** 2019-10-23T08:25:19.483 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-10-23T08:25:19.488 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-10-23T08:25:19.522 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:19 +0000 (0:00:00.519) 0:00:04.658 ***** 2019-10-23T08:25:19.558 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:19 +0000 (0:00:00.036) 0:00:04.694 ***** 2019-10-23T08:25:20.167 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-10-23T08:25:20.212 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:20 +0000 (0:00:00.654) 0:00:05.349 ***** 2019-10-23T08:25:20.218 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-10-23T08:25:20.236 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:25:20.258 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:20 +0000 (0:00:00.045) 0:00:05.394 ***** 2019-10-23T08:25:20.263 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:20.275 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:25:20.301 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:20 +0000 (0:00:00.043) 0:00:05.438 ***** 2019-10-23T08:25:20.309 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:20.348 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:20 +0000 (0:00:00.046) 0:00:05.485 ***** 2019-10-23T08:25:20.798 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-10-23T08:25:20.799 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:25:20.801 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:25:20.836 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:20 +0000 (0:00:00.488) 0:00:05.973 ***** 2019-10-23T08:25:20.871 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:20 +0000 (0:00:00.033) 0:00:06.007 ***** 2019-10-23T08:25:22.388 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1571819120.89-152453439491935/source", "state": "file", "uid": 0} 2019-10-23T08:25:22.432 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:22 +0000 (0:00:01.562) 0:00:07.569 ***** 2019-10-23T08:25:22.442 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1571819120.86-217644388622762/source", "state": "file", "uid": 0} 2019-10-23T08:25:22.501 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:22 +0000 (0:00:00.065) 0:00:07.637 ***** 2019-10-23T08:25:22.990 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-10-23T08:25:22.991 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:23.050 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:23.341 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:23.403 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:23.676 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:23.740 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.028 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.070 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.314 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.387 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.655 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.708 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:24.986 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:25.044 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-10-23T08:25:25.169 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-10-23T08:25:25.173 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-10-23T08:25:25.402 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:25 +0000 (0:00:02.901) 0:00:10.539 ***** 2019-10-23T08:25:25.435 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:25 +0000 (0:00:00.032) 0:00:10.572 ***** 2019-10-23T08:25:26.402 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-10-23T08:25:26.413 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_all_ipv4_addresses": ["172.21.15.38"], "ansible_all_ipv6_addresses": ["fe80::ec4:7aff:febd:15fc"], "ansible_apparmor": {"status": "disabled"}, "ansible_architecture": "x86_64", "ansible_bios_date": "09/07/2015", "ansible_bios_version": "1.0c", "ansible_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": "ttyS1,115200", "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_date_time": {"date": "2019-10-23", "day": "23", "epoch": "1571819126", "hour": "08", "iso8601": "2019-10-23T08:25:26Z", "iso8601_basic": "20191023T082526298867", "iso8601_basic_short": "20191023T082526", "iso8601_micro": "2019-10-23T08:25:26.298975Z", "minute": "25", "month": "10", "second": "26", "time": "08:25:26", "tz": "UTC", "tz_offset": "+0000", "weekday": "Wednesday", "weekday_number": "3", "weeknumber": "42", "year": "2019"}, "ansible_default_ipv4": {"address": "172.21.15.38", "alias": "ens1f0", "broadcast": "172.21.15.255", "gateway": "172.21.15.254", "interface": "ens1f0", "macaddress": "0c:c4:7a:bd:15:fc", "mtu": 1500, "netmask": "255.255.240.0", "network": "172.21.0.0", "type": "ether"}, "ansible_default_ipv6": {"address": "fe80::ec4:7aff:febd:15fc", "gateway": "fe80::327c:5e00:6487:71e0", "interface": "ens1f0", "macaddress": "0c:c4:7a:bd:15:fc", "mtu": 1500, "prefix": "64", "scope": "link", "type": "ether"}, "ansible_device_links": {"ids": {"dm-0": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa"], "dm-1": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy"], "dm-2": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML"], "dm-3": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM"], "dm-4": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wxcXLE37e5OewfU 2019-10-23T08:25:26.415 INFO:teuthology.task.ansible.out:uI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs"], "nvme0n1": ["lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "sda": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "sda1": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"]}, "labels": {}, "masters": {"nvme0n1": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"]}, "uuids": {"dm-0": ["16c78bcb-656e-4175-9aba-b8bbee9a11d1"], "dm-1": ["bf102730-4a2c-442a-8fd0-fb53f015abb1"], "dm-2": ["fb710487-4043-45d5-8d67-9c19438f9404"], "dm-3": ["626003b6-1741-4127-a420-61310d26acbe"], "dm-4": ["d0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8"], "sda1": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}}, "ansible_devices": {"dm-0": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa"], "labels": [], "masters": [], "uuids": ["16c78bcb-656e-4175-9aba-b8bbee9a11d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-1": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy"], "labels": [], "masters": [], "uuids": ["bf102730-4a2c-442a-8fd0-fb53f015abb1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-2": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML"], "labels": [], "masters": [], "uuids": ["fb710487-4043-45d5 2019-10-23T08:25:26.416 INFO:teuthology.task.ansible.out:-8d67-9c19438f9404"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-3": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM"], "labels": [], "masters": [], "uuids": ["626003b6-1741-4127-a420-61310d26acbe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-4": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs"], "labels": [], "masters": [], "uuids": ["d0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "nvme0n1": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "51 2019-10-23T08:25:26.423 INFO:teuthology.task.ansible.out:2", "vendor": null, "virtual": 1}, "sda": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J33D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b5cd5"}}, "ansible_distribution": "CentOS", "ansible_distribution_file_parsed": true, "ansible_distribution_file_path": "/etc/redhat-release", "ansible_distribution_file_variety": "RedHat", "ansible_distribution_major_version": "7", "ansible_distribution_release": "Core", "ansible_distribution_version": "7", "ansible_dns": {"nameservers": ["172.21.0.1", "172.21.0.2"], "search": ["front.sepia.ceph.com", "sepia.ceph.com"]}, "ansible_domain": "front.sepia.ceph.com", "ansible_effective_group_id": 0, "ansible_effective_user_id": 0, "ansible_eno1": {"active": false, "device": "eno1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx 2019-10-23T08:25:26.425 INFO:teuthology.task.ansible.out:_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_sca 2019-10-23T08:25:26.426 INFO:teuthology.task.ansible.out:tter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7a:6b:fd:a2", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.0", "phc_index": 0, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_eno2": {"active": false, "device": "eno2", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fr 2019-10-23T08:25:26.428 INFO:teuthology.task.ansible.out:aglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7a:6b:fd:a3", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.1", "phc_index": 1, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_ens1f0": {"active": true, "device": "ens1f0", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation 2019-10-23T08:25:26.429 INFO:teuthology.task.ansible.out:": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event"], "ipv4": {"address": "172.21.15.38", "broadcast": "172.21.15.255", "netmask": "255.255.240.0", "network": "172.21.0.0"}, "ipv6": [{"address": "fe80::ec4:7aff:febd:15fc", "prefix": "64", "scope": "link"}], "macaddress": "0c:c4:7a:bd:15:fc", "module": "ixgbe", "mtu": 1500, "pciid": "0000:01:00.0", "phc_index": 2, "promisc": false, "speed": 10000, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_ens1f1": {"active": false, "device": "ens1f1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "o 2019-10-23T08:25:26.431 INFO:teuthology.task.ansible.out:n", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event"], "macaddress": "0c:c4:7a:bd:15:fd", "module": "ixgbe", "mtu": 1500, "pciid": "0000:01:00.1", "phc_index": 3, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_env": {"HOME": "/root", "LANG": "en_US.UTF-8", "LOGNAME": "root", "MAIL": "/var/mail/ubuntu", "PATH": "/sbin:/bin:/usr/sbin:/usr/bin", "PWD": "/home/ubuntu", "QTDIR": "/usr/lib64/qt-3.3", "SHELL": "/bin/bash", "SHLVL": "1", "SUDO_COMMAND": "/bin/sh -c echo BECOME-SUCCESS-dkyiepoobtwxxmhyocmsjwjxvxqdjeee ; /usr/bin/python", "SUDO_GID": "1209", "SUDO_UID": "1000", "SUDO_USER": "ubuntu", "TERM": "unknown", "USER": "root", "USERNAME": "root", "XDG_SESSION_ID": "3", "_": "/usr/bin/python"}, "ansible_fibre_channel_wwn": [], "ansible_fips": false, "ansible_form_factor": "Other", "ansible_fqdn": "smithi038.front.sepia.ceph.com", "ansible_hostname": "smithi038", "ansible_hostnqn": "", "ansible_interfaces": ["ens1f1", "eno1", "eno2", "lo", "ens1f0"], "ansible_is_chroot": false, "ansible_iscsi_iqn": "", "ansible_kernel": "3.10.0-1062.4.1.el7.x86_64", "ansible_lo": {"active": true, "device": "lo", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentati 2019-10-23T08:25:26.433 INFO:teuthology.task.ansible.out:on_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off [fixed]", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "on [fixed]", "netns_local": "on [fixed]", "ntuple_filters": "off [fixed]", "receive_hashing": "off [fixed]", "rx_all": "off [fixed]", "rx_checksumming": "on [fixed]", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "off [fixed]", "rx_vlan_offload": "off [fixed]", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on [fixed]", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on [fixed]", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_gre_segmentation": "off [fixed]", "tx_gso_partial": "off [fixed]", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_lockless": "on [fixed]", "tx_nocache_copy": "off [fixed]", "tx_scatter_gather": "on [fixed]", "tx_scatter_gather_fraglist": "on [fixed]", "tx_sctp_segmentation": "on", "tx_sit_segmentation": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "on", "tx_tcp_mangleid_segmentation": "on", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "off [fixed]", "tx_udp_tnl_segmentation": "off [fixed]", "tx_vlan_offload": "off [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "on", "vlan_challenged": "on [fixed]"}, "hw_timestamp_filters": [], "ipv4": {"address": "127.0.0.1", "broadcast": "host", "netmask": "255.0.0.0", "network": "127.0.0.0"}, "ipv6": [{"address": "::1", "prefix": "128", "scope": "host"}], "mtu": 65536, "promisc": false, "timestamping": ["rx_software", "software"], "type": "loopback"}, "ansible_local": {}, "ansible_lsb": {"codename": "Core", "description": 2019-10-23T08:25:26.434 INFO:teuthology.task.ansible.out:"CentOS Linux release 7.6.1810 (Core)", "id": "CentOS", "major_release": "7", "release": "7.6.1810"}, "ansible_lvm": {"lvs": {"lv_1": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_2": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_3": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_4": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_5": {"size_g": "14.90", "vg": "vg_nvme"}}, "pvs": {"/dev/nvme0n1": {"free_g": "3353.51", "size_g": "3726.02", "vg": "vg_nvme"}}, "vgs": {"vg_nvme": {"free_g": "3353.51", "num_lvs": "5", "num_pvs": "1", "size_g": "3726.02"}}}, "ansible_machine": "x86_64", "ansible_machine_id": "48f603b7a56f4bb39f72becf12f3b725", "ansible_memfree_mb": 31228, "ansible_memory_mb": {"nocache": {"free": 31489, "used": 415}, "real": {"free": 31228, "total": 31904, "used": 676}, "swap": {"cached": 0, "free": 0, "total": 0, "used": 0}}, "ansible_memtotal_mb": 31904, "ansible_mounts": [{"block_available": 227323590, "block_size": 4096, "block_total": 240324484, "block_used": 13000894, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967567, "inode_total": 61054976, "inode_used": 87409, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117424640, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}], "ansible_nodename": "smithi038.front.sepia.ceph.com", "ansible_os_family": "RedHat", "ansible_pkg_mgr": "yum", "ansible_proc_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": ["ttyS1,115200", "tty0", "ttyS1,115200"], "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_processor": ["0", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "1", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "2", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "3", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "4", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "5", "GenuineIntel", "Intel(R) Xeon(R) CPU 2019-10-23T08:25:26.436 INFO:teuthology.task.ansible.out:E5-1620 v3 @ 3.50GHz", "6", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "7", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz"], "ansible_processor_cores": 4, "ansible_processor_count": 1, "ansible_processor_threads_per_core": 2, "ansible_processor_vcpus": 8, "ansible_product_name": "SYS-5018R-WR", "ansible_product_serial": "S188093X5922729", "ansible_product_uuid": "00000000-0000-0000-0000-0CC47A6BFDA2", "ansible_product_version": "0123456789", "ansible_python": {"executable": "/usr/bin/python", "has_sslcontext": true, "type": "CPython", "version": {"major": 2, "micro": 5, "minor": 7, "releaselevel": "final", "serial": 0}, "version_info": [2, 7, 5, "final", 0]}, "ansible_python_version": "2.7.5", "ansible_real_group_id": 0, "ansible_real_user_id": 0, "ansible_s 2019-10-23T08:25:26.438 INFO:teuthology.task.ansible.out:elinux": {"config_mode": "permissive", "mode": "permissive", "policyvers": 31, "status": "enabled", "type": "targeted"}, "ansible_selinux_python_present": true, "ansible_service_mgr": "systemd", "ansible_ssh_host_key_ecdsa_public": "AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxGd7mC9dt4Tq4ZC0MbYmAtZWn+kf3IBEGF2wFBrkSGGex6fufeaT+PO+CjEr2irtQeRdZwZ+CYa9Q7Gjpouxo=", "ansible_ssh_host_key_ed25519_public": "AAAAC3NzaC1lZDI1NTE5AAAAIK/leZ9Tp4MyUCFPMRZnGrwnnXi1ZoWRV0ltmLWhvQF5", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABAQDSay8RRKHl6hyM/yoVefaYjw//r9Dn2++40dyF1+V3VAhuGIGPUfq6mlEBasCDma+WXZpngodPu1VAihHz353WeCUjwhPOc6021BlKg6kXkWS8FFXLjqcRZ2Vshdo30HdYR8pJmkQD2qjqtOVOBH2gIQCNKAPszEUwhEacmFZF5VD1CnmO4SRuMG32WUNCPlD3/VUyR++8xU+tOsJDssAKTMjo47HCXENz2cZ++hH0cyX2fi0W/gMoTWR8wD4rbKP+ETlwkmGitGj+CsEYEYvU3vE+2YJnvWJ5evOTizvLTv+hURnMgbcPAgWsXMq/W2BAwqZcqX8J2qmUxSbOpgrL", "ansible_swapfree_mb": 0, "ansible_swaptotal_mb": 0, "ansible_system": "Linux", "ansible_system_capabilities": ["cap_chown", "cap_dac_override", "cap_dac_read_search", "cap_fowner", "cap_fsetid", "cap_kill", "cap_setgid", "cap_setuid", "cap_setpcap", "cap_linux_immutable", "cap_net_bind_service", "cap_net_broadcast", "cap_net_admin", "cap_net_raw", "cap_ipc_lock", "cap_ipc_owner", "cap_sys_module", "cap_sys_rawio", "cap_sys_chroot", "cap_sys_ptrace", "cap_sys_pacct", "cap_sys_admin", "cap_sys_boot", "cap_sys_nice", "cap_sys_resource", "cap_sys_time", "cap_sys_tty_config", "cap_mknod", "cap_lease", "cap_audit_write", "cap_audit_control", "cap_setfcap", "cap_mac_override", "cap_mac_admin", "cap_syslog", "35", "36+ep"], "ansible_system_capabilities_enforced": "True", "ansible_system_vendor": "Supermicro", "ansible_uptime_seconds": 71, "ansible_user_dir": "/root", "ansible_user_gecos": "root", "ansible_user_gid": 0, "ansible_user_id": "root", "ansible_user_shell": "/bin/bash", "ansible_user_uid": 0, "ansible_userspace_architecture": "x86_64", "ansible_userspace_bits": "64", "ansible_virtua 2019-10-23T08:25:26.440 INFO:teuthology.task.ansible.out:lization_role": "host", "ansible_virtualization_type": "kvm", "gather_subset": ["all"], "module_setup": true}, "changed": false} 2019-10-23T08:25:26.463 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_all_ipv4_addresses": ["172.21.15.62"], "ansible_all_ipv6_addresses": ["fe80::ec4:7aff:febb:d1c3"], "ansible_apparmor": {"status": "disabled"}, "ansible_architecture": "x86_64", "ansible_bios_date": "12/17/2015", "ansible_bios_version": "2.0", "ansible_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": "ttyS1,115200", "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_date_time": {"date": "2019-10-23", "day": "23", "epoch": "1571819126", "hour": "08", "iso8601": "2019-10-23T08:25:26Z", "iso8601_basic": "20191023T082526359691", "iso8601_basic_short": "20191023T082526", "iso8601_micro": "2019-10-23T08:25:26.359841Z", "minute": "25", "month": "10", "second": "26", "time": "08:25:26", "tz": "UTC", "tz_offset": "+0000", "weekday": "Wednesday", "weekday_number": "3", "weeknumber": "42", "year": "2019"}, "ansible_default_ipv4": {"address": "172.21.15.62", "alias": "enp3s0f1", "broadcast": "172.21.15.255", "gateway": "172.21.15.254", "interface": "enp3s0f1", "macaddress": "0c:c4:7a:bb:d1:c3", "mtu": 1500, "netmask": "255.255.240.0", "network": "172.21.0.0", "type": "ether"}, "ansible_default_ipv6": {"address": "fe80::ec4:7aff:febb:d1c3", "gateway": "fe80::327c:5e00:6487:71e0", "interface": "enp3s0f1", "macaddress": "0c:c4:7a:bb:d1:c3", "mtu": 1500, "prefix": "64", "scope": "link", "type": "ether"}, "ansible_device_links": {"ids": {"dm-0": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp"], "dm-1": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1"], "dm-2": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIrl"], "dm-3": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4"], "dm-4": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4M5k6LueTK 2019-10-23T08:25:26.465 INFO:teuthology.task.ansible.out:uLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr"], "nvme0n1": ["lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "sda": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "sda1": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"]}, "labels": {}, "masters": {"nvme0n1": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"]}, "uuids": {"dm-0": ["d3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b"], "dm-1": ["9d94d61b-6ff2-4df6-a5d7-dde722533a1e"], "dm-2": ["628f887b-3b78-46d8-bb4d-9a0064b6af15"], "dm-3": ["54cd6336-eb15-4664-bfdd-39f164a54798"], "dm-4": ["13cadbc7-0d9d-408e-9a4a-848b6a087cfc"], "sda1": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}}, "ansible_devices": {"dm-0": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp"], "labels": [], "masters": [], "uuids": ["d3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-1": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1"], "labels": [], "masters": [], "uuids": ["9d94d61b-6ff2-4df6-a5d7-dde722533a1e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-2": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIr 2019-10-23T08:25:26.466 INFO:teuthology.task.ansible.out:l"], "labels": [], "masters": [], "uuids": ["628f887b-3b78-46d8-bb4d-9a0064b6af15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-3": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4"], "labels": [], "masters": [], "uuids": ["54cd6336-eb15-4664-bfdd-39f164a54798"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "dm-4": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr"], "labels": [], "masters": [], "uuids": ["13cadbc7-0d9d-408e-9a4a-848b6a087cfc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "nvme0n1": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mo 2019-10-23T08:25:26.467 INFO:teuthology.task.ansible.out:de": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}, "sda": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, "ansible_distribution": "CentOS", "ansible_distribution_file_parsed": true, "ansible_distribution_file_path": "/etc/redhat-release", "ansible_distribution_file_variety": "RedHat", "ansible_distribution_major_version": "7", "ansible_distribution_release": "Core", "ansible_distribution_version": "7", "ansible_dns": {"nameservers": ["172.21.0.1", "172.21.0.2"], "search": ["front.sepia.ceph.com", "sepia.ceph.com"]}, "ansible_domain": "front.sepia.ceph.com", "ansible_effective_group_id": 0, "ansible_effective_user_id": 0, "ansible_eno1": {"active": false, "device": "eno1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on 2019-10-23T08:25:26.469 INFO:teuthology.task.ansible.out:", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7a:a9:aa:14", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.0", "phc_index": 0, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_eno2": {"active": false, "device": "eno2", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "on", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": " 2019-10-23T08:25:26.470 INFO:teuthology.task.ansible.out:off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "on [fixed]", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "all"], "macaddress": "0c:c4:7a:a9:aa:15", "module": "igb", "mtu": 1500, "pciid": "0000:07:00.1", "phc_index": 1, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_enp3s0f0": {"active": false, "device": "enp3s0f0", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksummin 2019-10-23T08:25:26.472 INFO:teuthology.task.ansible.out:g": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event"], "macadd 2019-10-23T08:25:26.477 INFO:teuthology.task.ansible.out:ress": "0c:c4:7a:bb:d1:c2", "module": "ixgbe", "mtu": 1500, "pciid": "0000:03:00.0", "phc_index": 2, "promisc": false, "speed": -1, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_enp3s0f1": {"active": true, "device": "enp3s0f1", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off", "l2_fwd_offload": "off", "large_receive_offload": "off", "loopback": "off [fixed]", "netns_local": "off [fixed]", "ntuple_filters": "off", "receive_hashing": "on", "rx_all": "off", "rx_checksumming": "on", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "on", "rx_vlan_filter": "on", "rx_vlan_offload": "on", "rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "on [fixed]", "tx_checksum_ip_generic": "on", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on", "tx_checksumming": "on", "tx_fcoe_segmentation": "on [fixed]", "tx_gre_csum_segmentation": "on", "tx_gre_segmentation": "on", "tx_gso_partial": "on", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "on", "tx_lockless": "off [fixed]", "tx_nocache_copy": "off", "tx_scatter_gather": "on", "tx_scatter_gather_fraglist": "off [fixed]", "tx_sctp_segmentation": "off [fixed]", "tx_sit_segmentation": "on", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "off [fixed]", "tx_tcp_mangleid_segmentation": "off", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "on", "tx_udp_tnl_segmentation": "on", "tx_vlan_offload": "on", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "off [fixed]", "vlan_challenged": "off [fixed]"}, "hw_timestamp_filters": ["none", "ptp_v1_l4_sync", "ptp_v1_l4_delay_req", "ptp_v2_event 2019-10-23T08:25:26.478 INFO:teuthology.task.ansible.out:"], "ipv4": {"address": "172.21.15.62", "broadcast": "172.21.15.255", "netmask": "255.255.240.0", "network": "172.21.0.0"}, "ipv6": [{"address": "fe80::ec4:7aff:febb:d1c3", "prefix": "64", "scope": "link"}], "macaddress": "0c:c4:7a:bb:d1:c3", "module": "ixgbe", "mtu": 1500, "pciid": "0000:03:00.1", "phc_index": 3, "promisc": false, "speed": 10000, "timestamping": ["tx_hardware", "tx_software", "rx_hardware", "rx_software", "software", "raw_hardware"], "type": "ether"}, "ansible_env": {"HOME": "/root", "LANG": "en_US.UTF-8", "LOGNAME": "root", "MAIL": "/var/mail/ubuntu", "PATH": "/sbin:/bin:/usr/sbin:/usr/bin", "PWD": "/home/ubuntu", "QTDIR": "/usr/lib64/qt-3.3", "SHELL": "/bin/bash", "SHLVL": "1", "SUDO_COMMAND": "/bin/sh -c echo BECOME-SUCCESS-yawalizeezolmqxscdituqwtziabzdwk ; /usr/bin/python", "SUDO_GID": "1209", "SUDO_UID": "1000", "SUDO_USER": "ubuntu", "TERM": "unknown", "USER": "root", "USERNAME": "root", "XDG_SESSION_ID": "2", "_": "/usr/bin/python"}, "ansible_fibre_channel_wwn": [], "ansible_fips": false, "ansible_form_factor": "Other", "ansible_fqdn": "smithi062.front.sepia.ceph.com", "ansible_hostname": "smithi062", "ansible_hostnqn": "", "ansible_interfaces": ["enp3s0f1", "eno1", "eno2", "lo", "enp3s0f0"], "ansible_is_chroot": false, "ansible_iscsi_iqn": "", "ansible_kernel": "3.10.0-1062.4.1.el7.x86_64", "ansible_lo": {"active": true, "device": "lo", "features": {"busy_poll": "off [fixed]", "fcoe_mtu": "off [fixed]", "generic_receive_offload": "on", "generic_segmentation_offload": "on", "highdma": "on [fixed]", "hw_tc_offload": "off [fixed]", "l2_fwd_offload": "off [fixed]", "large_receive_offload": "off [fixed]", "loopback": "on [fixed]", "netns_local": "on [fixed]", "ntuple_filters": "off [fixed]", "receive_hashing": "off [fixed]", "rx_all": "off [fixed]", "rx_checksumming": "on [fixed]", "rx_fcs": "off [fixed]", "rx_gro_hw": "off [fixed]", "rx_udp_tunnel_port_offload": "off [fixed]", "rx_vlan_filter": "off [fixed]", "rx_vlan_offload": "off [fixed]", 2019-10-23T08:25:26.480 INFO:teuthology.task.ansible.out:"rx_vlan_stag_filter": "off [fixed]", "rx_vlan_stag_hw_parse": "off [fixed]", "scatter_gather": "on", "tcp_segmentation_offload": "on", "tx_checksum_fcoe_crc": "off [fixed]", "tx_checksum_ip_generic": "on [fixed]", "tx_checksum_ipv4": "off [fixed]", "tx_checksum_ipv6": "off [fixed]", "tx_checksum_sctp": "on [fixed]", "tx_checksumming": "on", "tx_fcoe_segmentation": "off [fixed]", "tx_gre_csum_segmentation": "off [fixed]", "tx_gre_segmentation": "off [fixed]", "tx_gso_partial": "off [fixed]", "tx_gso_robust": "off [fixed]", "tx_ipip_segmentation": "off [fixed]", "tx_lockless": "on [fixed]", "tx_nocache_copy": "off [fixed]", "tx_scatter_gather": "on [fixed]", "tx_scatter_gather_fraglist": "on [fixed]", "tx_sctp_segmentation": "on", "tx_sit_segmentation": "off [fixed]", "tx_tcp6_segmentation": "on", "tx_tcp_ecn_segmentation": "on", "tx_tcp_mangleid_segmentation": "on", "tx_tcp_segmentation": "on", "tx_udp_tnl_csum_segmentation": "off [fixed]", "tx_udp_tnl_segmentation": "off [fixed]", "tx_vlan_offload": "off [fixed]", "tx_vlan_stag_hw_insert": "off [fixed]", "udp_fragmentation_offload": "on", "vlan_challenged": "on [fixed]"}, "hw_timestamp_filters": [], "ipv4": {"address": "127.0.0.1", "broadcast": "host", "netmask": "255.0.0.0", "network": "127.0.0.0"}, "ipv6": [{"address": "::1", "prefix": "128", "scope": "host"}], "mtu": 65536, "promisc": false, "timestamping": ["rx_software", "software"], "type": "loopback"}, "ansible_local": {}, "ansible_lsb": {"codename": "Core", "description": "CentOS Linux release 7.6.1810 (Core)", "id": "CentOS", "major_release": "7", "release": "7.6.1810"}, "ansible_lvm": {"lvs": {"lv_1": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_2": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_3": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_4": {"size_g": "89.40", "vg": "vg_nvme"}, "lv_5": {"size_g": "14.90", "vg": "vg_nvme"}}, "pvs": {"/dev/nvme0n1": {"free_g": "0.10", "size_g": "372.61", "vg": "vg_nvme"}}, "vgs": {"vg_nvme": {"free_g": "0.10", "num_lvs": "5", " 2019-10-23T08:25:26.481 INFO:teuthology.task.ansible.out:num_pvs": "1", "size_g": "372.61"}}}, "ansible_machine": "x86_64", "ansible_machine_id": "48f603b7a56f4bb39f72becf12f3b725", "ansible_memfree_mb": 31220, "ansible_memory_mb": {"nocache": {"free": 31481, "used": 417}, "real": {"free": 31220, "total": 31898, "used": 678}, "swap": {"cached": 0, "free": 0, "total": 0, "used": 0}}, "ansible_memtotal_mb": 31898, "ansible_mounts": [{"block_available": 227323594, "block_size": 4096, "block_total": 240324484, "block_used": 13000890, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967571, "inode_total": 61054976, "inode_used": 87405, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117441024, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}], "ansible_nodename": "smithi062.front.sepia.ceph.com", "ansible_os_family": "RedHat", "ansible_pkg_mgr": "yum", "ansible_proc_cmdline": {"BOOT_IMAGE": "/boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64", "console": ["ttyS1,115200", "tty0", "ttyS1,115200"], "crashkernel": "auto", "ro": true, "root": "UUID=18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "ansible_processor": ["0", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "1", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "2", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "3", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "4", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "5", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "6", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", "7", "GenuineIntel", "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz"], "ansible_processor_cores": 4, "ansible_processor_count": 1, "ansible_processor_threads_per_core": 2, "ansible_processor_vcpus": 8, "ansible_product_name": "SYS-5018R-WR", "ansible_product_serial": "S188093X6125177", "ansible_product_uuid": "00000000-0000-0000-0000-0CC47AA9AA14", "ansible_product_version": "0123456789", "ansible_python": {"execu 2019-10-23T08:25:26.483 INFO:teuthology.task.ansible.out:table": "/usr/bin/python", "has_sslcontext": true, "type": "CPython", "version": {"major": 2, "micro": 5, "minor": 7, "releaselevel": "final", "serial": 0}, "version_info": [2, 7, 5, "final", 0]}, "ansible_python_version": "2.7.5", "ansible_real_group_id": 0, "ansible_real_user_id": 0, "ansible_selinux": {"config_mode": "permissive", "mode": "permissive", "policyvers": 31, "status": "enabled", "type": "targeted"}, "ansible_selinux_python_present": true, "ansible_service_mgr": "systemd", "ansible_ssh_host_key_ecdsa_public": "AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7+3HAeNv08TgxjjXYDp1Tv6aBYY5TnpctWEA/h9si9i7xzoJR77l4jO8Zm5mE9e2tcQDsbHLVBTkc4ZOHpdZM=", "ansible_ssh_host_key_ed25519_public": "AAAAC3NzaC1lZDI1NTE5AAAAIEErLAXT69Tll4TsPs8NAvSKu42h8Ju6zGpxTRXnezXx", "ansible_ssh_host_key_rsa_public": "AAAAB3NzaC1yc2EAAAADAQABAAABAQDSgWQejVaUiCNSgXu+Q8J4Rk7qRrkt7vCHePdxgHgdNt/dMTihayyyXohuwCikobvgXs5+75tRwdPdNbjJofG3OBSmNrpNVWAXceBPdI6nct7xulSo170MIfOySbgF/49+oPn1lsFOgC001erY7PRQhzbRCIOqYioypedMkmYk5EWK8yLm+w7iddrtCFTP2SGfXVJJj2Cbr7jm6O7Pv0MbybCUPhNeuHYAT/I1eLemT1t+//9fi1VxZ5shUrEWBYzlwTVROb7EOinjiBolBhmyGy8lp3gE0qR+9wdzxoCYEvtSTSwUqh6T+01sMyfZVBzqucbswvpZuJb/vNfe9Ejz", "ansible_swapfree_mb": 0, "ansible_swaptotal_mb": 0, "ansible_system": "Linux", "ansible_system_capabilities": ["cap_chown", "cap_dac_override", "cap_dac_read_search", "cap_fowner", "cap_fsetid", "cap_kill", "cap_setgid", "cap_setuid", "cap_setpcap", "cap_linux_immutable", "cap_net_bind_service", "cap_net_broadcast", "cap_net_admin", "cap_net_raw", "cap_ipc_lock", "cap_ipc_owner", "cap_sys_module", "cap_sys_rawio", "cap_sys_chroot", "cap_sys_ptrace", "cap_sys_pacct", "cap_sys_admin", "cap_sys_boot", "cap_sys_nice", "cap_sys_resource", "cap_sys_time", "cap_sys_tty_config", "cap_mknod", "cap_lease", "cap_audit_write", "cap_audit_control", "cap_setfcap", "cap_mac_override", "cap_mac_admin", "cap_syslog", "35", "36+ep"], "ansible_system_capabilities_enforced": "True", "ansible_system_vendor": "Supe 2019-10-23T08:25:26.485 INFO:teuthology.task.ansible.out:rmicro", "ansible_uptime_seconds": 57, "ansible_user_dir": "/root", "ansible_user_gecos": "root", "ansible_user_gid": 0, "ansible_user_id": "root", "ansible_user_shell": "/bin/bash", "ansible_user_uid": 0, "ansible_userspace_architecture": "x86_64", "ansible_userspace_bits": "64", "ansible_virtualization_role": "host", "ansible_virtualization_type": "kvm", "gather_subset": ["all"], "module_setup": true}, "changed": false} 2019-10-23T08:25:26.594 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:01.158) 0:00:11.730 ***** 2019-10-23T08:25:26.648 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.053) 0:00:11.784 ***** 2019-10-23T08:25:26.655 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-10-23T08:25:26.656 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:26.715 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.067) 0:00:11.852 ***** 2019-10-23T08:25:26.728 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:26.779 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.063) 0:00:11.915 ***** 2019-10-23T08:25:26.787 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-10-23T08:25:26.788 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:26.831 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.047) 0:00:11.963 ***** 2019-10-23T08:25:26.834 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:26.872 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.046) 0:00:12.009 ***** 2019-10-23T08:25:26.878 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-10-23T08:25:26.879 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:26.918 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.046) 0:00:12.055 ***** 2019-10-23T08:25:26.924 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:26.964 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:26 +0000 (0:00:00.045) 0:00:12.101 ***** 2019-10-23T08:25:26.971 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-10-23T08:25:26.972 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:27.010 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:27 +0000 (0:00:00.046) 0:00:12.147 ***** 2019-10-23T08:25:27.017 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:25:27.061 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:27 +0000 (0:00:00.051) 0:00:12.198 ***** 2019-10-23T08:25:27.370 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-10-23T08:25:27.371 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:25:27.421 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:27 +0000 (0:00:00.359) 0:00:12.558 ***** 2019-10-23T08:25:27.429 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:25:27.469 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:25:27 +0000 (0:00:00.048) 0:00:12.606 ***** 2019-10-23T08:25:27.820 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-10-23T08:25:27.821 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-10-23T08:25:27.881 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-10-23T08:25:28.178 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-10-23T08:25:28.231 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-10-23T08:25:28.532 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-10-23T08:25:28.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-10-23T08:25:28.904 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-10-23T08:25:28.942 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-10-23T08:25:29.213 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-10-23T08:25:29.289 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-10-23T08:25:29.557 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-10-23T08:25:29.621 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-10-23T08:25:29.885 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-10-23T08:25:29.972 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-10-23T08:25:30.240 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-10-23T08:25:30.338 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-10-23T08:25:30.578 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-10-23T08:25:30.683 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-10-23T08:25:30.902 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-10-23T08:25:30.997 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-10-23T08:25:31.161 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-10-23T08:25:31.288 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-10-23T08:25:31.471 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-10-23T08:25:31.667 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-10-23T08:25:31.818 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-10-23T08:25:31.964 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-10-23T08:25:32.172 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-10-23T08:25:32.268 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXv 2019-10-23T08:25:32.269 INFO:teuthology.task.ansible.out:SKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-10-23T08:25:32.511 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-10-23T08:25:32.610 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-10-23T08:25:32.855 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-10-23T08:25:32.926 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-10-23T08:25:33.206 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-10-23T08:25:33.248 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-10-23T08:25:33.558 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-10-23T08:25:33.619 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-10-23T08:25:33.876 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-10-23T08:25:33.928 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-10-23T08:25:34.212 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-10-23T08:25:34.267 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-10-23T08:25:34.550 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-10-23T08:25:34.614 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-10-23T08:25:34.901 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-10-23T08:25:34.966 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-10-23T08:25:35.252 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-10-23T08:25:35.296 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-10-23T08:25:35.563 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-10-23T08:25:35.623 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-10-23T08:25:35.904 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-10-23T08:25:35.968 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-10-23T08:25:36.196 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-10-23T08:25:36.306 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-10-23T08:25:36.519 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-10-23T08:25:36.646 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-10-23T08:25:36.876 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-10-23T08:25:36.993 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-10-23T08:25:37.216 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-10-23T08:25:37.311 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-10-23T08:25:37.563 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-10-23T08:25:37.636 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-10-23T08:25:37.899 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-10-23T08:25:37.975 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-10-23T08:25:38.194 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-10-23T08:25:38.270 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-10-23T08:25:38.551 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-10-23T08:25:38.614 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-10-23T08:25:38.888 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-10-23T08:25:38.952 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-10-23T08:25:39.236 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-10-23T08:25:39.300 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-10-23T08:25:39.588 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-10-23T08:25:39.653 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-10-23T08:25:39.655 INFO:teuthology.task.ansible.out: 2019-10-23T08:25:39.922 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-10-23T08:25:39.944 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-10-23T08:25:40.264 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-10-23T08:25:40.265 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-10-23T08:25:40.590 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-10-23T08:25:40.612 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-10-23T08:25:40.932 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-10-23T08:25:40.954 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-10-23T08:25:41.279 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-10-23T08:25:41.287 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-10-23T08:25:41.600 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-10-23T08:25:41.643 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-10-23T08:25:41.937 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-10-23T08:25:41.952 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-10-23T08:25:42.260 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-10-23T08:25:42.301 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-10-23T08:25:42.574 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-10-23T08:25:42.648 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-10-23T08:25:42.908 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-10-23T08:25:42.976 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-10-23T08:25:43.276 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-10-23T08:25:43.302 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-10-23T08:25:43.631 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-10-23T08:25:43.654 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-10-23T08:25:43.991 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-10-23T08:25:44.000 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-10-23T08:25:44.337 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-10-23T08:25:44.357 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-10-23T08:25:44.678 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-10-23T08:25:44.682 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-10-23T08:25:45.023 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-10-23T08:25:45.043 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-10-23T08:25:45.368 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-10-23T08:25:45.374 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-10-23T08:25:45.703 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-10-23T08:25:45.716 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-10-23T08:25:46.043 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-10-23T08:25:46.074 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-10-23T08:25:46.385 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-10-23T08:25:46.408 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-10-23T08:25:46.741 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-10-23T08:25:46.742 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-10-23T08:25:47.090 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-10-23T08:25:47.102 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-10-23T08:25:47.430 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-10-23T08:25:47.457 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-10-23T08:25:47.774 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-10-23T08:25:47.800 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-10-23T08:25:48.126 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-10-23T08:25:48.159 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-10-23T08:25:48.468 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-10-23T08:25:48.500 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-10-23T08:25:48.795 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-10-23T08:25:48.853 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-10-23T08:25:49.112 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-10-23T08:25:49.208 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-10-23T08:25:49.420 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-10-23T08:25:49.525 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-10-23T08:25:49.771 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-10-23T08:25:49.880 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-10-23T08:25:50.084 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-10-23T08:25:50.234 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-10-23T08:25:50.389 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-10-23T08:25:50.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-10-23T08:25:50.733 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-10-23T08:25:50.925 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-10-23T08:25:51.053 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-10-23T08:25:51.263 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-10-23T08:25:51.419 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-10-23T08:25:51.565 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-10-23T08:25:51.750 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-10-23T08:25:51.906 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-10-23T08:25:52.104 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-10-23T08:25:52.236 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-10-23T08:25:52.442 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-10-23T08:25:52.548 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-10-23T08:25:52.752 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-10-23T08:25:52.889 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-10-23T08:25:53.110 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-10-23T08:25:53.226 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-10-23T08:25:53.433 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-10-23T08:25:53.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-10-23T08:25:53.773 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-10-23T08:25:53.900 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-10-23T08:25:54.115 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-10-23T08:25:54.211 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-10-23T08:25:54.458 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-10-23T08:25:54.574 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-10-23T08:25:54.795 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-10-23T08:25:54.936 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-10-23T08:25:55.151 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-10-23T08:25:55.298 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-10-23T08:25:55.510 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-10-23T08:25:55.633 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-10-23T08:25:55.858 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-10-23T08:25:55.980 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-10-23T08:25:56.212 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-10-23T08:25:56.319 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-10-23T08:25:56.532 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-10-23T08:25:56.663 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-10-23T08:25:56.896 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-10-23T08:25:57.022 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-10-23T08:25:57.241 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-10-23T08:25:57.367 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-10-23T08:25:57.595 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-10-23T08:25:57.682 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-10-23T08:25:57.924 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-10-23T08:25:58.019 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-10-23T08:25:58.281 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-10-23T08:25:58.355 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-10-23T08:25:58.602 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-10-23T08:25:58.690 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-10-23T08:25:58.979 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-10-23T08:25:59.033 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-10-23T08:25:59.330 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-10-23T08:25:59.383 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-10-23T08:25:59.670 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-10-23T08:25:59.734 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-10-23T08:26:00.026 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-10-23T08:26:00.048 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-10-23T08:26:00.382 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-10-23T08:26:00.383 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-10-23T08:26:00.713 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-10-23T08:26:00.719 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-10-23T08:26:01.055 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-10-23T08:26:01.078 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-10-23T08:26:01.400 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-10-23T08:26:01.731 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-10-23T08:26:01.743 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-10-23T08:26:02.067 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-10-23T08:26:02.104 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-10-23T08:26:02.407 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-10-23T08:26:02.419 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-10-23T08:26:02.730 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-10-23T08:26:02.775 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-10-23T08:26:03.066 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-10-23T08:26:03.152 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-10-23T08:26:03.406 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-10-23T08:26:03.483 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-10-23T08:26:03.485 INFO:teuthology.task.ansible.out: 2019-10-23T08:26:03.736 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-10-23T08:26:03.810 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-10-23T08:26:04.083 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-10-23T08:26:04.176 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-10-23T08:26:04.437 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-10-23T08:26:04.523 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-10-23T08:26:05.115 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-10-23T08:26:05.184 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-10-23T08:26:05.692 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-10-23T08:26:05.756 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-10-23T08:26:06.240 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "name": "shyukri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-10-23T08:26:06.365 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "name": "shyukri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2019-10-23T08:26:06.792 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-10-23T08:26:06.953 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2019-10-23T08:26:07.395 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "name": "rakesh", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2019-10-23T08:26:07.500 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "name": "rakesh", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2019-10-23T08:26:07.907 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "name": "ryg-", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2019-10-23T08:26:08.063 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "name": "ryg-", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2019-10-23T08:26:08.240 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-10-23T08:26:08.396 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-10-23T08:26:08.449 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:08 +0000 (0:00:40.979) 0:00:53.586 ***** 2019-10-23T08:26:08.555 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-10-23T08:26:08.603 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:08 +0000 (0:00:00.154) 0:00:53.740 ***** 2019-10-23T08:26:08.637 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:08 +0000 (0:00:00.033) 0:00:53.774 ***** 2019-10-23T08:26:08.662 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-10-23T08:26:08.667 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-10-23T08:26:08.668 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-10-23T08:26:08.670 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-10-23T08:26:08.672 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-10-23T08:26:08.673 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-10-23T08:26:08.675 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364 2019-10-23T08:26:08.677 INFO:teuthology.task.ansible.out:b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin 2019-10-23T08:26:08.679 INFO:teuthology.task.ansible.out:@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cC 2019-10-23T08:26:08.681 INFO:teuthology.task.ansible.out:x1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e 2019-10-23T08:26:08.683 INFO:teuthology.task.ansible.out:0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "k 2019-10-23T08:26:08.684 INFO:teuthology.task.ansible.out:keithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lm 2019-10-23T08:26:08.687 INFO:teuthology.task.ansible.out:b", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}]}, "changed": false} TASK [users : Create all users without sudo access.] *************************** 2019-10-23T08:26:08.719 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-10-23T08:26:08.720 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:08 +0000 (0:00:00.081) 0:00:53.855 ***** 2019-10-23T08:26:08.755 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:08 +0000 (0:00:00.035) 0:00:53.891 ***** 2019-10-23T08:26:08.818 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-10-23T08:26:08.827 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a 2019-10-23T08:26:08.829 INFO:teuthology.task.ansible.out:12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbe 2019-10-23T08:26:08.830 INFO:teuthology.task.ansible.out:njamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZ 2019-10-23T08:26:08.832 INFO:teuthology.task.ansible.out:cO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad 2019-10-23T08:26:08.834 INFO:teuthology.task.ansible.out: tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6Wt 2019-10-23T08:26:08.835 INFO:teuthology.task.ansible.out:Tng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdill 2019-10-23T08:26:08.837 INFO:teuthology.task.ansible.out:aman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+ 2019-10-23T08:26:08.840 INFO:teuthology.task.ansible.out:9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-10-23T08:26:08.842 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-10-23T08:26:08.843 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-10-23T08:26:08.845 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-10-23T08:26:08.846 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-10-23T08:26:08.847 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}]}, "changed": false} 2019-10-23T08:26:08.895 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:08 +0000 (0:00:00.140) 0:00:54.032 ***** 2019-10-23T08:26:10.211 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using 2019-10-23T08:26:10.213 INFO:teuthology.task.ansible.out: `result|success` use `result is success`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:26:10.214 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:26:10.229 INFO:teuthology.task.ansible.out: 2019-10-23T08:26:10.232 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* 2019-10-23T08:26:10.234 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"after": "6be59d86938a413a5a0da2d260683332e24f4cf1", "attempts": 1, "before": "6be59d86938a413a5a0da2d260683332e24f4cf1", "changed": false, "remote_url_changed": false} 2019-10-23T08:26:10.235 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"after": "6be59d86938a413a5a0da2d260683332e24f4cf1", "attempts": 1, "before": "6be59d86938a413a5a0da2d260683332e24f4cf1", "changed": false, "remote_url_changed": false} 2019-10-23T08:26:10.281 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:10 +0000 (0:00:01.385) 0:00:55.418 ***** 2019-10-23T08:26:10.319 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:10 +0000 (0:00:00.037) 0:00:55.455 ***** 2019-10-23T08:26:10.688 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-10-23T08:26:10.689 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-10-23T08:26:10.742 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-10-23T08:26:11.044 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-10-23T08:26:11.045 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-10-23T08:26:11.386 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-10-23T08:26:11.411 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-10-23T08:26:11.773 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-10-23T08:26:11.786 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-10-23T08:26:12.140 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-10-23T08:26:12.142 INFO:teuthology.task.ansible.out:lidate_certs": true} ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present" 2019-10-23T08:26:12.144 INFO:teuthology.task.ansible.out:, "user": "dmick", "validate_certs": true} 2019-10-23T08:26:12.481 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-10-23T08:26:12.529 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-10-23T08:26:12.815 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-10-23T08:26:12.816 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-10-23T08:26:12.880 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-10-23T08:26:12.882 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-10-23T08:26:13.151 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-10-23T08:26:13.245 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-10-23T08:26:13.495 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-10-23T08:26:13.517 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:13.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-10-23T08:26:13.608 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:13.878 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-10-23T08:26:13.880 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:13.890 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:13.901 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:13.902 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:13.976 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-10-23T08:26:13.978 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:14.001 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:14.002 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:14.014 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:14.267 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-10-23T08:26:14.373 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-10-23T08:26:14.636 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-10-23T08:26:14.638 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-10-23T08:26:14.710 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c63 2019-10-23T08:26:14.711 INFO:teuthology.task.ansible.out:74d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgn 2019-10-23T08:26:14.713 INFO:teuthology.task.ansible.out:VY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-10-23T08:26:14.995 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-10-23T08:26:15.070 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-10-23T08:26:15.344 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-10-23T08:26:15.441 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-10-23T08:26:15.686 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-10-23T08:26:15.799 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-10-23T08:26:16.040 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-10-23T08:26:16.093 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-10-23T08:26:16.412 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-10-23T08:26:16.434 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-10-23T08:26:16.759 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-10-23T08:26:16.781 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-10-23T08:26:17.113 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-10-23T08:26:17.115 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-10-23T08:26:17.146 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-10-23T08:26:17.147 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-10-23T08:26:17.458 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-10-23T08:26:17.459 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-10-23T08:26:17.511 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-10-23T08:26:17.512 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-10-23T08:26:17.793 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-10-23T08:26:17.869 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-10-23T08:26:18.142 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-10-23T08:26:18.235 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-10-23T08:26:18.495 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-10-23T08:26:18.497 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-10-23T08:26:18.569 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-10-23T08:26:18.570 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-10-23T08:26:18.834 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-10-23T08:26:18.911 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-10-23T08:26:19.170 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-10-23T08:26:19.248 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-10-23T08:26:19.506 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-10-23T08:26:19.643 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-10-23T08:26:19.875 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-10-23T08:26:20.017 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-10-23T08:26:20.223 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-10-23T08:26:20.361 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-10-23T08:26:20.591 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-10-23T08:26:20.593 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-10-23T08:26:20.716 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-10-23T08:26:20.718 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-10-23T08:26:20.987 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-10-23T08:26:20.992 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-10-23T08:26:21.038 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": " 2019-10-23T08:26:21.040 INFO:teuthology.task.ansible.out:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-10-23T08:26:21.370 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-10-23T08:26:21.393 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-10-23T08:26:21.720 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-10-23T08:26:21.741 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-10-23T08:26:22.079 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-10-23T08:26:22.092 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-10-23T08:26:22.420 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-10-23T08:26:22.444 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-10-23T08:26:22.785 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-10-23T08:26:22.797 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": tr 2019-10-23T08:26:22.798 INFO:teuthology.task.ansible.out:ue} 2019-10-23T08:26:23.154 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-10-23T08:26:23.166 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-10-23T08:26:23.504 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-10-23T08:26:23.535 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-10-23T08:26:23.857 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-10-23T08:26:23.903 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-10-23T08:26:24.203 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-10-23T08:26:24.225 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-10-23T08:26:24.529 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-10-23T08:26:24.573 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-10-23T08:26:24.918 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-10-23T08:26:24.920 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-10-23T08:26:24.963 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-10-23T08:26:24.965 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-10-23T08:26:25.287 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-10-23T08:26:25.289 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-10-23T08:26:25.357 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQSh 2019-10-23T08:26:25.363 INFO:teuthology.task.ansible.out:GhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-10-23T08:26:25.638 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-10-23T08:26:25.701 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-10-23T08:26:26.017 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-10-23T08:26:26.039 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-10-23T08:26:26.326 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-10-23T08:26:26.402 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-10-23T08:26:26.665 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-10-23T08:26:26.860 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-10-23T08:26:27.008 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-10-23T08:26:27.189 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-10-23T08:26:27.367 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-10-23T08:26:27.545 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-10-23T08:26:27.702 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-10-23T08:26:27.887 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-10-23T08:26:28.055 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_opti 2019-10-23T08:26:28.058 INFO:teuthology.task.ansible.out:ons": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-10-23T08:26:28.271 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_opti 2019-10-23T08:26:28.272 INFO:teuthology.task.ansible.out:ons": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-10-23T08:26:28.424 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-10-23T08:26:28.428 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-10-23T08:26:28.429 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-10-23T08:26:28.624 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-10-23T08:26:28.625 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-10-23T08:26:28.627 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-10-23T08:26:28.756 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-10-23T08:26:28.957 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-10-23T08:26:29.106 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-10-23T08:26:29.347 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-10-23T08:26:29.440 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-10-23T08:26:29.729 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-10-23T08:26:29.819 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-10-23T08:26:29.820 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-10-23T08:26:30.126 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-10-23T08:26:30.128 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-10-23T08:26:30.206 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-10-23T08:26:30.501 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-10-23T08:26:30.561 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-10-23T08:26:30.854 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-10-23T08:26:30.930 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-10-23T08:26:31.212 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-10-23T08:26:31.278 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-10-23T08:26:31.555 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-10-23T08:26:31.647 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-10-23T08:26:31.923 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-10-23T08:26:32.027 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-10-23T08:26:32.277 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-10-23T08:26:32.383 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-10-23T08:26:32.385 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-10-23T08:26:32.603 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-10-23T08:26:32.605 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-10-23T08:26:32.713 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-10-23T08:26:32.923 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-10-23T08:26:33.073 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-10-23T08:26:33.281 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-10-23T08:26:33.427 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-10-23T08:26:33.429 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-10-23T08:26:33.645 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-10-23T08:26:33.647 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-10-23T08:26:33.779 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-10-23T08:26:34.018 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-10-23T08:26:34.132 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-10-23T08:26:34.365 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-10-23T08:26:34.470 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-10-23T08:26:34.716 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-10-23T08:26:34.845 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-10-23T08:26:35.063 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-10-23T08:26:35.181 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-10-23T08:26:35.425 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-10-23T08:26:35.529 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-10-23T08:26:35.775 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-10-23T08:26:35.878 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-10-23T08:26:36.108 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-10-23T08:26:36.194 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-10-23T08:26:36.453 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-10-23T08:26:36.517 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-10-23T08:26:36.832 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-10-23T08:26:36.887 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-10-23T08:26:37.178 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-10-23T08:26:37.248 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-10-23T08:26:37.550 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-10-23T08:26:37.635 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-10-23T08:26:37.893 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-10-23T08:26:37.979 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-10-23T08:26:38.197 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-10-23T08:26:38.340 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-10-23T08:26:38.548 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-10-23T08:26:38.678 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-10-23T08:26:38.888 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-10-23T08:26:39.006 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-10-23T08:26:39.220 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-10-23T08:26:39.365 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-10-23T08:26:39.581 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-10-23T08:26:39.707 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-10-23T08:26:39.942 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-10-23T08:26:40.065 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-10-23T08:26:40.276 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-10-23T08:26:40.440 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-10-23T08:26:40.656 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-10-23T08:26:40.829 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-10-23T08:26:41.001 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-10-23T08:26:41.161 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-10-23T08:26:41.374 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-10-23T08:26:41.513 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-10-23T08:26:41.716 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEY 2019-10-23T08:26:41.717 INFO:teuthology.task.ansible.out:d3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-10-23T08:26:41.875 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-10-23T08:26:42.101 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-10-23T08:26:42.219 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-10-23T08:26:42.467 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-10-23T08:26:42.593 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-10-23T08:26:42.827 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-10-23T08:26:42.946 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-10-23T08:26:43.184 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-10-23T08:26:43.325 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-10-23T08:26:43.524 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-10-23T08:26:43.721 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-10-23T08:26:43.873 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-10-23T08:26:44.021 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhos 2019-10-23T08:26:44.023 INFO:teuthology.task.ansible.out:t.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-10-23T08:26:44.222 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhos 2019-10-23T08:26:44.223 INFO:teuthology.task.ansible.out:t.localdomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-10-23T08:26:44.354 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-10-23T08:26:44.355 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-10-23T08:26:44.591 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-10-23T08:26:44.596 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-10-23T08:26:44.711 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-10-23T08:26:44.940 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-10-23T08:26:45.060 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-10-23T08:26:45.324 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-10-23T08:26:45.425 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-10-23T08:26:45.686 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-10-23T08:26:45.764 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-10-23T08:26:46.022 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-10-23T08:26:46.133 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-10-23T08:26:46.392 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-10-23T08:26:46.522 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-10-23T08:26:46.738 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-10-23T08:26:46.877 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-10-23T08:26:47.099 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-10-23T08:26:47.228 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-10-23T08:26:47.427 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-10-23T08:26:47.573 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-10-23T08:26:47.762 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-10-23T08:26:47.910 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-10-23T08:26:48.111 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-10-23T08:26:48.261 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-10-23T08:26:48.459 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-10-23T08:26:48.634 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-10-23T08:26:48.820 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-10-23T08:26:49.006 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-10-23T08:26:49.182 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-10-23T08:26:49.380 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-10-23T08:26:49.546 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-10-23T08:26:49.736 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-10-23T08:26:49.738 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-10-23T08:26:49.853 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:49 +0000 (0:00:39.534) 0:01:34.990 ***** 2019-10-23T08:26:49.878 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-10-23T08:26:49.880 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-10-23T08:26:49.972 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-10-23T08:26:49.973 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:49.974 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:49.976 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:49.977 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d2 2019-10-23T08:26:49.979 INFO:teuthology.task.ansible.out:49450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:49.980 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.026 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:50 +0000 (0:00:00.172) 0:01:35.162 ***** 2019-10-23T08:26:50.085 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.097 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.112 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.130 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.131 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.142 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.162 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.162 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.322 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-10-23T08:26:50.346 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.521 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-10-23T08:26:50.532 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:50.708 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-10-23T08:26:50.870 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-10-23T08:26:51.074 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-10-23T08:26:51.212 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-10-23T08:26:51.400 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-10-23T08:26:51.580 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-10-23T08:26:51.726 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-10-23T08:26:51.729 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.741 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.752 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.763 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.775 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.775 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.786 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.798 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.798 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.810 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.812 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.822 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.822 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.834 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.851 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.859 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.860 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.872 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.873 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.884 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.895 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.896 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.908 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.919 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.931 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.933 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-10-23T08:26:51.935 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.936 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.950 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com h 2019-10-23T08:26:51.951 INFO:teuthology.task.ansible.out:sdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.963 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.964 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.966 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.978 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.979 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.981 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.982 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.984 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.995 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:51.998 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.000 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.001 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.016 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.018 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.021 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.022 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.024 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.026 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.048 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.068 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.070 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.077 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.083 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.084 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.086 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.131 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.132 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.133 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.135 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.137 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.138 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.140 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.141 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.149 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.151 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.152 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.154 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.166 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.169 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.170 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.172 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.173 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.175 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.187 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.188 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.215 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.216 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.234 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.610 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": 2019-10-23T08:26:52.611 INFO:teuthology.task.ansible.out:{"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WB 2019-10-23T08:26:52.613 INFO:teuthology.task.ansible.out:Mgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff 2019-10-23T08:26:52.614 INFO:teuthology.task.ansible.out:5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca 2019-10-23T08:26:52.616 INFO:teuthology.task.ansible.out:39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87 2019-10-23T08:26:52.617 INFO:teuthology.task.ansible.out:d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1 2019-10-23T08:26:52.619 INFO:teuthology.task.ansible.out:bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b 2019-10-23T08:26:52.620 INFO:teuthology.task.ansible.out:5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3V 2019-10-23T08:26:52.622 INFO:teuthology.task.ansible.out:iM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item" 2019-10-23T08:26:52.623 INFO:teuthology.task.ansible.out:: {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.625 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.627 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.629 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.632 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.634 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.635 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.636 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.644 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.646 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "ite 2019-10-23T08:26:52.647 INFO:teuthology.task.ansible.out:m", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.649 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.650 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.652 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.653 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.659 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.665 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit 2019-10-23T08:26:52.667 INFO:teuthology.task.ansible.out:@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.670 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.728 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.737 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.738 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.739 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.747 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.749 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.751 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.755 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha junlGKNU/xzt4OIaGHKBLA e8c67fd935fca490af3fe17453ccae3176268c4bfe1db4a2a879a2ab7ea6bfa5"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a3 2019-10-23T08:26:52.756 INFO:teuthology.task.ansible.out:4f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.759 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.859 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:52 +0000 (0:00:02.832) 0:01:37.995 ***** 2019-10-23T08:26:52.867 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.868 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.878 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.886 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.892 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.919 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.923 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.973 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:52 +0000 (0:00:00.113) 0:01:38.109 ***** 2019-10-23T08:26:52.985 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:52.988 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:53.060 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:53 +0000 (0:00:00.087) 0:01:38.196 ***** 2019-10-23T08:26:53.095 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:26:53.133 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:26:53 +0000 (0:00:00.073) 0:01:38.269 ***** 2019-10-23T08:26:53.359 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-10-23T08:26:53.361 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-10-23T08:26:53.507 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-10-23T08:26:53.655 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-10-23T08:26:53.833 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-10-23T08:26:54.025 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-10-23T08:26:54.179 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-10-23T08:26:54.398 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-10-23T08:26:54.534 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-10-23T08:26:54.746 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-10-23T08:26:54.858 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-10-23T08:26:55.093 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-10-23T08:26:55.215 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-10-23T08:26:55.416 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-10-23T08:26:55.554 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-10-23T08:26:55.740 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-10-23T08:26:55.888 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-10-23T08:26:56.068 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-10-23T08:26:56.227 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-10-23T08:26:56.384 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-10-23T08:26:56.554 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-10-23T08:26:56.726 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-10-23T08:26:56.922 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-10-23T08:26:57.071 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-10-23T08:26:57.291 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-10-23T08:26:57.409 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-10-23T08:26:57.577 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-10-23T08:26:57.763 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-10-23T08:26:57.930 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-10-23T08:26:58.099 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-10-23T08:26:58.247 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-10-23T08:26:58.451 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-10-23T08:26:58.586 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-10-23T08:26:58.769 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-10-23T08:26:58.916 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-10-23T08:26:59.122 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-10-23T08:26:59.281 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-10-23T08:26:59.423 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-10-23T08:26:59.650 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-10-23T08:26:59.800 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-10-23T08:26:59.981 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-10-23T08:27:00.143 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-10-23T08:27:00.319 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-10-23T08:27:00.462 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-10-23T08:27:00.643 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-10-23T08:27:00.761 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-10-23T08:27:00.983 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-10-23T08:27:01.122 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-10-23T08:27:01.326 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-10-23T08:27:01.463 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-10-23T08:27:01.657 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-10-23T08:27:01.816 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-10-23T08:27:01.993 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-10-23T08:27:02.161 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-10-23T08:27:02.335 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-10-23T08:27:02.494 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-10-23T08:27:02.562 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:09.428) 0:01:47.698 ***** 2019-10-23T08:27:02.602 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-10-23T08:27:02.603 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => { "msg": "Host smithi062.front.sepia.ceph.com is running CentOS 7 (Core)" } 2019-10-23T08:27:02.667 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:00.102) 0:01:47.801 ***** 2019-10-23T08:27:02.674 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-10-23T08:27:02.677 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-10-23T08:27:02.723 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-10-23T08:27:02.725 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-10-23T08:27:02.767 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:00.102) 0:01:47.904 ***** 2019-10-23T08:27:02.805 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:00.037) 0:01:47.941 ***** 2019-10-23T08:27:02.815 INFO:teuthology.task.ansible.out: 2019-10-23T08:27:02.821 INFO:teuthology.task.ansible.out:TASK [common : Log the OS name, version and release] *************************** 2019-10-23T08:27:02.822 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => { "msg": "Host smithi038.front.sepia.ceph.com is running CentOS 7 (Core)" } 2019-10-23T08:27:02.876 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:00.070) 0:01:48.011 ***** 2019-10-23T08:27:02.880 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-10-23T08:27:02.882 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:02.939 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:00.064) 0:01:48.076 ***** 2019-10-23T08:27:02.947 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-10-23T08:27:02.949 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-10-23T08:27:02.993 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:02 +0000 (0:00:00.053) 0:01:48.129 ***** 2019-10-23T08:27:03.040 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:03.096 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.103) 0:01:48.233 ***** 2019-10-23T08:27:03.536 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-10-23T08:27:03.537 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.092988", "end": "2019-10-23 08:27:03.502135", "rc": 0, "start": "2019-10-23 08:27:03.409147", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-10-23T08:27:03.589 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.492) 0:01:48.725 ***** 2019-10-23T08:27:03.596 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.258948", "end": "2019-10-23 08:27:03.514065", "rc": 0, "start": "2019-10-23 08:27:03.255117", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-10-23T08:27:03.645 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.056) 0:01:48.782 ***** 2019-10-23T08:27:03.651 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-10-23T08:27:03.652 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:03.703 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.057) 0:01:48.839 ***** 2019-10-23T08:27:03.712 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:03.774 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.070) 0:01:48.910 ***** 2019-10-23T08:27:03.778 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-10-23T08:27:03.781 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:03.825 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.051) 0:01:48.961 ***** 2019-10-23T08:27:03.833 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:03.906 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.081) 0:01:49.043 ***** 2019-10-23T08:27:03.912 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-10-23T08:27:03.913 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:03.958 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:03 +0000 (0:00:00.051) 0:01:49.095 ***** 2019-10-23T08:27:03.967 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.021 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.062) 0:01:49.157 ***** 2019-10-23T08:27:04.028 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-10-23T08:27:04.029 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.082 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.061) 0:01:49.219 ***** 2019-10-23T08:27:04.091 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.138 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.056) 0:01:49.275 ***** 2019-10-23T08:27:04.146 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-10-23T08:27:04.148 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.200 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.061) 0:01:49.337 ***** 2019-10-23T08:27:04.209 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.259 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.055) 0:01:49.393 ***** 2019-10-23T08:27:04.263 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-10-23T08:27:04.264 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.318 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.062) 0:01:49.455 ***** 2019-10-23T08:27:04.326 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.380 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.061) 0:01:49.516 ***** 2019-10-23T08:27:04.399 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-10-23T08:27:04.401 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:04.457 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.076) 0:01:49.593 ***** 2019-10-23T08:27:04.466 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:04.469 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:04.543 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.084) 0:01:49.678 ***** 2019-10-23T08:27:04.560 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.642 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.100) 0:01:49.779 ***** 2019-10-23T08:27:04.653 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.731 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.088) 0:01:49.867 ***** 2019-10-23T08:27:04.738 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-10-23T08:27:04.740 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.796 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.065) 0:01:49.932 ***** 2019-10-23T08:27:04.803 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:04.855 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.056) 0:01:49.989 ***** 2019-10-23T08:27:04.860 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-10-23T08:27:04.865 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:04.915 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.062) 0:01:50.051 ***** 2019-10-23T08:27:04.923 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:04.965 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:04 +0000 (0:00:00.049) 0:01:50.101 ***** 2019-10-23T08:27:04.974 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-10-23T08:27:04.976 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.030 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.063) 0:01:50.164 ***** 2019-10-23T08:27:05.037 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.101 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.073) 0:01:50.238 ***** 2019-10-23T08:27:05.109 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-10-23T08:27:05.111 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:05.173 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.071) 0:01:50.309 ***** 2019-10-23T08:27:05.200 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:05.246 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.073) 0:01:50.383 ***** 2019-10-23T08:27:05.254 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-10-23T08:27:05.255 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.299 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.052) 0:01:50.436 ***** 2019-10-23T08:27:05.305 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.347 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.047) 0:01:50.483 ***** 2019-10-23T08:27:05.355 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-10-23T08:27:05.357 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.393 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.046) 0:01:50.530 ***** 2019-10-23T08:27:05.403 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.443 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.047) 0:01:50.578 ***** 2019-10-23T08:27:05.449 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-10-23T08:27:05.450 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.493 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.052) 0:01:50.630 ***** 2019-10-23T08:27:05.501 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.540 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.046) 0:01:50.676 ***** 2019-10-23T08:27:05.546 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-10-23T08:27:05.547 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.587 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.046) 0:01:50.723 ***** 2019-10-23T08:27:05.597 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.633 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.046) 0:01:50.770 ***** 2019-10-23T08:27:05.639 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-10-23T08:27:05.640 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:05.679 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.045) 0:01:50.815 ***** 2019-10-23T08:27:05.686 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:05.725 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.046) 0:01:50.862 ***** 2019-10-23T08:27:05.731 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-10-23T08:27:05.733 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.775 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.049) 0:01:50.911 ***** 2019-10-23T08:27:05.784 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.826 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.050) 0:01:50.962 ***** 2019-10-23T08:27:05.832 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.875 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.049) 0:01:51.012 ***** 2019-10-23T08:27:05.882 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.924 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.048) 0:01:51.061 ***** 2019-10-23T08:27:05.930 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-10-23T08:27:05.932 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:05.977 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:05 +0000 (0:00:00.051) 0:01:51.112 ***** 2019-10-23T08:27:05.982 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.022 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.045) 0:01:51.158 ***** 2019-10-23T08:27:06.031 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-10-23T08:27:06.032 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.071 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.049) 0:01:51.207 ***** 2019-10-23T08:27:06.077 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.120 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.049) 0:01:51.257 ***** 2019-10-23T08:27:06.127 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-10-23T08:27:06.127 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.168 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.047) 0:01:51.304 ***** 2019-10-23T08:27:06.174 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.220 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.051) 0:01:51.356 ***** 2019-10-23T08:27:06.228 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.290 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.069) 0:01:51.426 ***** 2019-10-23T08:27:06.308 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.354 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.064) 0:01:51.490 ***** 2019-10-23T08:27:06.359 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-10-23T08:27:06.359 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:06.400 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.046) 0:01:51.537 ***** 2019-10-23T08:27:06.410 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-10-23T08:27:06.458 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.058) 0:01:51.595 ***** 2019-10-23T08:27:06.464 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-10-23T08:27:06.505 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.047) 0:01:51.642 ***** 2019-10-23T08:27:06.555 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.049) 0:01:51.691 ***** 2019-10-23T08:27:06.560 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-10-23T08:27:06.563 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.616 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.061) 0:01:51.752 ***** 2019-10-23T08:27:06.629 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:06.669 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:06 +0000 (0:00:00.053) 0:01:51.806 ***** 2019-10-23T08:27:06.981 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-10-23T08:27:06.983 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:27:07.038 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:07 +0000 (0:00:00.368) 0:01:52.174 ***** 2019-10-23T08:27:07.046 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:27:07.092 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:07 +0000 (0:00:00.054) 0:01:52.228 ***** 2019-10-23T08:27:08.390 INFO:teuthology.task.ansible.out: 2019-10-23T08:27:08.392 INFO:teuthology.task.ansible.out:TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-10-23T08:27:08.424 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-10-23T08:27:09.326 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-10-23T08:27:09.430 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:09 +0000 (0:00:02.337) 0:01:54.566 ***** 2019-10-23T08:27:09.444 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-10-23T08:27:09.512 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:09 +0000 (0:00:00.079) 0:01:54.645 ***** 2019-10-23T08:27:10.452 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi038.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4db37afba2545ac8871903964bcd8b701978565a", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 294, "state": "file", "uid": 0} 2019-10-23T08:27:10.572 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4db37afba2545ac8871903964bcd8b701978565a", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 294, "state": "file", "uid": 0} 2019-10-23T08:27:11.448 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "f1e1ffd80fcbd46e5168d3829bdcb34dffb3743b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 334, "state": "file", "uid": 0} 2019-10-23T08:27:11.493 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:01.983) 0:01:56.629 ***** 2019-10-23T08:27:11.539 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "f1e1ffd80fcbd46e5168d3829bdcb34dffb3743b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 334, "state": "file", "uid": 0} 2019-10-23T08:27:11.547 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:27:11.593 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.100) 0:01:56.730 ***** 2019-10-23T08:27:11.600 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.617 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:27:11.638 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.044) 0:01:56.775 ***** 2019-10-23T08:27:11.647 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.686 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.047) 0:01:56.823 ***** 2019-10-23T08:27:11.691 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-10-23T08:27:11.693 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.744 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.058) 0:01:56.881 ***** 2019-10-23T08:27:11.750 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.802 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.057) 0:01:56.939 ***** 2019-10-23T08:27:11.808 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-10-23T08:27:11.810 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.848 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.045) 0:01:56.984 ***** 2019-10-23T08:27:11.854 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.894 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.045) 0:01:57.030 ***** 2019-10-23T08:27:11.901 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-10-23T08:27:11.903 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.940 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.047) 0:01:57.077 ***** 2019-10-23T08:27:11.947 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:11.992 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:11 +0000 (0:00:00.051) 0:01:57.128 ***** 2019-10-23T08:27:11.997 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-10-23T08:27:11.999 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.038 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.045) 0:01:57.174 ***** 2019-10-23T08:27:12.044 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.082 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.044) 0:01:57.219 ***** 2019-10-23T08:27:12.088 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-10-23T08:27:12.089 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.126 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.043) 0:01:57.262 ***** 2019-10-23T08:27:12.133 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.174 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.048) 0:01:57.311 ***** 2019-10-23T08:27:12.181 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-10-23T08:27:12.182 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.226 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.051) 0:01:57.362 ***** 2019-10-23T08:27:12.232 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.271 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.044) 0:01:57.407 ***** 2019-10-23T08:27:12.280 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.314 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.043) 0:01:57.450 ***** 2019-10-23T08:27:12.319 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.358 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.044) 0:01:57.494 ***** 2019-10-23T08:27:12.371 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-10-23T08:27:12.373 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.409 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.051) 0:01:57.546 ***** 2019-10-23T08:27:12.415 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:12.455 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:12 +0000 (0:00:00.046) 0:01:57.592 ***** 2019-10-23T08:27:13.531 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-10-23T08:27:13.533 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.739023", "end": "2019-10-23 08:27:13.500489", "rc": 0, "start": "2019-10-23 08:27:12.761466", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.789873", "end": "2019-10-23 08:27:13.500475", "rc": 0, "start": "2019-10-23 08:27:12.710602", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:27:13.572 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:13 +0000 (0:00:01.116) 0:01:58.709 ***** 2019-10-23T08:27:13.609 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:13 +0000 (0:00:00.035) 0:01:58.745 ***** 2019-10-23T08:27:14.553 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-10-23T08:27:14.555 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_6.x86_64 providing krb5-workstation is already installed"]} 2019-10-23T08:27:14.595 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.986) 0:01:59.731 ***** 2019-10-23T08:27:14.607 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_6.x86_64 providing krb5-workstation is already installed"]} 2019-10-23T08:27:14.668 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.073) 0:01:59.805 ***** 2019-10-23T08:27:14.670 INFO:teuthology.task.ansible.out: 2019-10-23T08:27:14.677 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-10-23T08:27:14.679 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:14.736 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.067) 0:01:59.873 ***** 2019-10-23T08:27:14.744 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:14.793 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.057) 0:01:59.930 ***** 2019-10-23T08:27:14.799 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-10-23T08:27:14.801 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:14.839 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.045) 0:01:59.976 ***** 2019-10-23T08:27:14.846 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:14.884 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.044) 0:02:00.021 ***** 2019-10-23T08:27:14.890 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-10-23T08:27:14.891 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:14.929 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.044) 0:02:00.065 ***** 2019-10-23T08:27:14.936 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:14.977 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:14 +0000 (0:00:00.048) 0:02:00.114 ***** 2019-10-23T08:27:14.986 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-10-23T08:27:14.987 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:15.039 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:15 +0000 (0:00:00.061) 0:02:00.175 ***** 2019-10-23T08:27:15.046 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:15.085 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:15 +0000 (0:00:00.046) 0:02:00.222 ***** 2019-10-23T08:27:15.989 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-10-23T08:27:15.989 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-10-23T08:27:16.041 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:16 +0000 (0:00:00.955) 0:02:01.177 ***** 2019-10-23T08:27:16.083 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-10-23T08:27:16.125 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:16 +0000 (0:00:00.083) 0:02:01.261 ***** 2019-10-23T08:27:27.201 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-10-23T08:27:27.203 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["smartmontools", "1:7.0-1.el7.x86_64 from base"]]}, "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: repos-va.psychz.net\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\n1 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package smartmontools.x86_64 1:6.5-1.el7 will be updated\n---> Package smartmontools.x86_64 1:7.0-1.el7 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n smartmontools x86_64 1:7.0-1.el7 base 546 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package\n\nTotal download size: 546 k\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : 1:smartmontools-7.0-1.el7.x86_64 1/2 \n Cleanup : 1:smartmontools-6.5-1.el7.x86_64 2/2 \n Verifying : 1:smartmontools-7.0-1.el7.x86_64 1/2 \n Verifying : 1:smartmontools-6.5-1.el7.x86_64 2/2 \n\nUpdated:\n smartmontools.x86_64 1:7.0-1.el7 \n\nComplete!\n"]} 2019-10-23T08:27:27.243 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:27 +0000 (0:00:11.118) 0:02:12.379 ***** 2019-10-23T08:27:27.419 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["smartmontools", "1:7.0-1.el7.x86_64 from base"]]}, "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: repos-va.psychz.net\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\n1 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package smartmontools.x86_64 1:6.5-1.el7 will be updated\n---> Package smartmontools.x86_64 1:7.0-1.el7 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n smartmontools x86_64 1:7.0-1.el7 base 546 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package\n\nTotal download size: 546 k\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : 1:smartmontools-7.0-1.el7.x86_64 1/2 \n Cleanup : 1:smartmontools-6.5-1.el7.x86_64 2/2 \n Verifying : 1:smartmontools-7.0-1.el7.x86_64 1/2 \n Verifying : 1:smartmontools-6.5-1.el7.x86_64 2/2 \n\nUpdated:\n smartmontools.x86_64 1:7.0-1.el7 \n\nComplete!\n"]} 2019-10-23T08:27:27.467 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:27 +0000 (0:00:00.224) 0:02:12.603 ***** 2019-10-23T08:27:28.244 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi038.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-10-23T08:27:28.475 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-10-23T08:27:29.164 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-10-23T08:27:29.395 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-10-23T08:27:30.040 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-10-23T08:27:30.084 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:30 +0000 (0:00:02.616) 0:02:15.220 ***** 2019-10-23T08:27:30.281 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-10-23T08:27:30.339 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:30 +0000 (0:00:00.255) 0:02:15.475 ***** 2019-10-23T08:27:30.414 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-10-23T08:27:30.416 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-10-23T08:27:30.467 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:30 +0000 (0:00:00.127) 0:02:15.603 ***** 2019-10-23T08:27:30.669 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-10-23T08:27:30.717 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:30 +0000 (0:00:00.250) 0:02:15.854 ***** 2019-10-23T08:27:31.389 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi038.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-10-23T08:27:31.665 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-10-23T08:27:32.326 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-10-23T08:27:32.589 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-10-23T08:27:33.260 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-10-23T08:27:33.308 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:02.587) 0:02:18.441 ***** 2019-10-23T08:27:33.336 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:33.371 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:00.066) 0:02:18.507 ***** 2019-10-23T08:27:33.420 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-10-23T08:27:33.422 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-10-23T08:27:33.486 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:00.115) 0:02:18.623 ***** 2019-10-23T08:27:33.544 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-10-23T08:27:33.545 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-10-23T08:27:33.587 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:00.100) 0:02:18.724 ***** 2019-10-23T08:27:33.631 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:33.687 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:00.099) 0:02:18.823 ***** 2019-10-23T08:27:33.734 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-10-23T08:27:33.779 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:00.092) 0:02:18.915 ***** 2019-10-23T08:27:33.852 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-10-23T08:27:33.905 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:33 +0000 (0:00:00.126) 0:02:19.042 ***** 2019-10-23T08:27:33.967 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:33.992 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.010 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.023 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.061 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:34 +0000 (0:00:00.155) 0:02:19.198 ***** 2019-10-23T08:27:34.138 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-10-23T08:27:34.139 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-10-23T08:27:34.141 INFO:teuthology.task.ansible.out: 2019-10-23T08:27:34.197 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:34 +0000 (0:00:00.135) 0:02:19.334 ***** 2019-10-23T08:27:34.241 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-10-23T08:27:34.242 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.253 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.275 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.290 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:34.327 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:34 +0000 (0:00:00.129) 0:02:19.463 ***** 2019-10-23T08:27:37.611 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi038.front.sepia.ceph.com] => (item=nagios-common) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": [], "updated": []}, "item": "nagios-common", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["All packages providing nagios-common are up to date", ""]} 2019-10-23T08:27:37.845 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nagios-common) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": [], "updated": []}, "item": "nagios-common", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["All packages providing nagios-common are up to date", ""]} 2019-10-23T08:27:41.045 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nrpe) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": [], "updated": []}, "item": "nrpe", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["All packages providing nrpe are up to date", ""]} 2019-10-23T08:27:41.319 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nrpe) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": [], "updated": []}, "item": "nrpe", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["All packages providing nrpe are up to date", ""]} 2019-10-23T08:27:49.160 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=nagios-plugins) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": [], "updated": [["nagios-plugins", "2.2.2-2.20190926git1b8ad57.el7.x86_64 from epel"]]}, "item": "nagios-plugins", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: repos-va.psychz.net\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\n1 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package nagios-plugins.x86_64 0:2.2.1-16.20180725git3429dad.el7 will be updated\n--> Processing Dependency: nagios-plugins = 2.2.1-16.20180725git3429dad.el7 for package: nagios-plugins-load-2.2.1-16.20180725git3429dad.el7.x86_64\n---> Package nagios-plugins.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 will be an update\n--> Running transaction check\n---> Package nagios-plugins-load.x86_64 0:2.2.1-16.20180725git3429dad.el7 will be updated\n---> Package nagios-plugins-load.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository\n Size\n================================================================================\nUpdating:\n nagios-plugins x86_64 2.2.2-2.20190926git1b8ad57.el7 epel 115 k\nUpdating for dependencies:\n nagios-plugins-load x86_64 2.2.2-2.20190926git1b8ad57.el7 epel 41 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal 2019-10-23T08:27:49.162 INFO:teuthology.task.ansible.out: download size: 156 k\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 388 kB/s | 156 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : nagios-plugins-2.2.2-2.20190926git1b8ad57.el7.x86_64 1/4 \n Updating : nagios-plugins-load-2.2.2-2.20190926git1b8ad57.el7.x86_64 2/4 \n Cleanup : nagios-plugins-load-2.2.1-16.20180725git3429dad.el7.x86_64 3/4 \n Cleanup : nagios-plugins-2.2.1-16.20180725git3429dad.el7.x86_64 4/4 \n Verifying : nagios-plugins-load-2.2.2-2.20190926git1b8ad57.el7.x86_64 1/4 \n Verifying : nagios-plugins-2.2.2-2.20190926git1b8ad57.el7.x86_64 2/4 \n Verifying : nagios-plugins-2.2.1-16.20180725git3429dad.el7.x86_64 3/4 \n Verifying : nagios-plugins-load-2.2.1-16.20180725git3429dad.el7.x86_64 4/4 \n\nUpdated:\n nagios-plugins.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 \n\nDependency Updated:\n nagios-plugins-load.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 \n\nComplete!\n"]} 2019-10-23T08:27:49.312 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=nagios-plugins) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": [], "updated": [["nagios-plugins", "2.2.2-2.20190926git1b8ad57.el7.x86_64 from epel"]]}, "item": "nagios-plugins", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: repos-va.psychz.net\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\n1 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package nagios-plugins.x86_64 0:2.2.1-16.20180725git3429dad.el7 will be updated\n--> Processing Dependency: nagios-plugins = 2.2.1-16.20180725git3429dad.el7 for package: nagios-plugins-load-2.2.1-16.20180725git3429dad.el7.x86_64\n---> Package nagios-plugins.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 will be an update\n--> Running transaction check\n---> Package nagios-plugins-load.x86_64 0:2.2.1-16.20180725git3429dad.el7 will be updated\n---> Package nagios-plugins-load.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository\n Size\n================================================================================\nUpdating:\n nagios-plugins x86_64 2.2.2-2.20190926git1b8ad57.el7 epel 115 k\nUpdating for dependencies:\n nagios-plugins-load x86_64 2.2.2-2.20190926git1b8ad57.el7 epel 41 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nT 2019-10-23T08:27:49.314 INFO:teuthology.task.ansible.out:otal download size: 156 k\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 389 kB/s | 156 kB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : nagios-plugins-2.2.2-2.20190926git1b8ad57.el7.x86_64 1/4 \n Updating : nagios-plugins-load-2.2.2-2.20190926git1b8ad57.el7.x86_64 2/4 \n Cleanup : nagios-plugins-load-2.2.1-16.20180725git3429dad.el7.x86_64 3/4 \n Cleanup : nagios-plugins-2.2.1-16.20180725git3429dad.el7.x86_64 4/4 \n Verifying : nagios-plugins-load-2.2.2-2.20190926git1b8ad57.el7.x86_64 1/4 \n Verifying : nagios-plugins-2.2.2-2.20190926git1b8ad57.el7.x86_64 2/4 \n Verifying : nagios-plugins-2.2.1-16.20180725git3429dad.el7.x86_64 3/4 \n Verifying : nagios-plugins-load-2.2.1-16.20180725git3429dad.el7.x86_64 4/4 \n\nUpdated:\n nagios-plugins.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 \n\nDependency Updated:\n nagios-plugins-load.x86_64 0:2.2.2-2.20190926git1b8ad57.el7 \n\nComplete!\n"]} 2019-10-23T08:27:52.582 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nagios-plugins-load) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": [], "updated": []}, "item": "nagios-plugins-load", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["All packages providing nagios-plugins-load are up to date", ""]} 2019-10-23T08:27:52.627 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:52 +0000 (0:00:18.299) 0:02:37.763 ***** 2019-10-23T08:27:52.680 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi038.front.sepia.ceph.com] => (item=nagios-common) => {"ansible_loop_var": "item", "changed": false, "item": "nagios-common", "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item=nrpe) => {"ansible_loop_var": "item", "changed": false, "item": "nrpe", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.689 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=nagios-plugins) => {"ansible_loop_var": "item", "changed": false, "item": "nagios-plugins", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.711 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=nagios-plugins-load) => {"ansible_loop_var": "item", "changed": false, "item": "nagios-plugins-load", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.713 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-10-23T08:27:52.713 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nagios-plugins-load) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": [], "updated": []}, "item": "nagios-plugins-load", "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["All packages providing nagios-plugins-load are up to date", ""]} 2019-10-23T08:27:52.756 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:52 +0000 (0:00:00.129) 0:02:37.892 ***** 2019-10-23T08:27:52.801 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:52 +0000 (0:00:00.045) 0:02:37.937 ***** 2019-10-23T08:27:52.840 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-10-23T08:27:52.842 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=nagios-common) => {"ansible_loop_var": "item", "changed": false, "item": "nagios-common", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.853 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=nrpe) => {"ansible_loop_var": "item", "changed": false, "item": "nrpe", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.864 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=nagios-plugins) => {"ansible_loop_var": "item", "changed": false, "item": "nagios-plugins", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.875 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=nagios-plugins-load) => {"ansible_loop_var": "item", "changed": false, "item": "nagios-plugins-load", "skip_reason": "Conditional result was False"} 2019-10-23T08:27:52.933 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:52 +0000 (0:00:00.132) 0:02:38.070 ***** 2019-10-23T08:27:53.670 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-10-23T08:27:53.755 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} Wednesday 23 October 2019 08:27:53 +0000 (0:00:00.802) 0:02:38.872 ***** 2019-10-23T08:27:53.881 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-10-23T08:27:53.926 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:53 +0000 (0:00:00.189) 0:02:39.062 ***** 2019-10-23T08:27:54.679 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-10-23T08:27:54.680 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-10-23T08:27:54.741 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:54 +0000 (0:00:00.814) 0:02:39.877 ***** 2019-10-23T08:27:54.767 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-10-23T08:27:54.768 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:54.813 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:54 +0000 (0:00:00.072) 0:02:39.949 ***** 2019-10-23T08:27:54.819 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-10-23T08:27:54.820 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-10-23T08:27:54.868 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:54 +0000 (0:00:00.055) 0:02:40.005 ***** 2019-10-23T08:27:54.907 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:54.950 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:54 +0000 (0:00:00.082) 0:02:40.087 ***** 2019-10-23T08:27:55.143 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-10-23T08:27:55.145 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:27:55.191 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:55 +0000 (0:00:00.235) 0:02:40.322 ***** 2019-10-23T08:27:55.277 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:27:55.278 INFO:teuthology.task.ansible.out: 2019-10-23T08:27:55.329 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:55 +0000 (0:00:00.142) 0:02:40.465 ***** 2019-10-23T08:27:55.577 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-10-23T08:27:55.578 INFO:teuthology.task.ansible.out:fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-10-23T08:27:55.629 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:55 +0000 (0:00:00.300) 0:02:40.765 ***** 2019-10-23T08:27:55.670 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-10-23T08:27:55.671 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:55.719 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:55 +0000 (0:00:00.090) 0:02:40.856 ***** 2019-10-23T08:27:55.726 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-10-23T08:27:55.728 INFO:teuthology.task.ansible.out:fatal: [smithi062.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-10-23T08:27:55.778 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:55 +0000 (0:00:00.058) 0:02:40.914 ***** 2019-10-23T08:27:55.816 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-10-23T08:27:55.817 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:27:55.853 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:55 +0000 (0:00:00.075) 0:02:40.989 ***** 2019-10-23T08:27:56.662 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-10-23T08:27:56.663 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-10-23T08:27:56.715 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:56 +0000 (0:00:00.862) 0:02:41.852 ***** 2019-10-23T08:27:56.866 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-10-23T08:27:56.921 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:56 +0000 (0:00:00.205) 0:02:42.057 ***** 2019-10-23T08:27:57.615 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-10-23T08:27:57.616 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-10-23 08:24:48 UTC", "ActiveEnterTimestampMonotonic": "20052234", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice time-sync.target local-fs.target basic.target network.target var-run.mount nss-lookup.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-10-23 08:24:48 UTC", "AssertTimestampMonotonic": "20051515", "Before": "getty@tty1.service xdm.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-10-23 08:24:48 UTC", "ConditionTimestampMonotonic": "20051515", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8961", "ExecMainStartTimestamp": "Wed 2019-10-23 08:24:48 UTC", "ExecMainStartTimestampMonotonic": "20052183", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-10-23T08:27:57.618 INFO:teuthology.task.ansible.out:ors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-10-23 08:24:48 UTC", "InactiveExitTimestampMonotonic": "20052234", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8961", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirector 2019-10-23T08:27:57.619 INFO:teuthology.task.ansible.out:yMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-10-23 08:24:48 UTC", "WatchdogTimestampMonotonic": "20052217", "WatchdogUSec": "0"}} ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2019-10-23 08:24:36 UTC", "ActiveEnterTimestampMonotonic": "21865340", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target time-sync.target systemd-journald.socket var-run.mount basic.target system.slice network.target local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Wed 2019-10-23 08:24:36 UTC", "AssertTimestampMonotonic": "21864313", "Before": "multi-user.target getty@tty1.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "1844 2019-10-23T08:27:57.621 INFO:teuthology.task.ansible.out:6744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2019-10-23 08:24:36 UTC", "ConditionTimestampMonotonic": "21864313", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8771", "ExecMainStartTimestamp": "Wed 2019-10-23 08:24:36 UTC", "ExecMainStartTimestampMonotonic": "21865248", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2019-10-23 08:24:36 UTC", "InactiveExitTimestampMonotonic": "21865340", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "1844674407370955 2019-10-23T08:27:57.622 INFO:teuthology.task.ansible.out:1615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8771", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled 2019-10-23T08:27:57.624 INFO:teuthology.task.ansible.out:", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Wed 2019-10-23 08:24:36 UTC", "WatchdogTimestampMonotonic": "21865306", "WatchdogUSec": "0"}} 2019-10-23T08:27:57.657 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:57 +0000 (0:00:00.736) 0:02:42.794 ***** 2019-10-23T08:27:57.700 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:57 +0000 (0:00:00.042) 0:02:42.837 ***** 2019-10-23T08:27:57.998 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-10-23T08:27:58.000 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004757", "end": "2019-10-23 08:27:57.966504", "rc": 0, "start": "2019-10-23 08:27:57.961747", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-10-23T08:27:58.044 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:58 +0000 (0:00:00.344) 0:02:43.181 ***** 2019-10-23T08:27:58.050 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004515", "end": "2019-10-23 08:27:58.000063", "rc": 0, "start": "2019-10-23 08:27:57.995548", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-10-23T08:27:58.189 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:58 +0000 (0:00:00.144) 0:02:43.325 ***** 2019-10-23T08:27:58.659 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi038.front.sepia.ceph.com] => (item=libsemanage-python) => {"ansible_loop_var": "item", "changed": false, "item": "libsemanage-python", "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed"]} 2019-10-23T08:27:58.701 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libsemanage-python) => {"ansible_loop_var": "item", "changed": false, "item": "libsemanage-python", "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed"]} 2019-10-23T08:27:59.148 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=policycoreutils-python) => {"ansible_loop_var": "item", "changed": false, "item": "policycoreutils-python", "msg": "", "rc": 0, "results": ["policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-10-23T08:27:59.203 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:59 +0000 (0:00:01.014) 0:02:44.340 ***** 2019-10-23T08:27:59.211 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=policycoreutils-python) => {"ansible_loop_var": "item", "changed": false, "item": "policycoreutils-python", "msg": "", "rc": 0, "results": ["policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-10-23T08:27:59.253 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:27:59 +0000 (0:00:00.049) 0:02:44.389 ***** 2019-10-23T08:28:26.068 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-10-23T08:28:26.070 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7.1.noarch from updates"]]}, "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: repos-va.psychz.net\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\n1 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-229.el7_6.15 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7.1 for package: selinux-policy-targeted-3.13.1-252.el7.1.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7.1 for package: selinux-policy-targeted-3.13.1-252.el7.1.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-229.el7_6.15 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7.1 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7.1 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not in 2019-10-23T08:28:26.071 INFO:teuthology.task.ansible.out:stalled.\n--------------------------------------------------------------------------------\nTotal 9.0 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7.1.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7.1.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-229.el7_6.15.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-229.el7_6.15.noarch 4/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 1/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 2/4 \n Verifying : selinux-policy-3.13.1-229.el7_6.15.noarch 3/4 \n Verifying : selinux-policy-targeted-3.13.1-229.el7_6.15.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7.1 \n\nComplete!\n"]} 2019-10-23T08:28:26.127 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:26 +0000 (0:00:26.874) 0:03:11.264 ***** 2019-10-23T08:28:26.166 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7.1.noarch from updates"]]}, "msg": "", "obsoletes": {"urw-fonts": {"dist": "noarch", "repo": "@base", "version": "2.4-16.el7"}}, "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: repos-va.psychz.net\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repos-va.psychz.net\n1 packages excluded due to repository priority protections\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-229.el7_6.15 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7.1 for package: selinux-policy-targeted-3.13.1-252.el7.1.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7.1 for package: selinux-policy-targeted-3.13.1-252.el7.1.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-229.el7_6.15 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7.1 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7.1 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not instal 2019-10-23T08:28:26.168 INFO:teuthology.task.ansible.out:led.\n--------------------------------------------------------------------------------\nTotal 9.9 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7.1.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7.1.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-229.el7_6.15.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-229.el7_6.15.noarch 4/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 1/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 2/4 \n Verifying : selinux-policy-3.13.1-229.el7_6.15.noarch 3/4 \n Verifying : selinux-policy-targeted-3.13.1-229.el7_6.15.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7.1 \n\nComplete!\n"]} 2019-10-23T08:28:26.208 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:26 +0000 (0:00:00.080) 0:03:11.344 ***** 2019-10-23T08:28:26.810 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-10-23T08:28:26.857 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:26 +0000 (0:00:00.649) 0:03:11.994 ***** 2019-10-23T08:28:26.859 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:26.865 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-10-23T08:28:26.919 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:26 +0000 (0:00:00.055) 0:03:12.050 ***** 2019-10-23T08:28:35.529 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-10-23T08:28:35.530 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.373375", "end": "2019-10-23 08:28:35.497321", "failed_when_result": false, "rc": 0, "start": "2019-10-23 08:28:27.123946", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-10-23T08:28:35.567 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:35 +0000 (0:00:08.654) 0:03:20.704 ***** 2019-10-23T08:28:35.573 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.306466", "end": "2019-10-23 08:28:35.527769", "failed_when_result": false, "rc": 0, "start": "2019-10-23 08:28:27.221303", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-10-23T08:28:35.612 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:35 +0000 (0:00:00.044) 0:03:20.749 ***** 2019-10-23T08:28:36.434 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-10-23T08:28:36.435 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-10-23T08:28:36.493 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:36 +0000 (0:00:00.881) 0:03:21.630 ***** 2019-10-23T08:28:36.604 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-10-23T08:28:36.644 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:36 +0000 (0:00:00.150) 0:03:21.781 ***** 2019-10-23T08:28:36.856 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-10-23T08:28:36.856 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.022177", "end": "2019-10-23 08:28:36.829729", "rc": 0, "start": "2019-10-23 08:28:36.807552", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-10-23T08:28:36.898 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:36 +0000 (0:00:00.254) 0:03:22.035 ***** 2019-10-23T08:28:36.989 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015275", "end": "2019-10-23 08:28:36.959063", "rc": 0, "start": "2019-10-23 08:28:36.943788", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-10-23T08:28:37.034 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:37 +0000 (0:00:00.135) 0:03:22.170 ***** 2019-10-23T08:28:37.216 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-10-23T08:28:37.217 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014692", "end": "2019-10-23 08:28:37.188043", "rc": 0, "start": "2019-10-23 08:28:37.173351", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:28:37.271 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:37 +0000 (0:00:00.237) 0:03:22.408 ***** 2019-10-23T08:28:37.376 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010749", "end": "2019-10-23 08:28:37.349505", "rc": 0, "start": "2019-10-23 08:28:37.338756", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:28:37.434 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:37 +0000 (0:00:00.162) 0:03:22.571 ***** 2019-10-23T08:28:45.991 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-10-23T08:28:45.996 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.378418", "end": "2019-10-23 08:28:45.955054", "rc": 0, "start": "2019-10-23 08:28:37.576636", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:28:46.029 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:08.595) 0:03:31.166 ***** 2019-10-23T08:28:46.381 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-10-23T08:28:46.418 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.388) 0:03:31.555 ***** 2019-10-23T08:28:46.447 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-10-23T08:28:46.448 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-10-23T08:28:46.487 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.068) 0:03:31.624 ***** 2019-10-23T08:28:46.526 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-10-23T08:28:46.527 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.729972", "end": "2019-10-23 08:28:46.482916", "rc": 0, "start": "2019-10-23 08:28:37.752944", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:28:46.566 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.078) 0:03:31.702 ***** 2019-10-23T08:28:46.573 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-10-23T08:28:46.574 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-10-23T08:28:46.613 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.047) 0:03:31.750 ***** 2019-10-23T08:28:46.651 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-10-23T08:28:46.653 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-10-23T08:28:46.696 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.083) 0:03:31.833 ***** 2019-10-23T08:28:46.746 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-10-23T08:28:46.748 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-10-23T08:28:46.786 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.089) 0:03:31.922 ***** 2019-10-23T08:28:46.918 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-10-23T08:28:46.919 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-10-23T08:28:46.960 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:46 +0000 (0:00:00.174) 0:03:32.096 ***** 2019-10-23T08:28:46.998 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-10-23T08:28:46.999 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-10-23T08:28:47.042 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.082) 0:03:32.179 ***** 2019-10-23T08:28:47.100 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-10-23T08:28:47.137 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.094) 0:03:32.273 ***** 2019-10-23T08:28:47.143 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-10-23T08:28:47.144 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-10-23T08:28:47.187 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.050) 0:03:32.324 ***** 2019-10-23T08:28:47.195 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-10-23T08:28:47.197 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-10-23T08:28:47.255 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.065) 0:03:32.389 ***** 2019-10-23T08:28:47.302 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-10-23T08:28:47.303 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-10-23T08:28:47.363 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.109) 0:03:32.499 ***** 2019-10-23T08:28:47.499 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-10-23T08:28:47.501 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2019-10-23T08:28:47.545 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.181) 0:03:32.681 ***** 2019-10-23T08:28:47.576 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-10-23T08:28:47.577 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:28:47.618 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.073) 0:03:32.754 ***** 2019-10-23T08:28:47.637 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:28:47.646 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-10-23T08:28:47.649 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:28:47.687 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.069) 0:03:32.823 ***** 2019-10-23T08:28:47.701 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-10-23T08:28:47.736 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:47 +0000 (0:00:00.049) 0:03:32.873 ***** 2019-10-23T08:28:48.042 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-10-23T08:28:48.043 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-10-23T08:28:48.085 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:48 +0000 (0:00:00.348) 0:03:33.222 ***** 2019-10-23T08:28:48.102 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-10-23T08:28:48.104 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2019-10-23T08:28:48.142 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:48 +0000 (0:00:00.057) 0:03:33.279 ***** 2019-10-23T08:28:48.169 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-10-23T08:28:48.171 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:28:48.218 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:48 +0000 (0:00:00.075) 0:03:33.354 ***** 2019-10-23T08:28:48.236 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:28:48.244 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-10-23T08:28:48.246 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:28:48.284 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:48 +0000 (0:00:00.066) 0:03:33.421 ***** 2019-10-23T08:28:48.658 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-10-23T08:28:48.659 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-10-23T08:28:48.701 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:48 +0000 (0:00:00.413) 0:03:33.834 ***** 2019-10-23T08:28:49.189 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-10-23T08:28:49.190 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-10-23T08:28:49.239 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:49 +0000 (0:00:00.541) 0:03:34.375 ***** 2019-10-23T08:28:49.278 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi038"}, "changed": false} 2019-10-23T08:28:49.342 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:49 +0000 (0:00:00.102) 0:03:34.478 ***** 2019-10-23T08:28:49.783 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-10-23T08:28:49.824 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:49 +0000 (0:00:00.481) 0:03:34.960 ***** 2019-10-23T08:28:49.864 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi062"}, "changed": false} 2019-10-23T08:28:49.950 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:49 +0000 (0:00:00.125) 0:03:35.086 ***** 2019-10-23T08:28:50.412 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi038.front.sepia.ceph.com", "ansible_hostname": "smithi038", "ansible_nodename": "smithi038"}, "changed": true, "name": "smithi038"} 2019-10-23T08:28:50.449 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:50 +0000 (0:00:00.499) 0:03:35.586 ***** 2019-10-23T08:28:50.451 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:50.489 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi062.front.sepia.ceph.com", "ansible_hostname": "smithi062", "ansible_nodename": "smithi062"}, "changed": true, "name": "smithi062"} 2019-10-23T08:28:50.490 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:50.541 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:50 +0000 (0:00:00.091) 0:03:35.678 ***** 2019-10-23T08:28:51.347 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-10-23T08:28:51.394 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:51 +0000 (0:00:00.852) 0:03:36.530 ***** 2019-10-23T08:28:51.576 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-10-23T08:28:51.578 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:51.625 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:51 +0000 (0:00:00.230) 0:03:36.761 ***** 2019-10-23T08:28:52.398 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-10-23T08:28:52.399 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-10-23T08:28:52.443 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:52 +0000 (0:00:00.818) 0:03:37.580 ***** 2019-10-23T08:28:52.610 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-10-23T08:28:52.651 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:52 +0000 (0:00:00.207) 0:03:37.788 ***** 2019-10-23T08:28:53.633 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:28:53.641 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-10-23T08:28:53.641 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-10-23T08:28:53.643 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-10-23T08:28:53.680 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:53 +0000 (0:00:01.028) 0:03:38.817 ***** 2019-10-23T08:28:53.752 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` use `result is success`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:28:53.762 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-10-23T08:28:53.802 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:53 +0000 (0:00:00.121) 0:03:38.938 ***** 2019-10-23T08:28:54.626 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-10-23T08:28:54.627 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-10-23T08:28:54.672 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:54 +0000 (0:00:00.870) 0:03:39.808 ***** 2019-10-23T08:28:54.805 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-10-23T08:28:54.855 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:54 +0000 (0:00:00.183) 0:03:39.991 ***** 2019-10-23T08:28:54.857 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:55.013 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:55.015 INFO:teuthology.task.ansible.out:TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-10-23T08:28:55.017 INFO:teuthology.task.ansible.out: 2019-10-23T08:28:55.064 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:55 +0000 (0:00:00.208) 0:03:40.200 ***** 2019-10-23T08:28:55.203 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-10-23T08:28:55.243 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:55 +0000 (0:00:00.179) 0:03:40.379 ***** 2019-10-23T08:28:55.410 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-10-23T08:28:55.459 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:55 +0000 (0:00:00.216) 0:03:40.595 ***** 2019-10-23T08:28:55.571 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "kvm", "state": "present", "system": false} 2019-10-23T08:28:55.611 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:55 +0000 (0:00:00.152) 0:03:40.748 ***** 2019-10-23T08:28:55.831 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-10-23T08:28:55.833 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-10-23T08:28:55.876 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:55 +0000 (0:00:00.264) 0:03:41.012 ***** 2019-10-23T08:28:56.004 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-10-23T08:28:56.040 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:56 +0000 (0:00:00.164) 0:03:41.177 ***** 2019-10-23T08:28:56.852 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-10-23T08:28:56.854 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-10-23T08:28:56.899 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:56 +0000 (0:00:00.858) 0:03:42.035 ***** 2019-10-23T08:28:57.022 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-10-23T08:28:57.088 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:57 +0000 (0:00:00.189) 0:03:42.224 ***** 2019-10-23T08:28:57.915 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-10-23T08:28:57.916 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-10-23T08:28:57.959 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:57 +0000 (0:00:00.870) 0:03:43.095 ***** 2019-10-23T08:28:58.062 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-10-23T08:28:58.110 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:28:58 +0000 (0:00:00.151) 0:03:43.247 ***** 2019-10-23T08:29:00.388 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-10-23T08:29:00.389 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-10-23T08:29:00.391 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.102179", "end": "2019-10-23 08:29:00.354133", "rc": 0, "start": "2019-10-23 08:28:58.251954", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:29:00.453 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:00 +0000 (0:00:02.342) 0:03:45.590 ***** 2019-10-23T08:29:00.487 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-10-23T08:29:00.523 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:00 +0000 (0:00:00.069) 0:03:45.659 ***** 2019-10-23T08:29:00.524 INFO:teuthology.task.ansible.out: 2019-10-23T08:29:00.541 INFO:teuthology.task.ansible.out: 2019-10-23T08:29:00.543 INFO:teuthology.task.ansible.out:TASK [testnode : Rebuild rpmdb] ************************************************ changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.088981", "end": "2019-10-23 08:29:00.508316", "rc": 0, "start": "2019-10-23 08:28:58.419335", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:29:00.585 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:00 +0000 (0:00:00.062) 0:03:45.722 ***** 2019-10-23T08:29:00.587 INFO:teuthology.task.ansible.out: 2019-10-23T08:29:00.627 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-10-23T08:29:00.672 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:00 +0000 (0:00:00.086) 0:03:45.808 ***** 2019-10-23T08:29:00.674 INFO:teuthology.task.ansible.out: 2019-10-23T08:29:01.666 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-10-23T08:29:01.667 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "md5sum": "1ab983587ffdee6ea400c98696efa07e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1571819340.57-159774708165518/source", "state": "file", "uid": 0} 2019-10-23T08:29:01.840 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "md5sum": "1ab983587ffdee6ea400c98696efa07e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1571819340.72-19816934843101/source", "state": "file", "uid": 0} 2019-10-23T08:29:02.779 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "md5sum": "20e0446046d8fc74984ed9140203c656", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1571819341.68-5138919639736/source", "state": "file", "uid": 0} 2019-10-23T08:29:02.821 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:02 +0000 (0:00:02.148) 0:03:47.957 ***** 2019-10-23T08:29:02.849 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-10-23T08:29:02.851 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:29:02.918 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:02 +0000 (0:00:00.097) 0:03:48.055 ***** 2019-10-23T08:29:02.959 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-10-23T08:29:02.959 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-10-23T08:29:02.970 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-10-23T08:29:03.016 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.096) 0:03:48.151 ***** 2019-10-23T08:29:03.021 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-10-23T08:29:03.022 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "md5sum": "20e0446046d8fc74984ed9140203c656", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1571819341.85-160527872034795/source", "state": "file", "uid": 0} 2019-10-23T08:29:03.038 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:29:03.064 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.049) 0:03:48.201 ***** 2019-10-23T08:29:03.101 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-10-23T08:29:03.102 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:29:03.140 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.076) 0:03:48.277 ***** 2019-10-23T08:29:03.179 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-10-23T08:29:03.181 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-10-23T08:29:03.220 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.079) 0:03:48.356 ***** 2019-10-23T08:29:03.244 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:29:03.659 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** [WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.307969", "end": "2019-10-23 08:29:03.624153", "rc": 0, "start": "2019-10-23 08:29:03.316184", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nCleaning up list of fastest mirrors", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Cleaning up list of fastest mirrors"]} 2019-10-23T08:29:03.712 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.492) 0:03:48.849 ***** 2019-10-23T08:29:03.755 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:29:03.757 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-10-23T08:29:03.800 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.079) 0:03:48.929 ***** 2019-10-23T08:29:03.850 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-10-23T08:29:03.851 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.312670", "end": "2019-10-23 08:29:03.818628", "rc": 0, "start": "2019-10-23 08:29:03.505958", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nCleaning up list of fastest mirrors", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Cleaning up list of fastest mirrors"]} 2019-10-23T08:29:03.893 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.101) 0:03:49.030 ***** 2019-10-23T08:29:03.933 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-10-23T08:29:03.973 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:03 +0000 (0:00:00.079) 0:03:49.110 ***** 2019-10-23T08:29:04.299 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-10-23T08:29:04.360 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:04 +0000 (0:00:00.386) 0:03:49.496 ***** 2019-10-23T08:29:04.506 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-10-23T08:29:04.560 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:04 +0000 (0:00:00.199) 0:03:49.696 ***** 2019-10-23T08:29:10.128 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:05.369717", "end": "2019-10-23 08:29:10.066288", "rc": 0, "start": "2019-10-23 08:29:04.696571", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.rackspace.com", " * epel: ftp.linux.ncsu.edu", " * extras: mirror.atlanticmetro.net", " * updates: repo1.ash.innoscale.net", "No unfinished transactions left."]} 2019-10-23T08:29:10.172 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:10 +0000 (0:00:05.609) 0:03:55.306 ***** 2019-10-23T08:29:10.300 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:05.376513", "end": "2019-10-23 08:29:10.263451", "rc": 0, "start": "2019-10-23 08:29:04.886938", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.wdc1.us.leaseweb.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.rackspace.com", " * epel: ftp.linux.ncsu.edu", " * extras: mirror.atlanticmetro.net", " * updates: mirror.wdc1.us.leaseweb.net", "No unfinished transactions left."]} 2019-10-23T08:29:10.371 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:10 +0000 (0:00:00.201) 0:03:55.508 ***** 2019-10-23T08:29:10.550 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-10-23T08:29:10.551 INFO:teuthology.task.ansible.out:fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.036042", "end": "2019-10-23 08:29:10.520161", "msg": "non-zero return code", "rc": 1, "start": "2019-10-23 08:29:10.484119", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-10-23T08:29:10.603 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:10 +0000 (0:00:00.228) 0:03:55.736 ***** 2019-10-23T08:29:10.648 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-10-23T08:29:10.650 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:29:10.690 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:10 +0000 (0:00:00.089) 0:03:55.826 ***** 2019-10-23T08:29:10.729 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-10-23T08:29:10.730 INFO:teuthology.task.ansible.out:fatal: [smithi062.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.038269", "end": "2019-10-23 08:29:10.708384", "msg": "non-zero return code", "rc": 1, "start": "2019-10-23 08:29:10.670115", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-10-23T08:29:10.770 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:10 +0000 (0:00:00.080) 0:03:55.907 ***** 2019-10-23T08:29:10.840 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-10-23T08:29:10.842 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:29:10.884 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:10 +0000 (0:00:00.113) 0:03:56.021 ***** 2019-10-23T08:29:10.886 INFO:teuthology.task.ansible.out: 2019-10-23T08:29:11.179 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-10-23T08:29:11.181 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph) => {"ansible_loop_var": "item", "changed": false, "item": "ceph", "msg": "", "rc": 0, "results": ["ceph is not installed"]} 2019-10-23T08:29:11.378 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph) => {"ansible_loop_var": "item", "changed": false, "item": "ceph", "msg": "", "rc": 0, "results": ["ceph is not installed"]} 2019-10-23T08:29:11.692 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph-base) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-base", "msg": "", "rc": 0, "results": ["ceph-base is not installed"]} 2019-10-23T08:29:11.897 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph-base) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-base", "msg": "", "rc": 0, "results": ["ceph-base is not installed"]} 2019-10-23T08:29:12.224 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph-selinux) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-selinux", "msg": "", "rc": 0, "results": ["ceph-selinux is not installed"]} 2019-10-23T08:29:12.409 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph-selinux) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-selinux", "msg": "", "rc": 0, "results": ["ceph-selinux is not installed"]} 2019-10-23T08:29:12.735 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph-common) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-common", "msg": "", "rc": 0, "results": ["ceph-common is not installed"]} 2019-10-23T08:29:12.933 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph-common) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-common", "msg": "", "rc": 0, "results": ["ceph-common is not installed"]} 2019-10-23T08:29:13.262 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph-debuginfo) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-debuginfo", "msg": "", "rc": 0, "results": ["ceph-debuginfo is not installed"]} 2019-10-23T08:29:13.452 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph-debuginfo) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-debuginfo", "msg": "", "rc": 0, "results": ["ceph-debuginfo is not installed"]} 2019-10-23T08:29:13.753 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph-release) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-release", "msg": "", "rc": 0, "results": ["ceph-release is not installed"]} 2019-10-23T08:29:13.981 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph-release) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-release", "msg": "", "rc": 0, "results": ["ceph-release is not installed"]} 2019-10-23T08:29:14.217 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libcephfs1) => {"ansible_loop_var": "item", "changed": false, "item": "libcephfs1", "msg": "", "rc": 0, "results": ["libcephfs1 is not installed"]} 2019-10-23T08:29:14.430 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libcephfs1) => {"ansible_loop_var": "item", "changed": false, "item": "libcephfs1", "msg": "", "rc": 0, "results": ["libcephfs1 is not installed"]} 2019-10-23T08:29:14.770 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ceph-radosgw) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-radosgw", "msg": "", "rc": 0, "results": ["ceph-radosgw is not installed"]} 2019-10-23T08:29:14.942 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ceph-radosgw) => {"ansible_loop_var": "item", "changed": false, "item": "ceph-radosgw", "msg": "", "rc": 0, "results": ["ceph-radosgw is not installed"]} 2019-10-23T08:29:15.306 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-ceph) => {"ansible_loop_var": "item", "changed": false, "item": "python-ceph", "msg": "", "rc": 0, "results": ["python-ceph is not installed"]} 2019-10-23T08:29:15.476 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-ceph) => {"ansible_loop_var": "item", "changed": false, "item": "python-ceph", "msg": "", "rc": 0, "results": ["python-ceph is not installed"]} 2019-10-23T08:29:15.850 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-rados) => {"ansible_loop_var": "item", "changed": false, "item": "python-rados", "msg": "", "rc": 0, "results": ["python-rados is not installed"]} 2019-10-23T08:29:16.025 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-rados) => {"ansible_loop_var": "item", "changed": false, "item": "python-rados", "msg": "", "rc": 0, "results": ["python-rados is not installed"]} 2019-10-23T08:29:16.379 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-rbd) => {"ansible_loop_var": "item", "changed": false, "item": "python-rbd", "msg": "", "rc": 0, "results": ["python-rbd is not installed"]} 2019-10-23T08:29:16.528 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-rbd) => {"ansible_loop_var": "item", "changed": false, "item": "python-rbd", "msg": "", "rc": 0, "results": ["python-rbd is not installed"]} 2019-10-23T08:29:16.909 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-cephfs) => {"ansible_loop_var": "item", "changed": false, "item": "python-cephfs", "msg": "", "rc": 0, "results": ["python-cephfs is not installed"]} 2019-10-23T08:29:17.050 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-cephfs) => {"ansible_loop_var": "item", "changed": false, "item": "python-cephfs", "msg": "", "rc": 0, "results": ["python-cephfs is not installed"]} 2019-10-23T08:29:24.682 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=librbd1) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["librbd1"]}, "item": "librbd1", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-common-1.5.3-160.el7_6.3.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-160.el7_6.3.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-img-1.5.3-160.el7_6.3.x86_64\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-160.el7_6.3 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-160.el7_6.3 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-160.el7_6.3 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-160.el7_6.3 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-160.el7_6.3 @updates 5.8 M\n qemu-kvm-common x86_64 10:1.5.3-160.el7_6.3 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package (+3 Dependent packages)\n\nInstalled size: 16 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-160.el7_6.3.x86_64 1/4 \n Erasing : 10:qemu-img-1.5.3-160.el7_6.3 2019-10-23T08:29:24.684 INFO:teuthology.task.ansible.out:.x86_64 2/4 \n Erasing : 10:qemu-kvm-common-1.5.3-160.el7_6.3.x86_64 3/4 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/4 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/4 \n Verifying : 10:qemu-kvm-1.5.3-160.el7_6.3.x86_64 2/4 \n Verifying : 10:qemu-img-1.5.3-160.el7_6.3.x86_64 3/4 \n Verifying : 10:qemu-kvm-common-1.5.3-160.el7_6.3.x86_64 4/4 \n\nRemoved:\n librbd1.x86_64 1:10.2.5-4.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-160.el7_6.3 \n qemu-kvm.x86_64 10:1.5.3-160.el7_6.3 \n qemu-kvm-common.x86_64 10:1.5.3-160.el7_6.3 \n\nComplete!\n"]} 2019-10-23T08:29:24.833 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=librbd1) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["librbd1"]}, "item": "librbd1", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-common-1.5.3-160.el7_6.3.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-160.el7_6.3.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-img-1.5.3-160.el7_6.3.x86_64\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-160.el7_6.3 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-160.el7_6.3 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-160.el7_6.3 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-160.el7_6.3 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-160.el7_6.3 @updates 5.8 M\n qemu-kvm-common x86_64 10:1.5.3-160.el7_6.3 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package (+3 Dependent packages)\n\nInstalled size: 16 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-160.el7_6.3.x86_64 1/4 \n Erasing : 10:qemu-img-1.5.3-160.el7_6.3 2019-10-23T08:29:24.835 INFO:teuthology.task.ansible.out:.x86_64 2/4 \n Erasing : 10:qemu-kvm-common-1.5.3-160.el7_6.3.x86_64 3/4 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/4 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/4 \n Verifying : 10:qemu-kvm-1.5.3-160.el7_6.3.x86_64 2/4 \n Verifying : 10:qemu-img-1.5.3-160.el7_6.3.x86_64 3/4 \n Verifying : 10:qemu-kvm-common-1.5.3-160.el7_6.3.x86_64 4/4 \n\nRemoved:\n librbd1.x86_64 1:10.2.5-4.el7 \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-160.el7_6.3 \n qemu-kvm.x86_64 10:1.5.3-160.el7_6.3 \n qemu-kvm-common.x86_64 10:1.5.3-160.el7_6.3 \n\nComplete!\n"]} 2019-10-23T08:29:26.900 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=librados2) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["librados2"]}, "item": "librados2", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 5.5 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 1:librados2-10.2.5-4.el7.x86_64 1/1 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 1/1 \n\nRemoved:\n librados2.x86_64 1:10.2.5-4.el7 \n\nComplete!\n"]} 2019-10-23T08:29:27.124 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=librados2) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["librados2"]}, "item": "librados2", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 5.5 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 1:librados2-10.2.5-4.el7.x86_64 1/1 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 1/1 \n\nRemoved:\n librados2.x86_64 1:10.2.5-4.el7 \n\nComplete!\n"]} 2019-10-23T08:29:29.295 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=mod_fastcgi) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["mod_fastcgi"]}, "item": "mod_fastcgi", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 213 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \n\nRemoved:\n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:29:29.499 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=mod_fastcgi) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["mod_fastcgi"]}, "item": "mod_fastcgi", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 213 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \n\nRemoved:\n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:29:31.666 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=iozone) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["iozone"]}, "item": "iozone", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 1.3 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:29:31.726 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:31 +0000 (0:00:20.841) 0:04:16.863 ***** 2019-10-23T08:29:31.885 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=iozone) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["iozone"]}, "item": "iozone", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 1.3 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:29:31.935 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:31 +0000 (0:00:00.209) 0:04:17.072 ***** 2019-10-23T08:29:34.184 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi038.front.sepia.ceph.com] => (item=boost-random) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["boost-random"]}, "item": "boost-random", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-10-23T08:29:34.410 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=boost-random) => {"ansible_loop_var": "item", "changed": true, "changes": {"removed": ["boost-random"]}, "item": "boost-random", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-10-23T08:29:34.716 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=boost-program-options) => {"ansible_loop_var": "item", "changed": false, "item": "boost-program-options", "msg": "", "rc": 0, "results": ["boost-program-options is not installed"]} 2019-10-23T08:29:34.957 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=boost-program-options) => {"ansible_loop_var": "item", "changed": false, "item": "boost-program-options", "msg": "", "rc": 0, "results": ["boost-program-options is not installed"]} 2019-10-23T08:29:35.139 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=leveldb) => {"ansible_loop_var": "item", "changed": false, "item": "leveldb", "msg": "", "rc": 0, "results": ["leveldb is not installed"]} 2019-10-23T08:29:35.392 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=leveldb) => {"ansible_loop_var": "item", "changed": false, "item": "leveldb", "msg": "", "rc": 0, "results": ["leveldb is not installed"]} 2019-10-23T08:29:35.571 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=xmlstarlet) => {"ansible_loop_var": "item", "changed": false, "item": "xmlstarlet", "msg": "", "rc": 0, "results": ["xmlstarlet is not installed"]} 2019-10-23T08:29:35.823 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=xmlstarlet) => {"ansible_loop_var": "item", "changed": false, "item": "xmlstarlet", "msg": "", "rc": 0, "results": ["xmlstarlet is not installed"]} 2019-10-23T08:29:36.101 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-jinja2) => {"ansible_loop_var": "item", "changed": false, "item": "python-jinja2", "msg": "", "rc": 0, "results": ["python-jinja2 is not installed"]} 2019-10-23T08:29:36.340 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-jinja2) => {"ansible_loop_var": "item", "changed": false, "item": "python-jinja2", "msg": "", "rc": 0, "results": ["python-jinja2 is not installed"]} 2019-10-23T08:29:36.626 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-ceph) => {"ansible_loop_var": "item", "changed": false, "item": "python-ceph", "msg": "", "rc": 0, "results": ["python-ceph is not installed"]} 2019-10-23T08:29:36.859 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-ceph) => {"ansible_loop_var": "item", "changed": false, "item": "python-ceph", "msg": "", "rc": 0, "results": ["python-ceph is not installed"]} 2019-10-23T08:29:37.159 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-flask) => {"ansible_loop_var": "item", "changed": false, "item": "python-flask", "msg": "", "rc": 0, "results": ["python-flask is not installed"]} 2019-10-23T08:29:37.431 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-flask) => {"ansible_loop_var": "item", "changed": false, "item": "python-flask", "msg": "", "rc": 0, "results": ["python-flask is not installed"]} 2019-10-23T08:29:37.714 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-requests) => {"ansible_loop_var": "item", "changed": false, "item": "python-requests", "msg": "", "rc": 0, "results": ["python-requests is not installed"]} 2019-10-23T08:29:37.970 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-requests) => {"ansible_loop_var": "item", "changed": false, "item": "python-requests", "msg": "", "rc": 0, "results": ["python-requests is not installed"]} 2019-10-23T08:29:38.248 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=boost-random) => {"ansible_loop_var": "item", "changed": false, "item": "boost-random", "msg": "", "rc": 0, "results": ["boost-random is not installed"]} 2019-10-23T08:29:38.499 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=boost-random) => {"ansible_loop_var": "item", "changed": false, "item": "boost-random", "msg": "", "rc": 0, "results": ["boost-random is not installed"]} 2019-10-23T08:29:38.754 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-urllib3) => {"ansible_loop_var": "item", "changed": false, "item": "python-urllib3", "msg": "", "rc": 0, "results": ["python-urllib3 is not installed"]} 2019-10-23T08:29:39.043 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-urllib3) => {"ansible_loop_var": "item", "changed": false, "item": "python-urllib3", "msg": "", "rc": 0, "results": ["python-urllib3 is not installed"]} 2019-10-23T08:29:39.259 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-babel) => {"ansible_loop_var": "item", "changed": false, "item": "python-babel", "msg": "", "rc": 0, "results": ["python-babel is not installed"]} 2019-10-23T08:29:39.567 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-babel) => {"ansible_loop_var": "item", "changed": false, "item": "python-babel", "msg": "", "rc": 0, "results": ["python-babel is not installed"]} 2019-10-23T08:29:39.679 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=hdparm) => {"ansible_loop_var": "item", "changed": false, "item": "hdparm", "msg": "", "rc": 0, "results": ["hdparm is not installed"]} 2019-10-23T08:29:39.993 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=hdparm) => {"ansible_loop_var": "item", "changed": false, "item": "hdparm", "msg": "", "rc": 0, "results": ["hdparm is not installed"]} 2019-10-23T08:29:40.208 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-markupsafe) => {"ansible_loop_var": "item", "changed": false, "item": "python-markupsafe", "msg": "", "rc": 0, "results": ["python-markupsafe is not installed"]} 2019-10-23T08:29:40.493 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-markupsafe) => {"ansible_loop_var": "item", "changed": false, "item": "python-markupsafe", "msg": "", "rc": 0, "results": ["python-markupsafe is not installed"]} 2019-10-23T08:29:40.771 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-werkzeug) => {"ansible_loop_var": "item", "changed": false, "item": "python-werkzeug", "msg": "", "rc": 0, "results": ["python-werkzeug is not installed"]} 2019-10-23T08:29:41.040 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-werkzeug) => {"ansible_loop_var": "item", "changed": false, "item": "python-werkzeug", "msg": "", "rc": 0, "results": ["python-werkzeug is not installed"]} 2019-10-23T08:29:41.322 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-itsdangerous) => {"ansible_loop_var": "item", "changed": false, "item": "python-itsdangerous", "msg": "", "rc": 0, "results": ["python-itsdangerous is not installed"]} 2019-10-23T08:29:41.374 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:41 +0000 (0:00:09.437) 0:04:26.510 ***** 2019-10-23T08:29:41.574 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-itsdangerous) => {"ansible_loop_var": "item", "changed": false, "item": "python-itsdangerous", "msg": "", "rc": 0, "results": ["python-itsdangerous is not installed"]} 2019-10-23T08:29:41.627 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:29:41 +0000 (0:00:00.253) 0:04:26.763 ***** 2019-10-23T08:29:42.324 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-10-23T08:29:42.325 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=@core) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": ["@core"]}, "item": "@core", "msg": "Warning: Group core does not have any packages to install.\n", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\nNothing to do\n"]} 2019-10-23T08:29:42.579 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=@core) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": ["@core"]}, "item": "@core", "msg": "Warning: Group core does not have any packages to install.\n", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.wdc1.us.leaseweb.net\nNothing to do\n"]} 2019-10-23T08:29:43.280 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=@base) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": ["@base"]}, "item": "@base", "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\nNothing to do\n"]} 2019-10-23T08:29:43.506 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=@base) => {"ansible_loop_var": "item", "changed": false, "changes": {"installed": ["@base"]}, "item": "@base", "msg": "Warning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.wdc1.us.leaseweb.net\nNothing to do\n"]} 2019-10-23T08:29:43.787 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=yum-plugin-priorities) => {"ansible_loop_var": "item", "changed": false, "item": "yum-plugin-priorities", "msg": "", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-50.el7.noarch providing yum-plugin-priorities is already installed"]} 2019-10-23T08:29:44.000 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=yum-plugin-priorities) => {"ansible_loop_var": "item", "changed": false, "item": "yum-plugin-priorities", "msg": "", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-50.el7.noarch providing yum-plugin-priorities is already installed"]} 2019-10-23T08:29:44.268 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=yum-plugin-fastestmirror) => {"ansible_loop_var": "item", "changed": false, "item": "yum-plugin-fastestmirror", "msg": "", "rc": 0, "results": ["yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed"]} 2019-10-23T08:29:44.473 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=yum-plugin-fastestmirror) => {"ansible_loop_var": "item", "changed": false, "item": "yum-plugin-fastestmirror", "msg": "", "rc": 0, "results": ["yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed"]} 2019-10-23T08:29:44.771 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=redhat-lsb) => {"ansible_loop_var": "item", "changed": false, "item": "redhat-lsb", "msg": "", "rc": 0, "results": ["redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed"]} 2019-10-23T08:29:44.983 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=redhat-lsb) => {"ansible_loop_var": "item", "changed": false, "item": "redhat-lsb", "msg": "", "rc": 0, "results": ["redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed"]} 2019-10-23T08:29:45.268 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=sysstat) => {"ansible_loop_var": "item", "changed": false, "item": "sysstat", "msg": "", "rc": 0, "results": ["sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed"]} 2019-10-23T08:29:45.481 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=sysstat) => {"ansible_loop_var": "item", "changed": false, "item": "sysstat", "msg": "", "rc": 0, "results": ["sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed"]} 2019-10-23T08:29:45.740 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=gdb) => {"ansible_loop_var": "item", "changed": false, "item": "gdb", "msg": "", "rc": 0, "results": ["gdb-7.6.1-114.el7.x86_64 providing gdb is already installed"]} 2019-10-23T08:29:45.919 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gdb) => {"ansible_loop_var": "item", "changed": false, "item": "gdb", "msg": "", "rc": 0, "results": ["gdb-7.6.1-114.el7.x86_64 providing gdb is already installed"]} 2019-10-23T08:29:46.172 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=git-all) => {"ansible_loop_var": "item", "changed": false, "item": "git-all", "msg": "", "rc": 0, "results": ["git-all-1.8.3.1-20.el7.noarch providing git-all is already installed"]} 2019-10-23T08:29:46.374 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=git-all) => {"ansible_loop_var": "item", "changed": false, "item": "git-all", "msg": "", "rc": 0, "results": ["git-all-1.8.3.1-20.el7.noarch providing git-all is already installed"]} 2019-10-23T08:29:46.669 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-configobj) => {"ansible_loop_var": "item", "changed": false, "item": "python-configobj", "msg": "", "rc": 0, "results": ["python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed"]} 2019-10-23T08:29:46.829 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-configobj) => {"ansible_loop_var": "item", "changed": false, "item": "python-configobj", "msg": "", "rc": 0, "results": ["python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed"]} 2019-10-23T08:29:47.148 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=gcc-c++) => {"ansible_loop_var": "item", "changed": false, "item": "gcc-c++", "msg": "", "rc": 0, "results": ["gcc-c++-4.8.5-36.el7_6.2.x86_64 providing gcc-c++ is already installed"]} 2019-10-23T08:29:47.303 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gcc-c++) => {"ansible_loop_var": "item", "changed": false, "item": "gcc-c++", "msg": "", "rc": 0, "results": ["gcc-c++-4.8.5-36.el7_6.2.x86_64 providing gcc-c++ is already installed"]} 2019-10-23T08:29:47.591 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libedit) => {"ansible_loop_var": "item", "changed": false, "item": "libedit", "msg": "", "rc": 0, "results": ["libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed"]} 2019-10-23T08:29:47.796 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libedit) => {"ansible_loop_var": "item", "changed": false, "item": "libedit", "msg": "", "rc": 0, "results": ["libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed"]} 2019-10-23T08:29:48.085 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=openssl098e) => {"ansible_loop_var": "item", "changed": false, "item": "openssl098e", "msg": "", "rc": 0, "results": ["openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed"]} 2019-10-23T08:29:48.282 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=openssl098e) => {"ansible_loop_var": "item", "changed": false, "item": "openssl098e", "msg": "", "rc": 0, "results": ["openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed"]} 2019-10-23T08:29:48.552 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=boost-thread) => {"ansible_loop_var": "item", "changed": false, "item": "boost-thread", "msg": "", "rc": 0, "results": ["boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed"]} 2019-10-23T08:29:48.768 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=boost-thread) => {"ansible_loop_var": "item", "changed": false, "item": "boost-thread", "msg": "", "rc": 0, "results": ["boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed"]} 2019-10-23T08:29:49.032 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=xfsprogs) => {"ansible_loop_var": "item", "changed": false, "item": "xfsprogs", "msg": "", "rc": 0, "results": ["xfsprogs-4.5.0-19.el7_6.x86_64 providing xfsprogs is already installed"]} 2019-10-23T08:29:49.284 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=xfsprogs) => {"ansible_loop_var": "item", "changed": false, "item": "xfsprogs", "msg": "", "rc": 0, "results": ["xfsprogs-4.5.0-19.el7_6.x86_64 providing xfsprogs is already installed"]} 2019-10-23T08:29:49.477 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=gdisk) => {"ansible_loop_var": "item", "changed": false, "item": "gdisk", "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed"]} 2019-10-23T08:29:49.746 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gdisk) => {"ansible_loop_var": "item", "changed": false, "item": "gdisk", "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed"]} 2019-10-23T08:29:49.965 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=parted) => {"ansible_loop_var": "item", "changed": false, "item": "parted", "msg": "", "rc": 0, "results": ["parted-3.1-29.el7.x86_64 providing parted is already installed"]} 2019-10-23T08:29:50.197 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=parted) => {"ansible_loop_var": "item", "changed": false, "item": "parted", "msg": "", "rc": 0, "results": ["parted-3.1-29.el7.x86_64 providing parted is already installed"]} 2019-10-23T08:29:50.388 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libgcrypt) => {"ansible_loop_var": "item", "changed": false, "item": "libgcrypt", "msg": "", "rc": 0, "results": ["libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed"]} 2019-10-23T08:29:50.685 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libgcrypt) => {"ansible_loop_var": "item", "changed": false, "item": "libgcrypt", "msg": "", "rc": 0, "results": ["libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed"]} 2019-10-23T08:29:50.868 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=fuse) => {"ansible_loop_var": "item", "changed": false, "item": "fuse", "msg": "", "rc": 0, "results": ["fuse-2.9.2-11.el7.x86_64 providing fuse is already installed"]} 2019-10-23T08:29:51.153 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=fuse) => {"ansible_loop_var": "item", "changed": false, "item": "fuse", "msg": "", "rc": 0, "results": ["fuse-2.9.2-11.el7.x86_64 providing fuse is already installed"]} 2019-10-23T08:29:51.359 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=fuse-libs) => {"ansible_loop_var": "item", "changed": false, "item": "fuse-libs", "msg": "", "rc": 0, "results": ["fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed"]} 2019-10-23T08:29:51.643 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=fuse-libs) => {"ansible_loop_var": "item", "changed": false, "item": "fuse-libs", "msg": "", "rc": 0, "results": ["fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed"]} 2019-10-23T08:29:51.823 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-virtualenv) => {"ansible_loop_var": "item", "changed": false, "item": "python-virtualenv", "msg": "", "rc": 0, "results": ["python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed"]} 2019-10-23T08:29:52.070 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-virtualenv) => {"ansible_loop_var": "item", "changed": false, "item": "python-virtualenv", "msg": "", "rc": 0, "results": ["python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed"]} 2019-10-23T08:29:52.335 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=openssl) => {"ansible_loop_var": "item", "changed": false, "item": "openssl", "msg": "", "rc": 0, "results": ["1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed"]} 2019-10-23T08:29:52.559 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=openssl) => {"ansible_loop_var": "item", "changed": false, "item": "openssl", "msg": "", "rc": 0, "results": ["1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed"]} 2019-10-23T08:29:52.815 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libuuid) => {"ansible_loop_var": "item", "changed": false, "item": "libuuid", "msg": "", "rc": 0, "results": ["libuuid-2.23.2-59.el7_6.1.x86_64 providing libuuid is already installed"]} 2019-10-23T08:29:53.038 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libuuid) => {"ansible_loop_var": "item", "changed": false, "item": "libuuid", "msg": "", "rc": 0, "results": ["libuuid-2.23.2-59.el7_6.1.x86_64 providing libuuid is already installed"]} 2019-10-23T08:29:53.291 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=btrfs-progs) => {"ansible_loop_var": "item", "changed": false, "item": "btrfs-progs", "msg": "", "rc": 0, "results": ["btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed"]} 2019-10-23T08:29:53.525 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=btrfs-progs) => {"ansible_loop_var": "item", "changed": false, "item": "btrfs-progs", "msg": "", "rc": 0, "results": ["btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed"]} 2019-10-23T08:29:53.686 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=attr) => {"ansible_loop_var": "item", "changed": false, "item": "attr", "msg": "", "rc": 0, "results": ["attr-2.4.46-13.el7.x86_64 providing attr is already installed"]} 2019-10-23T08:29:54.005 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=attr) => {"ansible_loop_var": "item", "changed": false, "item": "attr", "msg": "", "rc": 0, "results": ["attr-2.4.46-13.el7.x86_64 providing attr is already installed"]} 2019-10-23T08:29:54.182 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=valgrind) => {"ansible_loop_var": "item", "changed": false, "item": "valgrind", "msg": "", "rc": 0, "results": ["1:valgrind-3.13.0-13.el7.x86_64 providing valgrind is already installed"]} 2019-10-23T08:29:54.458 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=valgrind) => {"ansible_loop_var": "item", "changed": false, "item": "valgrind", "msg": "", "rc": 0, "results": ["1:valgrind-3.13.0-13.el7.x86_64 providing valgrind is already installed"]} 2019-10-23T08:29:54.710 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-nose) => {"ansible_loop_var": "item", "changed": false, "item": "python-nose", "msg": "", "rc": 0, "results": ["python-nose-1.3.7-1.el7.noarch providing python-nose is already installed"]} 2019-10-23T08:29:54.942 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-nose) => {"ansible_loop_var": "item", "changed": false, "item": "python-nose", "msg": "", "rc": 0, "results": ["python-nose-1.3.7-1.el7.noarch providing python-nose is already installed"]} 2019-10-23T08:29:55.345 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=mpich) => {"ansible_loop_var": "item", "changed": false, "item": "mpich", "msg": "", "rc": 0, "results": ["mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed"]} 2019-10-23T08:29:55.582 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=mpich) => {"ansible_loop_var": "item", "changed": false, "item": "mpich", "msg": "", "rc": 0, "results": ["mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed"]} 2019-10-23T08:29:55.791 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ant) => {"ansible_loop_var": "item", "changed": false, "item": "ant", "msg": "", "rc": 0, "results": ["ant-1.9.4-2.el7.noarch providing ant is already installed"]} 2019-10-23T08:29:56.090 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ant) => {"ansible_loop_var": "item", "changed": false, "item": "ant", "msg": "", "rc": 0, "results": ["ant-1.9.4-2.el7.noarch providing ant is already installed"]} 2019-10-23T08:29:58.621 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=iozone) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": ["iozone"]}, "item": "iozone", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal download size: 800 k\nInstalled size: 800 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:29:59.071 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=iozone) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": ["iozone"]}, "item": "iozone", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.wdc1.us.leaseweb.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal download size: 800 k\nInstalled size: 800 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 1/1 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:29:59.103 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libtool) => {"ansible_loop_var": "item", "changed": false, "item": "libtool", "msg": "", "rc": 0, "results": ["libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed"]} 2019-10-23T08:29:59.549 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libtool) => {"ansible_loop_var": "item", "changed": false, "item": "libtool", "msg": "", "rc": 0, "results": ["libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed"]} 2019-10-23T08:29:59.603 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=automake) => {"ansible_loop_var": "item", "changed": false, "item": "automake", "msg": "", "rc": 0, "results": ["automake-1.13.4-3.el7.noarch providing automake is already installed"]} 2019-10-23T08:30:00.031 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=automake) => {"ansible_loop_var": "item", "changed": false, "item": "automake", "msg": "", "rc": 0, "results": ["automake-1.13.4-3.el7.noarch providing automake is already installed"]} 2019-10-23T08:30:00.089 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=gettext) => {"ansible_loop_var": "item", "changed": false, "item": "gettext", "msg": "", "rc": 0, "results": ["gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed"]} 2019-10-23T08:30:00.573 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gettext) => {"ansible_loop_var": "item", "changed": false, "item": "gettext", "msg": "", "rc": 0, "results": ["gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed"]} 2019-10-23T08:30:00.592 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libuuid-devel) => {"ansible_loop_var": "item", "changed": false, "item": "libuuid-devel", "msg": "", "rc": 0, "results": ["libuuid-devel-2.23.2-59.el7_6.1.x86_64 providing libuuid-devel is already installed"]} 2019-10-23T08:30:01.085 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libuuid-devel) => {"ansible_loop_var": "item", "changed": false, "item": "libuuid-devel", "msg": "", "rc": 0, "results": ["libuuid-devel-2.23.2-59.el7_6.1.x86_64 providing libuuid-devel is already installed"]} 2019-10-23T08:30:01.086 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libacl-devel) => {"ansible_loop_var": "item", "changed": false, "item": "libacl-devel", "msg": "", "rc": 0, "results": ["libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed"]} 2019-10-23T08:30:01.480 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=bc) => {"ansible_loop_var": "item", "changed": false, "item": "bc", "msg": "", "rc": 0, "results": ["bc-1.06.95-13.el7.x86_64 providing bc is already installed"]} 2019-10-23T08:30:01.585 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libacl-devel) => {"ansible_loop_var": "item", "changed": false, "item": "libacl-devel", "msg": "", "rc": 0, "results": ["libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed"]} 2019-10-23T08:30:01.919 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=xfsdump) => {"ansible_loop_var": "item", "changed": false, "item": "xfsdump", "msg": "", "rc": 0, "results": ["xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed"]} 2019-10-23T08:30:02.037 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=bc) => {"ansible_loop_var": "item", "changed": false, "item": "bc", "msg": "", "rc": 0, "results": ["bc-1.06.95-13.el7.x86_64 providing bc is already installed"]} 2019-10-23T08:30:02.404 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=xfsprogs-devel) => {"ansible_loop_var": "item", "changed": false, "item": "xfsprogs-devel", "msg": "", "rc": 0, "results": ["xfsprogs-devel-4.5.0-19.el7_6.x86_64 providing xfsprogs-devel is already installed"]} 2019-10-23T08:30:02.493 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=xfsdump) => {"ansible_loop_var": "item", "changed": false, "item": "xfsdump", "msg": "", "rc": 0, "results": ["xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed"]} 2019-10-23T08:30:02.886 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=blktrace) => {"ansible_loop_var": "item", "changed": false, "item": "blktrace", "msg": "", "rc": 0, "results": ["blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed"]} 2019-10-23T08:30:02.973 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=xfsprogs-devel) => {"ansible_loop_var": "item", "changed": false, "item": "xfsprogs-devel", "msg": "", "rc": 0, "results": ["xfsprogs-devel-4.5.0-19.el7_6.x86_64 providing xfsprogs-devel is already installed"]} 2019-10-23T08:30:03.362 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=numpy) => {"ansible_loop_var": "item", "changed": false, "item": "numpy", "msg": "", "rc": 0, "results": ["1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed"]} 2019-10-23T08:30:03.458 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=blktrace) => {"ansible_loop_var": "item", "changed": false, "item": "blktrace", "msg": "", "rc": 0, "results": ["blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed"]} 2019-10-23T08:30:03.825 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-matplotlib) => {"ansible_loop_var": "item", "changed": false, "item": "python-matplotlib", "msg": "", "rc": 0, "results": ["python-matplotlib-1.2.0-15.el7.x86_64 providing python-matplotlib is already installed"]} 2019-10-23T08:30:03.951 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=numpy) => {"ansible_loop_var": "item", "changed": false, "item": "numpy", "msg": "", "rc": 0, "results": ["1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed"]} 2019-10-23T08:30:04.411 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-matplotlib) => {"ansible_loop_var": "item", "changed": false, "item": "python-matplotlib", "msg": "", "rc": 0, "results": ["python-matplotlib-1.2.0-15.el7.x86_64 providing python-matplotlib is already installed"]} 2019-10-23T08:30:10.468 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=qemu-kvm) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": ["qemu-kvm"]}, "item": "qemu-kvm", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\nResolving Dependencies\n--> Running transaction check\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 2019-10-23T08:30:10.470 INFO:teuthology.task.ansible.out: 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package (+5 Dependent packages)\n\nTotal download size: 7.3 M\nInstalled size: 22 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 25 MB/s | 7.3 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/6 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/6 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/6 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/6 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/6 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/6 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/6 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/6 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 3/6 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/6 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/6 \n Verifying : boost-random-1.53.0-27.el7.x86_64 6/6 \n\nInstalled:\n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 2019-10-23T08:30:10.471 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-10-23T08:30:11.022 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=usbredir) => {"ansible_loop_var": "item", "changed": false, "item": "usbredir", "msg": "", "rc": 0, "results": ["usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed"]} 2019-10-23T08:30:11.044 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=qemu-kvm) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": ["qemu-kvm"]}, "item": "qemu-kvm", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.wdc1.us.leaseweb.net\nResolving Dependencies\n--> Running transaction check\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 2019-10-23T08:30:11.046 INFO:teuthology.task.ansible.out: 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package (+5 Dependent packages)\n\nTotal download size: 7.3 M\nInstalled size: 22 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 17 MB/s | 7.3 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/6 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/6 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/6 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/6 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/6 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/6 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/6 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/6 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 3/6 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/6 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/6 \n Verifying : boost-random-1.53.0-27.el7.x86_64 6/6 \n\nInstalled:\n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 2019-10-23T08:30:11.048 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-10-23T08:30:11.538 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=usbredir) => {"ansible_loop_var": "item", "changed": false, "item": "usbredir", "msg": "", "rc": 0, "results": ["usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed"]} 2019-10-23T08:30:11.539 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=genisoimage) => {"ansible_loop_var": "item", "changed": false, "item": "genisoimage", "msg": "", "rc": 0, "results": ["genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed"]} 2019-10-23T08:30:12.010 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=genisoimage) => {"ansible_loop_var": "item", "changed": false, "item": "genisoimage", "msg": "", "rc": 0, "results": ["genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed"]} 2019-10-23T08:30:12.022 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=httpd) => {"ansible_loop_var": "item", "changed": false, "item": "httpd", "msg": "", "rc": 0, "results": ["httpd-2.4.6-89.el7.centos.1.x86_64 providing httpd is already installed"]} 2019-10-23T08:30:12.467 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=httpd) => {"ansible_loop_var": "item", "changed": false, "item": "httpd", "msg": "", "rc": 0, "results": ["httpd-2.4.6-89.el7.centos.1.x86_64 providing httpd is already installed"]} 2019-10-23T08:30:12.510 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=httpd-devel) => {"ansible_loop_var": "item", "changed": false, "item": "httpd-devel", "msg": "", "rc": 0, "results": ["httpd-devel-2.4.6-89.el7.centos.1.x86_64 providing httpd-devel is already installed"]} 2019-10-23T08:30:12.954 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=httpd-devel) => {"ansible_loop_var": "item", "changed": false, "item": "httpd-devel", "msg": "", "rc": 0, "results": ["httpd-devel-2.4.6-89.el7.centos.1.x86_64 providing httpd-devel is already installed"]} 2019-10-23T08:30:12.977 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=httpd-tools) => {"ansible_loop_var": "item", "changed": false, "item": "httpd-tools", "msg": "", "rc": 0, "results": ["httpd-tools-2.4.6-89.el7.centos.1.x86_64 providing httpd-tools is already installed"]} 2019-10-23T08:30:13.458 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=httpd-tools) => {"ansible_loop_var": "item", "changed": false, "item": "httpd-tools", "msg": "", "rc": 0, "results": ["httpd-tools-2.4.6-89.el7.centos.1.x86_64 providing httpd-tools is already installed"]} 2019-10-23T08:30:13.469 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=mod_ssl) => {"ansible_loop_var": "item", "changed": false, "item": "mod_ssl", "msg": "", "rc": 0, "results": ["1:mod_ssl-2.4.6-89.el7.centos.1.x86_64 providing mod_ssl is already installed"]} 2019-10-23T08:30:13.940 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=mod_ssl) => {"ansible_loop_var": "item", "changed": false, "item": "mod_ssl", "msg": "", "rc": 0, "results": ["1:mod_ssl-2.4.6-89.el7.centos.1.x86_64 providing mod_ssl is already installed"]} 2019-10-23T08:30:24.983 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item=mod_fastcgi-2.4.7-1.ceph.el7.centos) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": ["mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "item": "mod_fastcgi-2.4.7-1.ceph.el7.centos", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: repo1.ash.innoscale.net\nResolving Dependencies\n--> Running transaction check\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal download size: 70 k\nInstalled size: 213 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \n\nInstalled:\n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:30:25.316 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item=mod_fastcgi-2.4.7-1.ceph.el7.centos) => {"ansible_loop_var": "item", "changed": true, "changes": {"installed": ["mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "item": "mod_fastcgi-2.4.7-1.ceph.el7.centos", "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.rackspace.com\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.wdc1.us.leaseweb.net\nResolving Dependencies\n--> Running transaction check\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal download size: 70 k\nInstalled size: 213 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 1/1 \n\nInstalled:\n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nComplete!\n"]} 2019-10-23T08:30:25.532 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=libev-devel) => {"ansible_loop_var": "item", "changed": false, "item": "libev-devel", "msg": "", "rc": 0, "results": ["libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed"]} 2019-10-23T08:30:25.870 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=libev-devel) => {"ansible_loop_var": "item", "changed": false, "item": "libev-devel", "msg": "", "rc": 0, "results": ["libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed"]} 2019-10-23T08:30:25.982 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=perl-XML-Twig) => {"ansible_loop_var": "item", "changed": false, "item": "perl-XML-Twig", "msg": "", "rc": 0, "results": ["perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed"]} 2019-10-23T08:30:26.355 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=perl-XML-Twig) => {"ansible_loop_var": "item", "changed": false, "item": "perl-XML-Twig", "msg": "", "rc": 0, "results": ["perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed"]} 2019-10-23T08:30:26.457 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=java-1.6.0-openjdk-devel) => {"ansible_loop_var": "item", "changed": false, "item": "java-1.6.0-openjdk-devel", "msg": "", "rc": 0, "results": ["1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed"]} 2019-10-23T08:30:26.843 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=java-1.6.0-openjdk-devel) => {"ansible_loop_var": "item", "changed": false, "item": "java-1.6.0-openjdk-devel", "msg": "", "rc": 0, "results": ["1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed"]} 2019-10-23T08:30:27.083 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=junit4) => {"ansible_loop_var": "item", "changed": false, "item": "junit4", "msg": "", "rc": 0, "results": ["junit-4.11-8.el7.noarch providing junit4 is already installed"]} 2019-10-23T08:30:27.428 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=junit4) => {"ansible_loop_var": "item", "changed": false, "item": "junit4", "msg": "", "rc": 0, "results": ["junit-4.11-8.el7.noarch providing junit4 is already installed"]} 2019-10-23T08:30:27.574 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nfs-utils) => {"ansible_loop_var": "item", "changed": false, "item": "nfs-utils", "msg": "", "rc": 0, "results": ["1:nfs-utils-1.3.0-0.35.el7.x86_64 providing nfs-utils is already installed"]} 2019-10-23T08:30:27.912 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nfs-utils) => {"ansible_loop_var": "item", "changed": false, "item": "nfs-utils", "msg": "", "rc": 0, "results": ["1:nfs-utils-1.3.0-0.35.el7.x86_64 providing nfs-utils is already installed"]} 2019-10-23T08:30:28.073 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=ncurses-devel) => {"ansible_loop_var": "item", "changed": false, "item": "ncurses-devel", "msg": "", "rc": 0, "results": ["ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed"]} 2019-10-23T08:30:28.387 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=ncurses-devel) => {"ansible_loop_var": "item", "changed": false, "item": "ncurses-devel", "msg": "", "rc": 0, "results": ["ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed"]} 2019-10-23T08:30:28.543 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-devel) => {"ansible_loop_var": "item", "changed": false, "item": "python-devel", "msg": "", "rc": 0, "results": ["python-devel-2.7.5-80.el7_6.x86_64 providing python-devel is already installed"]} 2019-10-23T08:30:28.803 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-devel) => {"ansible_loop_var": "item", "changed": false, "item": "python-devel", "msg": "", "rc": 0, "results": ["python-devel-2.7.5-80.el7_6.x86_64 providing python-devel is already installed"]} 2019-10-23T08:30:29.024 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=python-virtualenv) => {"ansible_loop_var": "item", "changed": false, "item": "python-virtualenv", "msg": "", "rc": 0, "results": ["python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed"]} 2019-10-23T08:30:29.328 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=python-virtualenv) => {"ansible_loop_var": "item", "changed": false, "item": "python-virtualenv", "msg": "", "rc": 0, "results": ["python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed"]} 2019-10-23T08:30:29.494 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=perl-CPAN) => {"ansible_loop_var": "item", "changed": false, "item": "perl-CPAN", "msg": "", "rc": 0, "results": ["perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed"]} 2019-10-23T08:30:29.574 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:29 +0000 (0:00:47.946) 0:05:14.710 ***** 2019-10-23T08:30:29.773 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=perl-CPAN) => {"ansible_loop_var": "item", "changed": false, "item": "perl-CPAN", "msg": "", "rc": 0, "results": ["perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed"]} 2019-10-23T08:30:29.857 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:29 +0000 (0:00:00.283) 0:05:14.993 ***** 2019-10-23T08:30:30.147 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi038.front.sepia.ceph.com] => (item=cryptopp-devel) => {"ansible_loop_var": "item", "changed": false, "item": "cryptopp-devel", "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed"]} 2019-10-23T08:30:30.409 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=cryptopp-devel) => {"ansible_loop_var": "item", "changed": false, "item": "cryptopp-devel", "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed"]} 2019-10-23T08:30:30.681 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=cryptopp) => {"ansible_loop_var": "item", "changed": false, "item": "cryptopp", "msg": "", "rc": 0, "results": ["cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed"]} 2019-10-23T08:30:30.933 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=cryptopp) => {"ansible_loop_var": "item", "changed": false, "item": "cryptopp", "msg": "", "rc": 0, "results": ["cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed"]} 2019-10-23T08:30:31.221 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=fcgi) => {"ansible_loop_var": "item", "changed": false, "item": "fcgi", "msg": "", "rc": 0, "results": ["fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed"]} 2019-10-23T08:30:31.390 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=fcgi) => {"ansible_loop_var": "item", "changed": false, "item": "fcgi", "msg": "", "rc": 0, "results": ["fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed"]} 2019-10-23T08:30:31.747 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=dbench) => {"ansible_loop_var": "item", "changed": false, "item": "dbench", "msg": "", "rc": 0, "results": ["dbench-4.0-10.el7.x86_64 providing dbench is already installed"]} 2019-10-23T08:30:31.914 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=dbench) => {"ansible_loop_var": "item", "changed": false, "item": "dbench", "msg": "", "rc": 0, "results": ["dbench-4.0-10.el7.x86_64 providing dbench is already installed"]} 2019-10-23T08:30:32.249 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=fuse-sshfs) => {"ansible_loop_var": "item", "changed": false, "item": "fuse-sshfs", "msg": "", "rc": 0, "results": ["fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed"]} 2019-10-23T08:30:32.408 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=fuse-sshfs) => {"ansible_loop_var": "item", "changed": false, "item": "fuse-sshfs", "msg": "", "rc": 0, "results": ["fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed"]} 2019-10-23T08:30:32.745 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=bonnie++) => {"ansible_loop_var": "item", "changed": false, "item": "bonnie++", "msg": "", "rc": 0, "results": ["bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed"]} 2019-10-23T08:30:32.903 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=bonnie++) => {"ansible_loop_var": "item", "changed": false, "item": "bonnie++", "msg": "", "rc": 0, "results": ["bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed"]} 2019-10-23T08:30:33.266 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=perl-JSON-XS) => {"ansible_loop_var": "item", "changed": false, "item": "perl-JSON-XS", "msg": "", "rc": 0, "results": ["1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-10-23T08:30:33.307 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:03.450) 0:05:18.444 ***** 2019-10-23T08:30:33.333 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-10-23T08:30:33.394 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:00.086) 0:05:18.530 ***** 2019-10-23T08:30:33.424 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-10-23T08:30:33.425 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=perl-JSON-XS) => {"ansible_loop_var": "item", "changed": false, "item": "perl-JSON-XS", "msg": "", "rc": 0, "results": ["1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-10-23T08:30:33.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-10-23T08:30:33.468 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:00.073) 0:05:18.604 ***** 2019-10-23T08:30:33.508 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:00.040) 0:05:18.644 ***** 2019-10-23T08:30:33.535 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-10-23T08:30:33.572 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:00.064) 0:05:18.708 ***** 2019-10-23T08:30:33.601 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-10-23T08:30:33.640 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:00.067) 0:05:18.776 ***** 2019-10-23T08:30:33.936 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-10-23T08:30:33.940 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target dbus.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "shutdown.target iptables.service ipset.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-10-23T08:30:33.942 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-10-23T08:30:33.943 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-10-23T08:30:33.991 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:33 +0000 (0:00:00.351) 0:05:19.127 ***** 2019-10-23T08:30:34.117 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice dbus.service polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service iptables.service shutdown.target ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-10-23T08:30:34.119 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-10-23T08:30:34.120 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-10-23T08:30:34.155 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:34 +0000 (0:00:00.164) 0:05:19.292 ***** 2019-10-23T08:30:34.400 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-10-23T08:30:34.402 INFO:teuthology.task.ansible.out:fatal: [smithi038.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-10-23T08:30:34.442 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:34 +0000 (0:00:00.286) 0:05:19.578 ***** 2019-10-23T08:30:34.579 INFO:teuthology.task.ansible.out:fatal: [smithi062.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-10-23T08:30:34.639 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:34 +0000 (0:00:00.196) 0:05:19.775 ***** 2019-10-23T08:30:35.352 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-10-23T08:30:35.354 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-10-23T08:30:35.410 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.771) 0:05:20.547 ***** 2019-10-23T08:30:35.416 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-10-23T08:30:35.458 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.048) 0:05:20.595 ***** 2019-10-23T08:30:35.464 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-10-23T08:30:35.466 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.505 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.046) 0:05:20.641 ***** 2019-10-23T08:30:35.511 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.550 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.045) 0:05:20.687 ***** 2019-10-23T08:30:35.559 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-10-23T08:30:35.597 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.046) 0:05:20.734 ***** 2019-10-23T08:30:35.645 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.047) 0:05:20.781 ***** 2019-10-23T08:30:35.651 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-10-23T08:30:35.653 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.692 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.046) 0:05:20.829 ***** 2019-10-23T08:30:35.699 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.738 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.046) 0:05:20.875 ***** 2019-10-23T08:30:35.745 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-10-23T08:30:35.746 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.785 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.046) 0:05:20.922 ***** 2019-10-23T08:30:35.792 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.835 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.049) 0:05:20.971 ***** 2019-10-23T08:30:35.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-10-23T08:30:35.841 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.842 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.882 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.047) 0:05:21.019 ***** 2019-10-23T08:30:35.893 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:35.938 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.055) 0:05:21.074 ***** 2019-10-23T08:30:36.062 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 23 October 2019 08:30:35 +0000 (0:00:00.050) 0:05:21.125 ***** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.047) 0:05:21.172 ***** TASK [testnode : Add local apt repos.] ***************************************** 2019-10-23T08:30:36.082 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.046) 0:05:21.218 ***** 2019-10-23T08:30:36.144 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.061) 0:05:21.280 ***** 2019-10-23T08:30:36.153 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-10-23T08:30:36.155 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.193 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.049) 0:05:21.329 ***** 2019-10-23T08:30:36.200 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.240 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.046) 0:05:21.376 ***** 2019-10-23T08:30:36.246 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-10-23T08:30:36.248 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.288 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.048) 0:05:21.424 ***** 2019-10-23T08:30:36.294 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.310 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ ceph_packages_to_remove|list + packages_to_remove|list }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:36.335 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.046) 0:05:21.471 ***** 2019-10-23T08:30:36.358 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ ceph_packages_to_remove|list + packages_to_remove|list }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:36.362 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-10-23T08:30:36.364 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.408 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.073) 0:05:21.545 ***** 2019-10-23T08:30:36.428 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.467 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.058) 0:05:21.603 ***** 2019-10-23T08:30:36.473 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-10-23T08:30:36.516 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.048) 0:05:21.652 ***** 2019-10-23T08:30:36.563 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.046) 0:05:21.699 ***** 2019-10-23T08:30:36.569 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-10-23T08:30:36.609 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.045) 0:05:21.745 ***** 2019-10-23T08:30:36.628 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ packages|list + common_packages|list }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:36.652 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.043) 0:05:21.789 ***** 2019-10-23T08:30:36.675 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ packages|list + common_packages|list }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:36.785 INFO:teuthology.task.ansible.out: 2019-10-23T08:30:36.786 INFO:teuthology.task.ansible.out:TASK [testnode : Install packages] ********************************************* 2019-10-23T08:30:36.788 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.859 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.207) 0:05:21.996 ***** 2019-10-23T08:30:36.871 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:36.915 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.055) 0:05:22.052 ***** 2019-10-23T08:30:36.923 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-10-23T08:30:36.968 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:36 +0000 (0:00:00.052) 0:05:22.105 ***** 2019-10-23T08:30:37.022 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.052) 0:05:22.157 ***** 2019-10-23T08:30:37.026 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-10-23T08:30:37.028 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.066 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.045) 0:05:22.202 ***** 2019-10-23T08:30:37.080 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.126 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.060) 0:05:22.263 ***** 2019-10-23T08:30:37.132 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-10-23T08:30:37.134 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.172 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.045) 0:05:22.308 ***** 2019-10-23T08:30:37.177 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.219 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.045) 0:05:22.353 ***** 2019-10-23T08:30:37.223 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-10-23T08:30:37.224 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.263 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.046) 0:05:22.399 ***** 2019-10-23T08:30:37.268 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.314 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.051) 0:05:22.451 ***** 2019-10-23T08:30:37.320 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-10-23T08:30:37.322 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.365 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.051) 0:05:22.502 ***** 2019-10-23T08:30:37.371 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.414 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.048) 0:05:22.550 ***** 2019-10-23T08:30:37.424 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.465 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.050) 0:05:22.601 ***** 2019-10-23T08:30:37.471 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.514 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.048) 0:05:22.650 ***** 2019-10-23T08:30:37.521 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-10-23T08:30:37.522 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.563 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.048) 0:05:22.699 ***** 2019-10-23T08:30:37.572 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.614 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.050) 0:05:22.750 ***** 2019-10-23T08:30:37.619 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-10-23T08:30:37.636 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.660 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.045) 0:05:22.796 ***** 2019-10-23T08:30:37.672 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.708 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.048) 0:05:22.844 ***** 2019-10-23T08:30:37.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-10-23T08:30:37.715 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.757 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.049) 0:05:22.894 ***** 2019-10-23T08:30:37.763 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.802 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.044) 0:05:22.939 ***** 2019-10-23T08:30:37.812 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.849 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.046) 0:05:22.986 ***** 2019-10-23T08:30:37.855 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.897 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.047) 0:05:23.033 ***** 2019-10-23T08:30:37.905 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-10-23T08:30:37.906 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.942 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.045) 0:05:23.079 ***** 2019-10-23T08:30:37.948 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:37.991 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:37 +0000 (0:00:00.047) 0:05:23.127 ***** 2019-10-23T08:30:37.996 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-10-23T08:30:37.998 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.036 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.046) 0:05:23.173 ***** 2019-10-23T08:30:38.042 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.080 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.043) 0:05:23.217 ***** 2019-10-23T08:30:38.086 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-10-23T08:30:38.087 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.124 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.044) 0:05:23.261 ***** 2019-10-23T08:30:38.132 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.170 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.046) 0:05:23.307 ***** 2019-10-23T08:30:38.176 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-10-23T08:30:38.177 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.215 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.044) 0:05:23.352 ***** 2019-10-23T08:30:38.221 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.236 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "zypper" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ ceph_packages_to_remove }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:38.272 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.048) 0:05:23.400 ***** 2019-10-23T08:30:38.285 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "zypper" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ ceph_packages_to_remove }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:38.291 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-10-23T08:30:38.293 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.333 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.068) 0:05:23.469 ***** 2019-10-23T08:30:38.349 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.356 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "zypper" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ ceph_dependency_packages_to_remove }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:38.413 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.079) 0:05:23.549 ***** 2019-10-23T08:30:38.418 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-10-23T08:30:38.420 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.430 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "zypper" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ ceph_dependency_packages_to_remove }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:38.459 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.045) 0:05:23.595 ***** 2019-10-23T08:30:38.485 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.486 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-10-23T08:30:38.535 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.076) 0:05:23.672 ***** 2019-10-23T08:30:38.574 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.039) 0:05:23.711 ***** 2019-10-23T08:30:38.613 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "zypper" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ packages }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:38.622 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.048) 0:05:23.759 ***** 2019-10-23T08:30:38.645 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "zypper" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ packages }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:38.782 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-10-23T08:30:38.783 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.831 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.208) 0:05:23.968 ***** 2019-10-23T08:30:38.838 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:38.878 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.046) 0:05:24.014 ***** 2019-10-23T08:30:38.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-10-23T08:30:38.924 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.046) 0:05:24.061 ***** 2019-10-23T08:30:38.970 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:38 +0000 (0:00:00.046) 0:05:24.107 ***** 2019-10-23T08:30:38.977 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-10-23T08:30:38.979 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:39.017 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:39 +0000 (0:00:00.046) 0:05:24.154 ***** 2019-10-23T08:30:39.024 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:39.064 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:39 +0000 (0:00:00.047) 0:05:24.201 ***** 2019-10-23T08:30:39.356 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-10-23T08:30:39.356 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-10-23T08:30:39.393 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:39 +0000 (0:00:00.329) 0:05:24.530 ***** 2019-10-23T08:30:39.400 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-10-23T08:30:39.439 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:39 +0000 (0:00:00.045) 0:05:24.575 ***** 2019-10-23T08:30:39.770 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-10-23T08:30:39.771 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-10-23T08:30:39.810 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:39 +0000 (0:00:00.371) 0:05:24.947 ***** 2019-10-23T08:30:39.883 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-10-23T08:30:39.922 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:39 +0000 (0:00:00.110) 0:05:25.058 ***** 2019-10-23T08:30:40.161 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-10-23T08:30:40.163 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-10-23T08:30:40.204 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.282) 0:05:25.340 ***** 2019-10-23T08:30:40.234 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-10-23T08:30:40.235 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.285 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.080) 0:05:25.421 ***** 2019-10-23T08:30:40.318 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-10-23T08:30:40.319 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.369 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.083) 0:05:25.505 ***** 2019-10-23T08:30:40.386 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-10-23T08:30:40.387 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-10-23T08:30:40.432 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.063) 0:05:25.568 ***** 2019-10-23T08:30:40.438 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-10-23T08:30:40.440 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.482 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.049) 0:05:25.618 ***** 2019-10-23T08:30:40.488 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-10-23T08:30:40.490 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.532 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.050) 0:05:25.669 ***** 2019-10-23T08:30:40.538 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-10-23T08:30:40.540 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.581 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.048) 0:05:25.717 ***** 2019-10-23T08:30:40.586 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-10-23T08:30:40.589 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.626 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.045) 0:05:25.762 ***** 2019-10-23T08:30:40.634 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-10-23T08:30:40.635 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.671 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.044) 0:05:25.807 ***** 2019-10-23T08:30:40.677 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-10-23T08:30:40.679 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.718 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.047) 0:05:25.854 ***** 2019-10-23T08:30:40.723 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-10-23T08:30:40.726 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.762 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.044) 0:05:25.899 ***** 2019-10-23T08:30:40.769 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-10-23T08:30:40.771 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.807 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.044) 0:05:25.944 ***** 2019-10-23T08:30:40.813 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-10-23T08:30:40.815 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.852 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.043) 0:05:25.988 ***** 2019-10-23T08:30:40.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-10-23T08:30:40.861 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.896 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.044) 0:05:26.033 ***** 2019-10-23T08:30:40.903 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.941 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.044) 0:05:26.078 ***** 2019-10-23T08:30:40.947 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-10-23T08:30:40.949 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:40.986 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:40 +0000 (0:00:00.044) 0:05:26.123 ***** 2019-10-23T08:30:40.994 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.032 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.046) 0:05:26.169 ***** 2019-10-23T08:30:41.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-10-23T08:30:41.039 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.081 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.048) 0:05:26.217 ***** 2019-10-23T08:30:41.086 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-10-23T08:30:41.087 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.135 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.053) 0:05:26.271 ***** 2019-10-23T08:30:41.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-10-23T08:30:41.143 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.183 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.048) 0:05:26.320 ***** 2019-10-23T08:30:41.189 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-10-23T08:30:41.192 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.231 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.046) 0:05:26.366 ***** 2019-10-23T08:30:41.237 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-10-23T08:30:41.238 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.276 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.046) 0:05:26.412 ***** 2019-10-23T08:30:41.281 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-10-23T08:30:41.282 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.327 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.050) 0:05:26.463 ***** 2019-10-23T08:30:41.333 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-10-23T08:30:41.335 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.372 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.044) 0:05:26.508 ***** 2019-10-23T08:30:41.377 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-10-23T08:30:41.379 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.418 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.045) 0:05:26.554 ***** 2019-10-23T08:30:41.426 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-10-23T08:30:41.428 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.467 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.048) 0:05:26.603 ***** 2019-10-23T08:30:41.472 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-10-23T08:30:41.473 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.511 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.044) 0:05:26.648 ***** 2019-10-23T08:30:41.518 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-10-23T08:30:41.520 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.557 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.046) 0:05:26.694 ***** 2019-10-23T08:30:41.563 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-10-23T08:30:41.564 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.601 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.043) 0:05:26.738 ***** 2019-10-23T08:30:41.607 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-10-23T08:30:41.608 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.646 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.044) 0:05:26.782 ***** 2019-10-23T08:30:41.654 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-10-23T08:30:41.655 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.691 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.045) 0:05:26.828 ***** 2019-10-23T08:30:41.697 INFO:teuthology.task.ansible.out: 2019-10-23T08:30:41.699 INFO:teuthology.task.ansible.out:TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.737 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.045) 0:05:26.873 ***** 2019-10-23T08:30:41.742 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-10-23T08:30:41.743 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.781 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.044) 0:05:26.918 ***** 2019-10-23T08:30:41.788 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-10-23T08:30:41.788 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.827 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.045) 0:05:26.963 ***** 2019-10-23T08:30:41.833 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.871 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.044) 0:05:27.007 ***** 2019-10-23T08:30:41.879 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-10-23T08:30:41.880 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.928 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.056) 0:05:27.064 ***** 2019-10-23T08:30:41.934 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-10-23T08:30:41.934 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:41.974 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:41 +0000 (0:00:00.046) 0:05:27.111 ***** 2019-10-23T08:30:41.981 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.021 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.046) 0:05:27.158 ***** 2019-10-23T08:30:42.027 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-10-23T08:30:42.028 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.068 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.047) 0:05:27.205 ***** 2019-10-23T08:30:42.074 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-10-23T08:30:42.075 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.114 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.045) 0:05:27.250 ***** 2019-10-23T08:30:42.119 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-10-23T08:30:42.121 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.158 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.044) 0:05:27.295 ***** 2019-10-23T08:30:42.164 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-10-23T08:30:42.164 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.202 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.043) 0:05:27.339 ***** 2019-10-23T08:30:42.208 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.251 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.049) 0:05:27.388 ***** 2019-10-23T08:30:42.257 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-10-23T08:30:42.258 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.306 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.054) 0:05:27.442 ***** 2019-10-23T08:30:42.311 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:30:42.312 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-10-23T08:30:42.350 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.044) 0:05:27.487 ***** 2019-10-23T08:30:42.359 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-10-23T08:30:42.360 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.396 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.045) 0:05:27.532 ***** 2019-10-23T08:30:42.402 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-10-23T08:30:42.403 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.405 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-10-23T08:30:42.417 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.427 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-10-23T08:30:42.428 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi038.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.464 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.068) 0:05:27.601 ***** 2019-10-23T08:30:42.470 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.471 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.479 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.528 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.063) 0:05:27.664 ***** 2019-10-23T08:30:42.535 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:30:42.535 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-10-23T08:30:42.574 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.046) 0:05:27.711 ***** 2019-10-23T08:30:42.622 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-10-23T08:30:42.623 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.633 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-10-23T08:30:42.634 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.648 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.666 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.688 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.688 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.690 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-10-23T08:30:42.692 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003658", "end": "2019-10-23 08:30:42.669443", "rc": 0, "start": "2019-10-23 08:30:42.665785", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-10-23T08:30:42.736 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.161) 0:05:27.873 ***** 2019-10-23T08:30:42.777 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.040) 0:05:27.913 ***** 2019-10-23T08:30:42.781 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-10-23T08:30:42.782 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.824 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.047) 0:05:27.960 ***** 2019-10-23T08:30:42.862 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-10-23T08:30:42.864 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.905 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.081) 0:05:28.042 ***** 2019-10-23T08:30:42.933 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-10-23T08:30:42.934 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003916", "end": "2019-10-23 08:30:42.907207", "rc": 0, "start": "2019-10-23 08:30:42.903291", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-10-23T08:30:42.936 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:42.984 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:42 +0000 (0:00:00.078) 0:05:28.121 ***** 2019-10-23T08:30:43.000 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: ['gdisk', 'dmsetup']` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:43.051 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:43 +0000 (0:00:00.066) 0:05:28.187 ***** 2019-10-23T08:30:43.056 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-10-23T08:30:43.057 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:43.097 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:43 +0000 (0:00:00.046) 0:05:28.234 ***** 2019-10-23T08:30:43.103 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-10-23T08:30:43.104 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:43.147 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:43 +0000 (0:00:00.049) 0:05:28.283 ***** 2019-10-23T08:30:43.182 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-10-23T08:30:43.184 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:43.220 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:43 +0000 (0:00:00.073) 0:05:28.357 ***** 2019-10-23T08:30:43.245 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-10-23T08:30:43.247 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:43.284 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:43 +0000 (0:00:00.063) 0:05:28.420 ***** 2019-10-23T08:30:43.301 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: ['gdisk', 'dmsetup']` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:30:43.320 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-10-23T08:30:43.321 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=[]) => {"ansible_loop_var": "item", "changed": false, "item": [], "skip_reason": "Conditional result was False"} 2019-10-23T08:30:43.360 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:43 +0000 (0:00:00.076) 0:05:28.497 ***** 2019-10-23T08:30:43.582 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-10-23T08:30:43.584 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=gdisk) => {"ansible_loop_var": "item", "changed": false, "item": "gdisk", "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed"]} 2019-10-23T08:30:43.858 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=gdisk) => {"ansible_loop_var": "item", "changed": false, "item": "gdisk", "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed"]} 2019-10-23T08:30:44.051 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=device-mapper) => {"ansible_loop_var": "item", "changed": false, "item": "device-mapper", "msg": "", "rc": 0, "results": ["7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-10-23T08:30:44.091 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.730) 0:05:29.228 ***** 2019-10-23T08:30:44.131 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-10-23T08:30:44.132 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item={u'block_used': 13000894, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227323590, u'size_available': 931117424640, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60967567, u'device': u'/dev/sda1', u'inode_used': 87409, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227323590, "block_size": 4096, "block_total": 240324484, "block_used": 13000894, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967567, "inode_total": 61054976, "inode_used": 87409, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117424640, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}} 2019-10-23T08:30:44.172 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.081) 0:05:29.309 ***** 2019-10-23T08:30:44.309 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-10-23T08:30:44.312 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=device-mapper) => {"ansible_loop_var": "item", "changed": false, "item": "device-mapper", "msg": "", "rc": 0, "results": ["7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-10-23T08:30:44.352 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.179) 0:05:29.488 ***** 2019-10-23T08:30:44.402 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-10-23T08:30:44.403 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item={u'block_used': 13000890, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227323594, u'size_available': 931117441024, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60967571, u'device': u'/dev/sda1', u'inode_used': 87405, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227323594, "block_size": 4096, "block_total": 240324484, "block_used": 13000890, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967571, "inode_total": 61054976, "inode_used": 87405, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117441024, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}} 2019-10-23T08:30:44.460 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.108) 0:05:29.597 ***** 2019-10-23T08:30:44.499 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-10-23T08:30:44.501 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011775", "end": "2019-10-23 08:30:44.472454", "rc": 0, "start": "2019-10-23 08:30:44.460679", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:44.539 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.078) 0:05:29.676 ***** 2019-10-23T08:30:44.579 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi038.front.sepia.ceph.com] => (item={u'block_used': 13000894, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227323590, u'size_available': 931117424640, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60967567, u'device': u'/dev/sda1', u'inode_used': 87409, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227323590, "block_size": 4096, "block_total": 240324484, "block_used": 13000894, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967567, "inode_total": 61054976, "inode_used": 87409, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117424640, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:44.620 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.081) 0:05:29.757 ***** 2019-10-23T08:30:44.648 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-10-23T08:30:44.687 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.066) 0:05:29.824 ***** 2019-10-23T08:30:44.725 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-10-23T08:30:44.727 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J33D', u'wwn-0x5000c500871b5cd5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J33D', u'wwn': u'0x5000c500871b5cd5', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J33D-part1', u'wwn-0x5000c500871b5cd5-part1'], u'uuids': [u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J33D", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-10-23T08:30:44.730 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871b5cd5"}}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:44.822 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-10-23T08:30:44.823 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.014216", "end": "2019-10-23 08:30:44.783889", "rc": 0, "start": "2019-10-23 08:30:44.769673", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:44.863 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.176) 0:05:30.000 ***** 2019-10-23T08:30:44.914 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-10-23T08:30:44.915 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={u'block_used': 13000890, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227323594, u'size_available': 931117441024, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60967571, u'device': u'/dev/sda1', u'inode_used': 87405, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227323594, "block_size": 4096, "block_total": 240324484, "block_used": 13000890, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967571, "inode_total": 61054976, "inode_used": 87405, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117441024, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:44.964 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:44 +0000 (0:00:00.100) 0:05:30.100 ***** 2019-10-23T08:30:44.992 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-10-23T08:30:45.031 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:45 +0000 (0:00:00.066) 0:05:30.167 ***** 2019-10-23T08:30:45.078 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-10-23T08:30:45.080 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV', u'wwn-0x5000c50087b99812'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4W5SV', u'wwn': u'0x5000c50087b99812', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', u'wwn-0x5000c50087b99812-part1'], u'uuids': [u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-10-23T08:30:45.081 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:46.281 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0', u'nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN', u'nvme-eui.0100000001000000e4d25c000034df14'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', u'support_discard': u'512', u'model': u'INTEL SSDPEDKE040T7', u'size': u'3.64 TB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'7814037168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.231520", "end": "2019-10-23 08:30:46.247213", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:45.015693", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk us 2019-10-23T08:30:46.283 INFO:teuthology.task.ansible.out:ing fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:46.776 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd', u'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', u'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.358627", "end": "2019-10-23 08:30:46.733400", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:45.374773", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-10-23T08:30:46.778 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:47.691 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs'], u'uuids': [u'd0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.066045", "end": "2019-10-23 08:30:47.650313", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs"], "labels": [], "masters": [], "uuids": ["d0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:46.584268", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:48.123 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr'], u'uuids': [u'13cadbc7-0d9d-408e-9a4a-848b6a087cfc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.043624", "end": "2019-10-23 08:30:48.091568", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr"], "labels": [], "masters": [], "uuids": ["13cadbc7-0d9d-408e-9a4a-848b6a087cfc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:47.047944", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:49.085 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML'], u'uuids': [u'fb710487-4043-45d5-8d67-9c19438f9404']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.059443", "end": "2019-10-23 08:30:49.042301", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML"], "labels": [], "masters": [], "uuids": ["fb710487-4043-45d5-8d67-9c19438f9404"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:47.982858", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:49.485 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIrl'], u'uuids': [u'628f887b-3b78-46d8-bb4d-9a0064b6af15']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052757", "end": "2019-10-23 08:30:49.450261", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIrl"], "labels": [], "masters": [], "uuids": ["628f887b-3b78-46d8-bb4d-9a0064b6af15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:48.397504", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:50.447 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM'], u'uuids': [u'626003b6-1741-4127-a420-61310d26acbe']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.056007", "end": "2019-10-23 08:30:50.409705", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM"], "labels": [], "masters": [], "uuids": ["626003b6-1741-4127-a420-61310d26acbe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:49.353698", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:50.857 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4'], u'uuids': [u'54cd6336-eb15-4664-bfdd-39f164a54798']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.061099", "end": "2019-10-23 08:30:50.825466", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4"], "labels": [], "masters": [], "uuids": ["54cd6336-eb15-4664-bfdd-39f164a54798"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:49.764367", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:51.816 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa'], u'uuids': [u'16c78bcb-656e-4175-9aba-b8bbee9a11d1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.054405", "end": "2019-10-23 08:30:51.776542", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa"], "labels": [], "masters": [], "uuids": ["16c78bcb-656e-4175-9aba-b8bbee9a11d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:50.722137", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:52.205 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp'], u'uuids': [u'd3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.045841", "end": "2019-10-23 08:30:52.176047", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp"], "labels": [], "masters": [], "uuids": ["d3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:51.130206", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:53.187 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy'], u'uuids': [u'bf102730-4a2c-442a-8fd0-fb53f015abb1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.051325", "end": "2019-10-23 08:30:53.151690", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy"], "labels": [], "masters": [], "uuids": ["bf102730-4a2c-442a-8fd0-fb53f015abb1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:52.100365", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:53.253 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:53 +0000 (0:00:08.222) 0:05:38.390 ***** 2019-10-23T08:30:53.320 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-10-23T08:30:53.322 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J33D', u'wwn-0x5000c500871b5cd5'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J33D', u'wwn': u'0x5000c500871b5cd5', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J33D-part1', u'wwn-0x5000c500871b5cd5-part1'], u'uuids': [u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D", "wwn-0x5000c500871b5cd5"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J33D-part1", "wwn-0x5000c500871b5cd5-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J33D", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-10-23T08:30:53.324 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871b5cd5"}}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:53.571 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-10-23T08:30:53.572 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1'], u'uuids': [u'9d94d61b-6ff2-4df6-a5d7-dde722533a1e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.057998", "end": "2019-10-23 08:30:53.535339", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1"], "labels": [], "masters": [], "uuids": ["9d94d61b-6ff2-4df6-a5d7-dde722533a1e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:52.477341", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-10-23T08:30:53.626 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:53 +0000 (0:00:00.372) 0:05:38.762 ***** 2019-10-23T08:30:53.692 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-10-23T08:30:53.694 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV', u'wwn-0x5000c50087b99812'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4W5SV', u'wwn': u'0x5000c50087b99812', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1', u'wwn-0x5000c50087b99812-part1'], u'uuids': [u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV", "wwn-0x5000c50087b99812"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W5SV-part1", "wwn-0x5000c50087b99812-part1"], "labels": [], "masters": [], "uuids": ["18c84fd2-0dad-4c7c-9f93-a357a32b72bb"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W5SV", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-10-23T08:30:53.696 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50087b99812"}}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:53.708 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0', u'nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN', u'nvme-eui.0100000001000000e4d25c000034df14'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]', u'support_discard': u'512', u'model': u'INTEL SSDPEDKE040T7', u'size': u'3.64 TB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'7814037168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.085724", "end": "2019-10-23 08:30:53.670426", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [3DNAND, Beta Rock Controller]", "links": {"ids": ["lvm-pv-uuid-yCGBnY-7dCG-r7Fq-2POI-IIix-WnBj-ZrbJn0", "nvme-INTEL_SSDPEDKE040T7_BTLE736103BB4P0KGN", "nvme-eui.0100000001000000e4d25c000034df14"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDKE040T7", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "7814037168", "sectorsize": "512", "size": "3.64 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:53.584702", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0788678 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 re 2019-10-23T08:30:53.710 INFO:teuthology.task.ansible.out:cords out", "115343360 bytes (115 MB) copied, 0.0788678 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:54.092 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd', u'nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN', u'nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.086967", "end": "2019-10-23 08:30:54.052470", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HhaziP-sJ37-19q2-pEMS-EfB0-sWrr-Rh9Lqd", "nvme-INTEL_SSDPEDMD400G4_CVFT53440094400BGN", "nvme-nvme.8086-43564654353334343030393434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:53.965503", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-10-23T08:30:54.094 INFO:teuthology.task.ansible.out:pied, 0.0799515 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0799515 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:54.177 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs'], u'uuids': [u'd0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.180029", "end": "2019-10-23 08:30:54.139711", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QIOT4svLPLSRMvSFx3AclBlGo4hpqd2Qs"], "labels": [], "masters": [], "uuids": ["d0f6b2dd-fcb2-4c76-a99c-2f39adb6fcc8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:53.959682", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.173846 s, 663 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.173846 s, 663 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:54.576 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr'], u'uuids': [u'13cadbc7-0d9d-408e-9a4a-848b6a087cfc']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.186189", "end": "2019-10-23 08:30:54.548766", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ftV1y5acEfK32YTczzCJdXMzSQuD1AmZr"], "labels": [], "masters": [], "uuids": ["13cadbc7-0d9d-408e-9a4a-848b6a087cfc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:54.362577", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.18014 s, 640 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.18014 s, 640 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:54.672 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML'], u'uuids': [u'fb710487-4043-45d5-8d67-9c19438f9404']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.212101", "end": "2019-10-23 08:30:54.633548", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QG9aqv1T6IW5x2JS46DpSi0zCgbfsrmML"], "labels": [], "masters": [], "uuids": ["fb710487-4043-45d5-8d67-9c19438f9404"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:54.421447", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.205742 s, 561 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.205742 s, 561 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:55.090 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIrl'], u'uuids': [u'628f887b-3b78-46d8-bb4d-9a0064b6af15']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.203909", "end": "2019-10-23 08:30:55.060429", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4foztdVLnJO5qlNbE0iJx8DIFqJDsxcIrl"], "labels": [], "masters": [], "uuids": ["628f887b-3b78-46d8-bb4d-9a0064b6af15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:54.856520", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.197027 s, 585 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.197027 s, 585 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:55.196 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM'], u'uuids': [u'626003b6-1741-4127-a420-61310d26acbe']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.218460", "end": "2019-10-23 08:30:55.157756", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKehanntHqzUtthpmY2sEIFOoSGLcMysM"], "labels": [], "masters": [], "uuids": ["626003b6-1741-4127-a420-61310d26acbe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:54.939296", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.211918 s, 544 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.211918 s, 544 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:55.626 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4'], u'uuids': [u'54cd6336-eb15-4664-bfdd-39f164a54798']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.195215", "end": "2019-10-23 08:30:55.594407", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4ffeHYEHX6l1Ow0eEpFkjN01d8gOq37Rj4"], "labels": [], "masters": [], "uuids": ["54cd6336-eb15-4664-bfdd-39f164a54798"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:55.399192", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.18896 s, 610 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.18896 s, 610 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:55.669 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa'], u'uuids': [u'16c78bcb-656e-4175-9aba-b8bbee9a11d1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.165760", "end": "2019-10-23 08:30:55.638640", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QRZc30Thg0k3DWbqLbfMkW0udJkbqtCBa"], "labels": [], "masters": [], "uuids": ["16c78bcb-656e-4175-9aba-b8bbee 2019-10-23T08:30:55.671 INFO:teuthology.task.ansible.out:9a11d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:55.472880", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.159768 s, 722 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.159768 s, 722 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:56.110 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp'], u'uuids': [u'd3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.183642", "end": "2019-10-23 08:30:56.079534", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fhuNiFfDQ5ddyos8ES64mcqDvKoHnhdKp"], "labels": [], "masters": [], "uuids": ["d3d5cdbe-7139-4e8b-b7f4-8a2ea84a429b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:55.895892", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.177334 s, 650 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.177334 s, 650 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:56.152 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy'], u'uuids': [u'bf102730-4a2c-442a-8fd0-fb53f015abb1']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162602", "end": "2019-10-23 08:30:56.105522", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wxcXLE37e5OewfUuI0uM9KgG3eR0Ap5QKxfDrVm0QAJhxaAumyqfmWoy7KK94Aoy"], "labels": [], "masters": [], "uuids": ["bf102730-4a2c-442a-8fd0-fb53f015abb1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:55.942920", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.156439 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.156439 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:56.188 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:56 +0000 (0:00:02.562) 0:05:41.324 ***** 2019-10-23T08:30:56.595 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-10-23T08:30:56.597 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.081959", "end": "2019-10-23 08:30:56.553860", "rc": 0, "start": "2019-10-23 08:30:56.471901", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:56.647 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:56 +0000 (0:00:00.458) 0:05:41.783 ***** 2019-10-23T08:30:56.655 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-10-23T08:30:56.657 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1'], u'uuids': [u'9d94d61b-6ff2-4df6-a5d7-dde722533a1e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.199512", "end": "2019-10-23 08:30:56.586574", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4M5k6LueTKuLGGiCVeeGwFl1W0nnlQ4fe92pZF4f28vjyAo5Fv9X4nWQIOf0kJJ1"], "labels": [], "masters": [], "uuids": ["9d94d61b-6ff2-4df6-a5d7-dde722533a1e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-10-23 08:30:56.387062", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.192689 s, 599 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.192689 s, 599 MB/s"], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:56.707 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:56 +0000 (0:00:00.060) 0:05:41.844 ***** 2019-10-23T08:30:57.028 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-10-23T08:30:57.030 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048586", "end": "2019-10-23 08:30:56.997870", "rc": 0, "start": "2019-10-23 08:30:56.949284", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:57.076 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.368) 0:05:42.212 ***** 2019-10-23T08:30:57.108 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-10-23T08:30:57.162 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.086) 0:05:42.298 ***** 2019-10-23T08:30:57.172 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-10-23T08:30:57.173 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.087626", "end": "2019-10-23 08:30:57.098945", "rc": 0, "start": "2019-10-23 08:30:57.011319", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:57.216 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.053) 0:05:42.352 ***** 2019-10-23T08:30:57.221 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-10-23T08:30:57.222 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.274 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.058) 0:05:42.410 ***** 2019-10-23T08:30:57.312 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-10-23T08:30:57.314 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.358 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.084) 0:05:42.495 ***** 2019-10-23T08:30:57.387 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-10-23T08:30:57.388 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.434 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.074) 0:05:42.570 ***** 2019-10-23T08:30:57.484 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-10-23T08:30:57.486 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.533 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.098) 0:05:42.668 ***** 2019-10-23T08:30:57.613 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-10-23T08:30:57.615 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.061500", "end": "2019-10-23 08:30:57.582360", "rc": 0, "start": "2019-10-23 08:30:57.520860", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:30:57.662 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.129) 0:05:42.798 ***** 2019-10-23T08:30:57.692 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-10-23T08:30:57.746 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.084) 0:05:42.883 ***** 2019-10-23T08:30:57.788 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-10-23T08:30:57.792 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.834 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.087) 0:05:42.970 ***** 2019-10-23T08:30:57.862 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.863 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-10-23T08:30:57.865 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:30:57.904 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.070) 0:05:43.040 ***** 2019-10-23T08:30:57.942 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.036) 0:05:43.077 ***** 2019-10-23T08:30:57.958 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-10-23T08:30:57.960 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={u'block_used': 13000894, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227323590, u'size_available': 931117424640, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60967567, u'device': u'/dev/sda1', u'inode_used': 87409, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227323590, "block_size": 4096, "block_total": 240324484, "block_used": 13000894, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967567, "inode_total": 61054976, "inode_used": 87409, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117424640, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:57.999 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:57 +0000 (0:00:00.058) 0:05:43.136 ***** 2019-10-23T08:30:58.006 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-10-23T08:30:58.007 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.047 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.047) 0:05:43.183 ***** 2019-10-23T08:30:58.053 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-10-23T08:30:58.055 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.108 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.052) 0:05:43.236 ***** TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.153 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.053) 0:05:43.290 ***** 2019-10-23T08:30:58.160 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:30:58.162 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.201 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.047) 0:05:43.338 ***** 2019-10-23T08:30:58.238 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:30:58.240 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.282 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.080) 0:05:43.418 ***** 2019-10-23T08:30:58.319 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-10-23T08:30:58.321 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.358 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.076) 0:05:43.494 ***** 2019-10-23T08:30:58.384 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-10-23T08:30:58.386 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.423 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.065) 0:05:43.560 ***** 2019-10-23T08:30:58.449 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-10-23T08:30:58.451 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.488 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.064) 0:05:43.624 ***** 2019-10-23T08:30:58.495 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-10-23T08:30:58.496 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-10-23T08:30:58.535 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.046) 0:05:43.671 ***** 2019-10-23T08:30:58.583 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi062.front.sepia.ceph.com] => (item={u'block_used': 13000890, u'uuid': u'18c84fd2-0dad-4c7c-9f93-a357a32b72bb', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227323594, u'size_available': 931117441024, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60967571, u'device': u'/dev/sda1', u'inode_used': 87405, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227323594, "block_size": 4096, "block_total": 240324484, "block_used": 13000890, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60967571, "inode_total": 61054976, "inode_used": 87405, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 931117441024, "size_total": 984369086464, "uuid": "18c84fd2-0dad-4c7c-9f93-a357a32b72bb"}, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.624 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.089) 0:05:43.761 ***** 2019-10-23T08:30:58.657 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-10-23T08:30:58.659 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.717 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.092) 0:05:43.853 ***** 2019-10-23T08:30:58.758 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:30:58.760 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.798 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.080) 0:05:43.934 ***** 2019-10-23T08:30:58.834 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-10-23T08:30:58.836 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.873 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.075) 0:05:44.009 ***** 2019-10-23T08:30:58.899 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:58.941 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:58 +0000 (0:00:00.068) 0:05:44.078 ***** 2019-10-23T08:30:58.969 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-10-23T08:30:58.970 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:59.013 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:59 +0000 (0:00:00.071) 0:05:44.150 ***** 2019-10-23T08:30:59.040 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-10-23T08:30:59.041 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:30:59.084 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:59 +0000 (0:00:00.069) 0:05:44.220 ***** 2019-10-23T08:30:59.322 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-10-23T08:30:59.324 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}, "warnings": ["The value 4 (type int) in a string field was converted to u'4' (type string). If this does not look like what you expect, quote the entire value to ensure it does not change."]} [WARNING]: The value 4 (type int) in a string field was converted to u'4' (type string). If this does not look like what you expect, quote the entire value to ensure it does not change. 2019-10-23T08:30:59.367 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:59 +0000 (0:00:00.283) 0:05:44.504 ***** 2019-10-23T08:30:59.655 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}, "warnings": ["The value 4 (type int) in a string field was converted to u'4' (type string). If this does not look like what you expect, quote the entire value to ensure it does not change."]} 2019-10-23T08:30:59.722 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:30:59 +0000 (0:00:00.354) 0:05:44.859 ***** 2019-10-23T08:31:00.143 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-10-23T08:31:00.145 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:00.238 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:00.645 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:00.728 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:01.123 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:01.207 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:01.627 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:01.682 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:02.118 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:02.168 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:02 +0000 (0:00:02.441) 0:05:47.300 ***** 2019-10-23T08:31:02.183 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-10-23T08:31:02.235 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:02 +0000 (0:00:00.071) 0:05:47.371 ***** 2019-10-23T08:31:02.511 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-10-23T08:31:02.512 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-10-23T08:31:02.552 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:02 +0000 (0:00:00.316) 0:05:47.688 ***** 2019-10-23T08:31:02.584 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-10-23T08:31:02.632 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:02 +0000 (0:00:00.080) 0:05:47.768 ***** 2019-10-23T08:31:02.640 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** skipping: [smithi038.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:02.680 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:02.917 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.008 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.234 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.325 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.550 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.680 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.845 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:03.887 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:03 +0000 (0:00:01.254) 0:05:49.023 ***** 2019-10-23T08:31:04.023 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-10-23T08:31:04.070 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:04 +0000 (0:00:00.180) 0:05:49.204 ***** 2019-10-23T08:31:04.237 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-10-23T08:31:04.238 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-10-23T08:31:04.279 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:04 +0000 (0:00:00.211) 0:05:49.416 ***** 2019-10-23T08:31:04.316 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-10-23T08:31:04.318 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-10-23T08:31:04.360 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:04 +0000 (0:00:00.080) 0:05:49.496 ***** 2019-10-23T08:31:04.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-10-23T08:31:04.420 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-10-23T08:31:04.489 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:04 +0000 (0:00:00.128) 0:05:49.625 ***** 2019-10-23T08:31:04.530 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-10-23T08:31:04.532 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-10-23T08:31:04.574 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:04 +0000 (0:00:00.084) 0:05:49.710 ***** 2019-10-23T08:31:05.059 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-10-23T08:31:05.061 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true} 2019-10-23T08:31:05.112 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:05 +0000 (0:00:00.538) 0:05:50.249 ***** 2019-10-23T08:31:05.280 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true} 2019-10-23T08:31:05.319 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:05 +0000 (0:00:00.206) 0:05:50.456 ***** 2019-10-23T08:31:05.826 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-10-23T08:31:05.827 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-10-23T08:31:05.867 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:05 +0000 (0:00:00.548) 0:05:51.004 ***** 2019-10-23T08:31:05.876 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-10-23T08:31:05.913 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:05 +0000 (0:00:00.045) 0:05:51.050 ***** 2019-10-23T08:31:05.928 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:05.959 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:05 +0000 (0:00:00.045) 0:05:51.096 ***** 2019-10-23T08:31:05.971 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.007 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.048) 0:05:51.144 ***** 2019-10-23T08:31:06.014 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-10-23T08:31:06.015 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.053 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.045) 0:05:51.189 ***** 2019-10-23T08:31:06.059 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.100 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.046) 0:05:51.236 ***** 2019-10-23T08:31:06.106 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-10-23T08:31:06.108 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.145 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.045) 0:05:51.282 ***** 2019-10-23T08:31:06.151 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.191 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.046) 0:05:51.328 ***** 2019-10-23T08:31:06.197 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-10-23T08:31:06.199 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.237 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.045) 0:05:51.373 ***** 2019-10-23T08:31:06.243 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.290 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.052) 0:05:51.426 ***** 2019-10-23T08:31:06.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-10-23T08:31:06.300 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.339 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.049) 0:05:51.476 ***** 2019-10-23T08:31:06.346 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.393 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.053) 0:05:51.529 ***** 2019-10-23T08:31:06.399 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-10-23T08:31:06.400 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.438 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.045) 0:05:51.575 ***** 2019-10-23T08:31:06.445 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.484 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.045) 0:05:51.621 ***** 2019-10-23T08:31:06.490 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-10-23T08:31:06.492 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.531 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.046) 0:05:51.668 ***** 2019-10-23T08:31:06.540 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:06.578 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:06 +0000 (0:00:00.046) 0:05:51.714 ***** 2019-10-23T08:31:07.024 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-10-23T08:31:07.025 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-10-23T08:31:07.070 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:07 +0000 (0:00:00.492) 0:05:52.206 ***** 2019-10-23T08:31:07.087 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-10-23T08:31:07.128 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:07 +0000 (0:00:00.058) 0:05:52.265 ***** 2019-10-23T08:31:07.134 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-10-23T08:31:07.135 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:07.174 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:07 +0000 (0:00:00.045) 0:05:52.310 ***** 2019-10-23T08:31:07.181 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:07.222 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:07 +0000 (0:00:00.048) 0:05:52.359 ***** 2019-10-23T08:31:07.235 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:07.269 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:07 +0000 (0:00:00.047) 0:05:52.406 ***** 2019-10-23T08:31:07.276 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:07.317 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:07 +0000 (0:00:00.047) 0:05:52.453 ***** 2019-10-23T08:31:08.203 INFO:teuthology.task.ansible.out: 2019-10-23T08:31:08.204 INFO:teuthology.task.ansible.out:TASK [testnode : Create the ntp.conf file.] ************************************ 2019-10-23T08:31:08.206 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-10-23T08:31:08.258 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:08 +0000 (0:00:00.940) 0:05:53.394 ***** 2019-10-23T08:31:08.294 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-10-23T08:31:08.340 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:08 +0000 (0:00:00.075) 0:05:53.470 ***** 2019-10-23T08:31:08.381 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:08 +0000 (0:00:00.047) 0:05:53.518 ***** 2019-10-23T08:31:08.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-10-23T08:31:08.421 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:08.457 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:08 +0000 (0:00:00.075) 0:05:53.594 ***** 2019-10-23T08:31:08.870 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sntp.service syslog.target basic.target -.mount system.slice ntpdate.service systemd-journald.socket tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": " 2019-10-23T08:31:08.872 INFO:teuthology.task.ansible.out:0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551 2019-10-23T08:31:08.873 INFO:teuthology.task.ansible.out:615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-10-23T08:31:08.920 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:08 +0000 (0:00:00.463) 0:05:54.057 ***** 2019-10-23T08:31:08.987 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "tmp.mount syslog.target ntpdate.service systemd-journald.socket system.slice -.mount sntp.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-10-23T08:31:08.989 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-10-23T08:31:08.991 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-10-23T08:31:09.043 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:09 +0000 (0:00:00.122) 0:05:54.180 ***** 2019-10-23T08:31:09.751 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-10-23T08:31:09.752 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-9.el7.noarch providing python-pip is already installed"]} 2019-10-23T08:31:09.795 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:09 +0000 (0:00:00.751) 0:05:54.932 ***** 2019-10-23T08:31:09.834 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-10-23T08:31:09.836 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-9.el7.noarch providing python-pip is already installed"]} 2019-10-23T08:31:09.875 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:09 +0000 (0:00:00.080) 0:05:55.012 ***** 2019-10-23T08:31:09.913 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:09 +0000 (0:00:00.037) 0:05:55.049 ***** 2019-10-23T08:31:09.951 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-10-23T08:31:09.953 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:10.006 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:10 +0000 (0:00:00.093) 0:05:55.143 ***** 2019-10-23T08:31:10.224 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-10-23T08:31:10.226 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-10-23T08:31:10.275 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:10 +0000 (0:00:00.268) 0:05:55.412 ***** 2019-10-23T08:31:10.367 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-10-23T08:31:10.409 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:10 +0000 (0:00:00.134) 0:05:55.546 ***** 2019-10-23T08:31:11.252 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-10-23T08:31:11.254 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-10-23T08:31:11.292 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:11 +0000 (0:00:00.882) 0:05:56.428 ***** 2019-10-23T08:31:11.313 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "pip" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ pip_packages_to_install }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:31:11.341 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-10-23T08:31:11.380 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:11 +0000 (0:00:00.088) 0:05:56.516 ***** 2019-10-23T08:31:11.401 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Invoking "pip" only once while using a loop via squash_actions is deprecated. Instead of using a loop to supply multiple items and specifying `name: "{{ item }}"`, please use `name: '{{ pip_packages_to_install }}'` and remove the loop. This feature will be removed in version 2.11. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:31:13.211 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-10-23T08:31:13.212 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=[u'remoto>=0.0.35']) => {"ansible_loop_var": "item", "changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "item": ["remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-10-23T08:31:13.250 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:01.870) 0:05:58.387 ***** 2019-10-23T08:31:13.259 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=[u'remoto>=0.0.35']) => {"ansible_loop_var": "item", "changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "item": ["remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-10-23T08:31:13.302 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.051) 0:05:58.439 ***** 2019-10-23T08:31:13.309 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-10-23T08:31:13.311 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:13.358 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.055) 0:05:58.494 ***** 2019-10-23T08:31:13.365 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:13.402 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.044) 0:05:58.539 ***** 2019-10-23T08:31:13.408 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-10-23T08:31:13.410 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-10-23T08:31:13.448 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.045) 0:05:58.584 ***** 2019-10-23T08:31:13.453 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-10-23T08:31:13.496 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.048) 0:05:58.633 ***** 2019-10-23T08:31:13.776 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-10-23T08:31:13.778 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-10-23T08:31:13.816 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.320) 0:05:58.953 ***** 2019-10-23T08:31:13.821 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-10-23T08:31:13.861 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.044) 0:05:58.997 ***** 2019-10-23T08:31:13.868 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:13.912 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.050) 0:05:59.048 ***** 2019-10-23T08:31:13.919 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:13.929 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:31:13.976 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:13 +0000 (0:00:00.061) 0:05:59.110 ***** 2019-10-23T08:31:13.984 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi062.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-10-23T08:31:13.991 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|changed` use `result is changed`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2019-10-23T08:31:14.023 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.049) 0:05:59.159 ***** 2019-10-23T08:31:14.029 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-10-23T08:31:14.070 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.047) 0:05:59.206 ***** 2019-10-23T08:31:14.076 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-10-23T08:31:14.078 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:14.117 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.046) 0:05:59.253 ***** 2019-10-23T08:31:14.123 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:14.166 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.049) 0:05:59.303 ***** 2019-10-23T08:31:14.443 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-10-23T08:31:14.445 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-10-23T08:31:14.499 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.330) 0:05:59.633 ***** 2019-10-23T08:31:14.516 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-10-23T08:31:14.557 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.059) 0:05:59.693 ***** 2019-10-23T08:31:14.814 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi062.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-10-23T08:31:14.867 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.310) 0:06:00.003 ***** 2019-10-23T08:31:14.899 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-10-23T08:31:14.901 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:14.941 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.070) 0:06:00.073 ***** 2019-10-23T08:31:14.972 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:14 +0000 (0:00:00.034) 0:06:00.108 ***** 2019-10-23T08:31:14.977 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.041 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.068) 0:06:00.177 ***** 2019-10-23T08:31:15.050 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-10-23T08:31:15.050 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.052 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.053 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.103 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.062) 0:06:00.239 ***** 2019-10-23T08:31:15.108 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.113 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.114 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.169 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.065) 0:06:00.305 ***** 2019-10-23T08:31:15.175 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-10-23T08:31:15.176 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.177 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.179 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.180 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.225 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.057) 0:06:00.362 ***** 2019-10-23T08:31:15.234 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.235 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.237 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi038.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.238 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.280 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.054) 0:06:00.417 ***** 2019-10-23T08:31:15.288 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.335 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.054) 0:06:00.471 ***** 2019-10-23T08:31:15.341 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.392 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.057) 0:06:00.529 ***** 2019-10-23T08:31:15.399 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-10-23T08:31:15.400 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.445 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.047) 0:06:00.576 ***** 2019-10-23T08:31:15.446 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.487 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.047) 0:06:00.624 ***** 2019-10-23T08:31:15.493 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-10-23T08:31:15.494 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.536 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.049) 0:06:00.673 ***** 2019-10-23T08:31:15.542 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.583 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.046) 0:06:00.719 ***** 2019-10-23T08:31:15.591 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.627 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.044) 0:06:00.763 ***** 2019-10-23T08:31:15.632 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.673 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.045) 0:06:00.809 ***** 2019-10-23T08:31:15.678 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-10-23T08:31:15.680 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.718 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.045) 0:06:00.855 ***** 2019-10-23T08:31:15.723 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.764 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.045) 0:06:00.900 ***** 2019-10-23T08:31:15.769 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-10-23T08:31:15.770 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.809 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.045) 0:06:00.946 ***** 2019-10-23T08:31:15.814 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.855 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.045) 0:06:00.991 ***** 2019-10-23T08:31:15.860 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-10-23T08:31:15.861 INFO:teuthology.task.ansible.out:skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.910 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.055) 0:06:01.047 ***** 2019-10-23T08:31:15.915 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:15.969 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:15 +0000 (0:00:00.059) 0:06:01.106 ***** 2019-10-23T08:31:15.976 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi062.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:16.019 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:16 +0000 (0:00:00.049) 0:06:01.155 ***** 2019-10-23T08:31:16.025 INFO:teuthology.task.ansible.out:skipping: [smithi038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-10-23T08:31:16.068 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:16 +0000 (0:00:00.049) 0:06:01.205 ***** 2019-10-23T08:31:16.362 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-10-23T08:31:16.364 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015815", "end": "2019-10-23 08:31:16.316767", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-10-23 08:31:16.300952", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:16.454 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012430", "end": "2019-10-23 08:31:16.407061", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-10-23 08:31:16.394631", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:16.694 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007552", "end": "2019-10-23 08:31:16.658970", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-10-23 08:31:16.651418", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:16.696 INFO:teuthology.task.ansible.out: 2019-10-23T08:31:16.727 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007440", "end": "2019-10-23 08:31:16.691380", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-10-23 08:31:16.683940", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:17.022 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006884", "end": "2019-10-23 08:31:16.978203", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-10-23 08:31:16.971319", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:17.064 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007335", "end": "2019-10-23 08:31:17.023564", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-10-23 08:31:17.016229", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:17.315 INFO:teuthology.task.ansible.out:ok: [smithi062.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008617", "end": "2019-10-23 08:31:17.280169", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-10-23 08:31:17.271552", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:17.355 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:17 +0000 (0:00:01.287) 0:06:02.492 ***** 2019-10-23T08:31:17.384 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-10-23T08:31:17.426 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:17 +0000 (0:00:00.070) 0:06:02.563 ***** 2019-10-23T08:31:17.431 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-10-23T08:31:17.433 INFO:teuthology.task.ansible.out:ok: [smithi038.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.009017", "end": "2019-10-23 08:31:17.361484", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-10-23 08:31:17.352467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-10-23T08:31:17.475 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:17 +0000 (0:00:00.048) 0:06:02.611 ***** 2019-10-23T08:31:17.502 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-10-23T08:31:17.540 INFO:teuthology.task.ansible.out:Wednesday 23 October 2019 08:31:17 +0000 (0:00:00.065) 0:06:02.677 ***** 2019-10-23T08:31:17.756 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-10-23T08:31:17.757 INFO:teuthology.task.ansible.out:changed: [smithi062.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-10-23T08:31:17.886 INFO:teuthology.task.ansible.out:changed: [smithi038.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-10-23T08:31:17.990 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-10-23T08:31:17.992 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2019-10-23T08:31:17.994 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-10-23T08:31:17.995 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi038.front.sepia.ceph.com : ok=116 changed=39 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 2019-10-23T08:31:17.997 INFO:teuthology.task.ansible.out:smithi062.front.sepia.ceph.com : ok=116 changed=39 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 Wednesday 23 October 2019 08:31:17 +0000 (0:00:00.455) 0:06:03.132 ***** =============================================================================== testnode : Install packages -------------------------------------------- 47.95s users : Create all admin users with sudo access. ----------------------- 40.98s users : Update authorized_keys using the keys repo --------------------- 39.54s common : nrpe - Ensure SELinux policy is up to date -------------------- 26.87s testnode : Ensure ceph packages are not present. ----------------------- 20.84s common : Install nrpe package and dependencies (RHEL/CentOS) ----------- 18.30s common : Make sure smartmontools is installed -------------------------- 11.12s testnode : Ensure ceph dependency packages are not present. ------------- 9.44s users : Remove revoked users -------------------------------------------- 9.43s common : nrpe - Remove SELinux policy package --------------------------- 8.65s common : nrpe - Load SELinux policy package ----------------------------- 8.60s testnode : Zap all non-root disks --------------------------------------- 8.22s testnode : Removing saved yum transactions ------------------------------ 5.61s 2019-10-23T08:31:17.998 INFO:teuthology.task.ansible.out:testnode : Install epel packages ---------------------------------------- 3.45s ansible-managed : Add authorized keys for the ansible user. ------------- 2.90s users : Update authorized_keys for each user with literal keys ---------- 2.83s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.62s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 2.59s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.56s testnode : Create logical volume(s) ------------------------------------- 2.44s 2019-10-23T08:31:18.294 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi038.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2019-10-23T08:31:18.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:31:18.298 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi038.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:31:18.399 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:18.399 INFO:teuthology.orchestra.run.smithi038:> true 2019-10-23T08:31:18.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-10-23T08:31:18.833 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi062.front.sepia.ceph.com', 'timeout': 60} 2019-10-23T08:31:18.933 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:18.933 INFO:teuthology.orchestra.run.smithi062:> true 2019-10-23T08:31:19.363 INFO:teuthology.run_tasks:Running task clock... 2019-10-23T08:31:19.376 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-10-23T08:31:19.376 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:19.376 INFO:teuthology.orchestra.run.smithi038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-10-23T08:31:19.526 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-10-23T08:31:29.608 INFO:teuthology.orchestra.run.smithi038.stdout:ntpd: time slew -0.000233s 2019-10-23T08:31:29.649 INFO:teuthology.orchestra.run.smithi038.stderr:Failed to start ntp.service: Unit not found. 2019-10-23T08:31:29.735 INFO:teuthology.orchestra.run.smithi038.stdout: remote refid st t when poll reach delay offset jitter 2019-10-23T08:31:29.735 INFO:teuthology.orchestra.run.smithi038.stdout:============================================================================== 2019-10-23T08:31:29.735 INFO:teuthology.orchestra.run.smithi038.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:29.736 INFO:teuthology.orchestra.run.smithi038.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:29.736 INFO:teuthology.orchestra.run.smithi038.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:29.736 INFO:teuthology.orchestra.run.smithi038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:29.737 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:29.737 INFO:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-10-23T08:31:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-10-23T08:31:39.966 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.001382s 2019-10-23T08:31:40.010 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit not found. 2019-10-23T08:31:40.084 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2019-10-23T08:31:40.085 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2019-10-23T08:31:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:40.085 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-10-23T08:31:40.086 INFO:teuthology.run_tasks:Running task install... 2019-10-23T08:31:40.099 DEBUG:teuthology.task.install:project ceph 2019-10-23T08:31:40.099 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198'}} 2019-10-23T08:31:40.099 DEBUG:teuthology.task.install:config {'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198'} 2019-10-23T08:31:40.099 INFO:teuthology.task.install:Using flavor: basic 2019-10-23T08:31:40.110 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-10-23T08:31:40.110 INFO:teuthology.task.install:extra packages: [] 2019-10-23T08:31:40.110 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:40.110 INFO:teuthology.orchestra.run.smithi038:> sudo lsb_release -is 2019-10-23T08:31:40.280 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS 2019-10-23T08:31:40.282 DEBUG:teuthology.misc:System to be installed: CentOS 2019-10-23T08:31:40.282 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:40.282 INFO:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2019-10-23T08:31:40.283 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-10-23T08:31:40.283 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:40.283 INFO:teuthology.orchestra.run.smithi038:> sudo lsb_release -is 2019-10-23T08:31:40.426 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS 2019-10-23T08:31:40.428 DEBUG:teuthology.misc:System to be installed: CentOS 2019-10-23T08:31:40.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=1214c80e358aa5969cb9e43aaf279e75b8989198 2019-10-23T08:31:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS 2019-10-23T08:31:40.447 DEBUG:teuthology.misc:System to be installed: CentOS 2019-10-23T08:31:40.447 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-10-23T08:31:40.447 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:40.447 INFO:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2019-10-23T08:31:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS 2019-10-23T08:31:40.588 DEBUG:teuthology.misc:System to be installed: CentOS 2019-10-23T08:31:40.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=1214c80e358aa5969cb9e43aaf279e75b8989198 2019-10-23T08:31:40.595 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sjust-testing2/1214c80e358aa5969cb9e43aaf279e75b8989198/centos/7/flavors/default/ 2019-10-23T08:31:40.595 INFO:teuthology.task.install.rpm:Package version is 15.0.0-6281.g1214c80 2019-10-23T08:31:40.715 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:40.716 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-10-23T08:31:40.747 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sjust-testing2/1214c80e358aa5969cb9e43aaf279e75b8989198/centos/7/flavors/default/ 2019-10-23T08:31:40.750 INFO:teuthology.task.install.rpm:Package version is 15.0.0-6281.g1214c80 2019-10-23T08:31:40.840 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-10-23T08:31:40.840 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:40.840 INFO:teuthology.orchestra.run.smithi038:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1214c80e358aa5969cb9e43aaf279e75b8989198/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-10-23T08:31:40.891 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:40.891 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-10-23T08:31:40.952 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:40.952 INFO:teuthology.orchestra.run.smithi038:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-10-23T08:31:41.015 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-10-23T08:31:41.016 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:41.016 INFO:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1214c80e358aa5969cb9e43aaf279e75b8989198/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-10-23T08:31:41.058 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:41.058 INFO:teuthology.orchestra.run.smithi038:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-10-23T08:31:41.113 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:41.114 INFO:teuthology.orchestra.run.smithi062:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-10-23T08:31:41.147 INFO:teuthology.orchestra.run.smithi038.stdout:check_obsoletes = 1 2019-10-23T08:31:41.149 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:41.150 INFO:teuthology.orchestra.run.smithi038:> sudo yum clean all 2019-10-23T08:31:41.205 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:41.205 INFO:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-10-23T08:31:41.308 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2019-10-23T08:31:41.310 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:41.310 INFO:teuthology.orchestra.run.smithi062:> sudo yum clean all 2019-10-23T08:31:41.359 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:31:41.401 INFO:teuthology.orchestra.run.smithi038.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-10-23T08:31:41.401 INFO:teuthology.orchestra.run.smithi038.stdout: : lab-extras updates 2019-10-23T08:31:41.417 INFO:teuthology.orchestra.run.smithi038.stdout:Cleaning up list of fastest mirrors 2019-10-23T08:31:41.430 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:31:41.430 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-radosgw 2019-10-23T08:31:41.570 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:31:41.617 INFO:teuthology.orchestra.run.smithi062.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-10-23T08:31:41.617 INFO:teuthology.orchestra.run.smithi062.stdout: : lab-extras updates 2019-10-23T08:31:41.634 INFO:teuthology.orchestra.run.smithi062.stdout:Cleaning up list of fastest mirrors 2019-10-23T08:31:41.647 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:31:41.648 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2019-10-23T08:31:41.678 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:31:41.724 INFO:teuthology.orchestra.run.smithi038.stdout:Determining fastest mirrors 2019-10-23T08:31:41.871 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:31:41.915 INFO:teuthology.orchestra.run.smithi062.stdout:Determining fastest mirrors 2019-10-23T08:31:42.401 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:31:42.402 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:31:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:31:42.403 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:31:42.429 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:31:42.430 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:31:42.431 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:31:42.431 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:31:49.000 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:31:49.112 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:31:49.357 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:31:49.358 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:31:49.358 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.371 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.471 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:31:49.472 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:31:49.472 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.484 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: librados2 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.485 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.486 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.487 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.488 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.488 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.490 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.491 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libceph-common.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.492 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:31:49.492 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-base.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.501 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.502 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.504 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.505 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.506 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.507 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.512 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-10-23T08:31:49.512 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-10-23T08:31:49.512 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-10-23T08:31:49.512 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librados2.x86_64 2:15.0.0-6281.g1214c80.el7 will be an update 2019-10-23T08:31:49.513 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librgw2.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.514 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:31:49.514 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.518 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.520 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.521 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.522 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.523 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.524 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-rados = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.525 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.526 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.526 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.527 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.528 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.528 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-10-23T08:31:49.529 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package libcephfs2.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.529 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-10-23T08:31:49.529 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librbd1.x86_64 2:15.0.0-6281.g1214c80.el7 will be an update 2019-10-23T08:31:49.530 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-10-23T08:31:49.531 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-10-23T08:31:49.532 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-10-23T08:31:49.532 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:31:49.532 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-10-23T08:31:49.533 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.534 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.534 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.534 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-cephfs.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.536 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-10-23T08:31:49.536 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-rados.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.537 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-rbd.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.537 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-rgw.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.537 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-10-23T08:31:49.598 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librados2 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.599 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.600 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.609 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.609 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.610 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.610 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libceph-common.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.610 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:31:49.610 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-base.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.615 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.616 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.617 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.619 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.620 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.622 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.623 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-10-23T08:31:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-10-23T08:31:49.624 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-10-23T08:31:49.626 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librados2.x86_64 2:15.0.0-6281.g1214c80.el7 will be an update 2019-10-23T08:31:49.627 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librgw2.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.628 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:31:49.628 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.633 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.633 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.635 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.636 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.636 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.637 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-rados = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.638 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.639 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.640 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.641 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.642 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:31:49.642 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-10-23T08:31:49.643 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libcephfs2.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.643 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-10-23T08:31:49.643 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librbd1.x86_64 2:15.0.0-6281.g1214c80.el7 will be an update 2019-10-23T08:31:49.644 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-10-23T08:31:49.644 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-10-23T08:31:49.645 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-10-23T08:31:49.646 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:31:49.646 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-10-23T08:31:49.647 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.648 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.648 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.648 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-cephfs.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.649 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-10-23T08:31:49.649 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-rados.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.650 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-rbd.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.650 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-rgw.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:31:49.651 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-10-23T08:31:50.419 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:31:50.506 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:31:50.506 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:31:50.509 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:31:50.509 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:31:50.510 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:31:50.510 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:31:50.510 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:31:50.510 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:31:50.511 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw x86_64 2:15.0.0-6281.g1214c80.el7 ceph 6.0 M 2019-10-23T08:31:50.511 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:31:50.511 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base x86_64 2:15.0.0-6281.g1214c80.el7 ceph 5.4 M 2019-10-23T08:31:50.511 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common x86_64 2:15.0.0-6281.g1214c80.el7 ceph 19 M 2019-10-23T08:31:50.511 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux x86_64 2:15.0.0-6281.g1214c80.el7 ceph 20 k 2019-10-23T08:31:50.511 INFO:teuthology.orchestra.run.smithi038.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-10-23T08:31:50.512 INFO:teuthology.orchestra.run.smithi038.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-10-23T08:31:50.512 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 482 k 2019-10-23T08:31:50.512 INFO:teuthology.orchestra.run.smithi038.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-10-23T08:31:50.512 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-10-23T08:31:50.512 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 361 k 2019-10-23T08:31:50.513 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 5.3 M 2019-10-23T08:31:50.513 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-10-23T08:31:50.513 INFO:teuthology.orchestra.run.smithi038.stdout: python-ceph-argparse x86_64 2:15.0.0-6281.g1214c80.el7 ceph 35 k 2019-10-23T08:31:50.513 INFO:teuthology.orchestra.run.smithi038.stdout: python-ceph-common x86_64 2:15.0.0-6281.g1214c80.el7 ceph 13 k 2019-10-23T08:31:50.513 INFO:teuthology.orchestra.run.smithi038.stdout: python-cephfs x86_64 2:15.0.0-6281.g1214c80.el7 ceph 100 k 2019-10-23T08:31:50.514 INFO:teuthology.orchestra.run.smithi038.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-10-23T08:31:50.514 INFO:teuthology.orchestra.run.smithi038.stdout: python-rados x86_64 2:15.0.0-6281.g1214c80.el7 ceph 208 k 2019-10-23T08:31:50.514 INFO:teuthology.orchestra.run.smithi038.stdout: python-rbd x86_64 2:15.0.0-6281.g1214c80.el7 ceph 196 k 2019-10-23T08:31:50.514 INFO:teuthology.orchestra.run.smithi038.stdout: python-rgw x86_64 2:15.0.0-6281.g1214c80.el7 ceph 77 k 2019-10-23T08:31:50.514 INFO:teuthology.orchestra.run.smithi038.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-10-23T08:31:50.515 INFO:teuthology.orchestra.run.smithi038.stdout:Updating for dependencies: 2019-10-23T08:31:50.515 INFO:teuthology.orchestra.run.smithi038.stdout: librados2 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 3.5 M 2019-10-23T08:31:50.515 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 1.7 M 2019-10-23T08:31:50.515 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:31:50.515 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:31:50.515 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:31:50.516 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+19 Dependent packages) 2019-10-23T08:31:50.516 INFO:teuthology.orchestra.run.smithi038.stdout:Upgrade ( 2 Dependent packages) 2019-10-23T08:31:50.516 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:31:50.516 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 43 M 2019-10-23T08:31:50.516 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:31:50.517 INFO:teuthology.orchestra.run.smithi038.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-10-23T08:31:50.528 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:31:50.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:31:50.615 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:31:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:31:50.630 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:31:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:31:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:31:50.631 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:31:50.631 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:31:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:15.0.0-6281.g1214c80.el7 ceph 6.0 M 2019-10-23T08:31:50.632 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:31:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:15.0.0-6281.g1214c80.el7 ceph 5.4 M 2019-10-23T08:31:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:15.0.0-6281.g1214c80.el7 ceph 19 M 2019-10-23T08:31:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:15.0.0-6281.g1214c80.el7 ceph 20 k 2019-10-23T08:31:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-10-23T08:31:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-10-23T08:31:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 482 k 2019-10-23T08:31:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-10-23T08:31:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-10-23T08:31:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 361 k 2019-10-23T08:31:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 5.3 M 2019-10-23T08:31:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-10-23T08:31:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-argparse x86_64 2:15.0.0-6281.g1214c80.el7 ceph 35 k 2019-10-23T08:31:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-common x86_64 2:15.0.0-6281.g1214c80.el7 ceph 13 k 2019-10-23T08:31:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: python-cephfs x86_64 2:15.0.0-6281.g1214c80.el7 ceph 100 k 2019-10-23T08:31:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-10-23T08:31:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: python-rados x86_64 2:15.0.0-6281.g1214c80.el7 ceph 208 k 2019-10-23T08:31:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: python-rbd x86_64 2:15.0.0-6281.g1214c80.el7 ceph 196 k 2019-10-23T08:31:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: python-rgw x86_64 2:15.0.0-6281.g1214c80.el7 ceph 77 k 2019-10-23T08:31:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-10-23T08:31:50.637 INFO:teuthology.orchestra.run.smithi062.stdout:Updating for dependencies: 2019-10-23T08:31:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 3.5 M 2019-10-23T08:31:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:15.0.0-6281.g1214c80.el7 ceph 1.7 M 2019-10-23T08:31:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:31:50.640 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:31:50.641 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:31:50.641 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+19 Dependent packages) 2019-10-23T08:31:50.641 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade ( 2 Dependent packages) 2019-10-23T08:31:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:31:50.642 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 43 M 2019-10-23T08:31:50.642 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:31:50.642 INFO:teuthology.orchestra.run.smithi062.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-10-23T08:31:54.062 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:31:54.062 INFO:teuthology.orchestra.run.smithi062.stdout:Total 13 MB/s | 43 MB 00:03 2019-10-23T08:31:54.063 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:31:54.064 INFO:teuthology.orchestra.run.smithi038.stdout:Total 12 MB/s | 43 MB 00:03 2019-10-23T08:31:54.075 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:31:54.081 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:31:54.137 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:31:54.157 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:31:54.331 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:31:54.331 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:31:54.331 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:31:54.332 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:31:54.968 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/24 2019-10-23T08:31:55.096 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/24 2019-10-23T08:31:55.260 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/24 2019-10-23T08:31:55.374 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/24 2019-10-23T08:31:55.519 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-ceph-argparse-15.0.0-6281.g1214c80.el7.x86_64 3/24 2019-10-23T08:31:55.622 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-ceph-argparse-15.0.0-6281.g1214c80.el7.x86_64 3/24 2019-10-23T08:31:55.871 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/24 2019-10-23T08:31:55.934 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/24 2019-10-23T08:31:56.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 5/24 2019-10-23T08:31:56.297 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 5/24 2019-10-23T08:31:56.951 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 6/24 2019-10-23T08:31:57.049 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 6/24 2019-10-23T08:31:57.308 INFO:teuthology.orchestra.run.smithi062.stdout: Updating : 2:librados2-15.0.0-6281.g1214c80.el7.x86_64 7/24 2019-10-23T08:31:57.396 INFO:teuthology.orchestra.run.smithi038.stdout: Updating : 2:librados2-15.0.0-6281.g1214c80.el7.x86_64 7/24 2019-10-23T08:31:58.200 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-rados-15.0.0-6281.g1214c80.el7.x86_64 8/24 2019-10-23T08:31:58.354 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-rados-15.0.0-6281.g1214c80.el7.x86_64 8/24 2019-10-23T08:31:58.724 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:librgw2-15.0.0-6281.g1214c80.el7.x86_64 9/24 2019-10-23T08:31:58.957 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:librgw2-15.0.0-6281.g1214c80.el7.x86_64 9/24 2019-10-23T08:31:59.122 INFO:teuthology.orchestra.run.smithi062.stdout: Updating : 2:librbd1-15.0.0-6281.g1214c80.el7.x86_64 10/24 2019-10-23T08:31:59.420 INFO:teuthology.orchestra.run.smithi038.stdout: Updating : 2:librbd1-15.0.0-6281.g1214c80.el7.x86_64 10/24 2019-10-23T08:31:59.439 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:libcephfs2-15.0.0-6281.g1214c80.el7.x86_64 11/24 2019-10-23T08:31:59.695 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:libcephfs2-15.0.0-6281.g1214c80.el7.x86_64 11/24 2019-10-23T08:31:59.725 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-cephfs-15.0.0-6281.g1214c80.el7.x86_64 12/24 2019-10-23T08:31:59.990 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-cephfs-15.0.0-6281.g1214c80.el7.x86_64 12/24 2019-10-23T08:31:59.997 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-rbd-15.0.0-6281.g1214c80.el7.x86_64 13/24 2019-10-23T08:32:00.230 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-rbd-15.0.0-6281.g1214c80.el7.x86_64 13/24 2019-10-23T08:32:00.288 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-rgw-15.0.0-6281.g1214c80.el7.x86_64 14/24 2019-10-23T08:32:00.558 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-rgw-15.0.0-6281.g1214c80.el7.x86_64 14/24 2019-10-23T08:32:00.560 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:libradosstriper1-15.0.0-6281.g1214c80.el7.x86_64 15/24 2019-10-23T08:32:00.832 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:libradosstriper1-15.0.0-6281.g1214c80.el7.x86_64 15/24 2019-10-23T08:32:00.838 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-ceph-common-15.0.0-6281.g1214c80.el7.x86_64 16/24 2019-10-23T08:32:01.070 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-ceph-common-15.0.0-6281.g1214c80.el7.x86_64 16/24 2019-10-23T08:32:01.122 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/24 2019-10-23T08:32:01.328 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/24 2019-10-23T08:32:03.630 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/24 2019-10-23T08:32:03.916 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/24 2019-10-23T08:32:04.700 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 19/24 2019-10-23T08:32:04.996 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 19/24 2019-10-23T08:32:05.227 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 20/24 2019-10-23T08:32:05.639 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 20/24 2019-10-23T08:32:15.242 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-selinux-15.0.0-6281.g1214c80.el7.x86_64 21/24 2019-10-23T08:32:15.547 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-selinux-15.0.0-6281.g1214c80.el7.x86_64 21/24 2019-10-23T08:32:15.625 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 22/24 2019-10-23T08:32:15.914 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 23/24 2019-10-23T08:32:16.045 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 22/24 2019-10-23T08:32:16.201 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 24/24 2019-10-23T08:32:16.308 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 23/24 2019-10-23T08:32:16.312 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/24 2019-10-23T08:32:16.429 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/24 2019-10-23T08:32:16.529 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-selinux-15.0.0-6281.g1214c80.el7.x86_64 3/24 2019-10-23T08:32:16.593 INFO:teuthology.orchestra.run.smithi038.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 24/24 2019-10-23T08:32:16.613 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 4/24 2019-10-23T08:32:16.705 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 5/24 2019-10-23T08:32:16.739 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/24 2019-10-23T08:32:16.839 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-rbd-15.0.0-6281.g1214c80.el7.x86_64 6/24 2019-10-23T08:32:16.848 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/24 2019-10-23T08:32:16.956 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-ceph-argparse-15.0.0-6281.g1214c80.el7.x86_64 7/24 2019-10-23T08:32:16.965 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-selinux-15.0.0-6281.g1214c80.el7.x86_64 3/24 2019-10-23T08:32:17.048 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:libradosstriper1-15.0.0-6281.g1214c80.el7.x86_64 8/24 2019-10-23T08:32:17.066 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-radosgw-15.0.0-6281.g1214c80.el7.x86_64 4/24 2019-10-23T08:32:17.158 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 5/24 2019-10-23T08:32:17.166 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librgw2-15.0.0-6281.g1214c80.el7.x86_64 9/24 2019-10-23T08:32:17.267 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-rbd-15.0.0-6281.g1214c80.el7.x86_64 6/24 2019-10-23T08:32:17.275 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 10/24 2019-10-23T08:32:17.375 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-rados-15.0.0-6281.g1214c80.el7.x86_64 11/24 2019-10-23T08:32:17.484 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-cephfs-15.0.0-6281.g1214c80.el7.x86_64 12/24 2019-10-23T08:32:17.617 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-rgw-15.0.0-6281.g1214c80.el7.x86_64 13/24 2019-10-23T08:32:18.056 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 14/24 2019-10-23T08:32:18.102 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-ceph-argparse-15.0.0-6281.g1214c80.el7.x86_64 7/24 2019-10-23T08:32:18.219 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:libradosstriper1-15.0.0-6281.g1214c80.el7.x86_64 8/24 2019-10-23T08:32:18.344 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:librgw2-15.0.0-6281.g1214c80.el7.x86_64 9/24 2019-10-23T08:32:18.453 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-base-15.0.0-6281.g1214c80.el7.x86_64 10/24 2019-10-23T08:32:18.562 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-rados-15.0.0-6281.g1214c80.el7.x86_64 11/24 2019-10-23T08:32:18.705 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-cephfs-15.0.0-6281.g1214c80.el7.x86_64 12/24 2019-10-23T08:32:18.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-ceph-common-15.0.0-6281.g1214c80.el7.x86_64 15/24 2019-10-23T08:32:18.813 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-rgw-15.0.0-6281.g1214c80.el7.x86_64 13/24 2019-10-23T08:32:18.845 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 16/24 2019-10-23T08:32:18.905 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 14/24 2019-10-23T08:32:18.937 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librados2-15.0.0-6281.g1214c80.el7.x86_64 17/24 2019-10-23T08:32:19.021 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 18/24 2019-10-23T08:32:19.022 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-ceph-common-15.0.0-6281.g1214c80.el7.x86_64 15/24 2019-10-23T08:32:19.104 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librbd1-15.0.0-6281.g1214c80.el7.x86_64 19/24 2019-10-23T08:32:19.140 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 16/24 2019-10-23T08:32:19.205 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:libcephfs2-15.0.0-6281.g1214c80.el7.x86_64 20/24 2019-10-23T08:32:19.240 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:librados2-15.0.0-6281.g1214c80.el7.x86_64 17/24 2019-10-23T08:32:19.313 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/24 2019-10-23T08:32:19.341 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-common-15.0.0-6281.g1214c80.el7.x86_64 18/24 2019-10-23T08:32:19.422 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 22/24 2019-10-23T08:32:19.424 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 23/24 2019-10-23T08:32:19.425 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:librbd1-15.0.0-6281.g1214c80.el7.x86_64 19/24 2019-10-23T08:32:19.546 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:libcephfs2-15.0.0-6281.g1214c80.el7.x86_64 20/24 2019-10-23T08:32:19.659 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/24 2019-10-23T08:32:19.760 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 22/24 2019-10-23T08:32:19.761 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 23/24 2019-10-23T08:32:19.804 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 24/24 2019-10-23T08:32:19.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:19.805 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:32:19.805 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:19.805 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:32:19.805 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-10-23T08:32:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-argparse.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: python-cephfs.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-10-23T08:32:19.807 INFO:teuthology.orchestra.run.smithi062.stdout: python-rados.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout: python-rbd.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout: python-rgw.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Updated: 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout: librados2.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.808 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:19.809 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:19.809 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:32:19.937 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:32:19.938 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2019-10-23T08:32:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 24/24 2019-10-23T08:32:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:20.133 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:32:20.133 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-radosgw.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-base.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-selinux.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-10-23T08:32:20.134 INFO:teuthology.orchestra.run.smithi038.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs2.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: libradosstriper1.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: librgw2.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-10-23T08:32:20.135 INFO:teuthology.orchestra.run.smithi038.stdout: python-ceph-argparse.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: python-ceph-common.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: python-cephfs.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-10-23T08:32:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: python-rados.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: python-rbd.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.136 INFO:teuthology.orchestra.run.smithi038.stdout: python-rgw.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-10-23T08:32:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:20.137 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Updated: 2019-10-23T08:32:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: librados2.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: librbd1.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:20.137 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:20.138 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:32:20.241 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:32:20.277 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:32:20.277 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-test 2019-10-23T08:32:20.282 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:32:20.283 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:32:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:32:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:32:20.284 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:32:20.527 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:32:20.567 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:32:20.568 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:32:20.933 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:32:21.215 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:32:21.278 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:32:21.279 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:21.279 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-test.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:21.297 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:21.328 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:21.329 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:21.330 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:21.330 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-10-23T08:32:21.331 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-10-23T08:32:21.332 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-10-23T08:32:21.334 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-10-23T08:32:21.337 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:21.338 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-10-23T08:32:21.551 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:32:21.552 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:21.552 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-test.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:21.574 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:21.601 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:21.602 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:21.603 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:21.603 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-10-23T08:32:21.604 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-10-23T08:32:21.605 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-10-23T08:32:21.607 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-10-23T08:32:21.610 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:21.610 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-10-23T08:32:21.705 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:32:21.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:21.932 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:32:21.933 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:21.933 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:21.933 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:32:21.934 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:32:21.934 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:21.934 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:32:21.934 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:15.0.0-6281.g1214c80.el7 ceph 37 M 2019-10-23T08:32:21.934 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:32:21.934 INFO:teuthology.orchestra.run.smithi062.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-10-23T08:32:21.935 INFO:teuthology.orchestra.run.smithi062.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-10-23T08:32:21.935 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-10-23T08:32:21.935 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-10-23T08:32:21.935 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:21.936 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:32:21.936 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:21.936 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+4 Dependent packages) 2019-10-23T08:32:21.936 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:21.936 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 37 M 2019-10-23T08:32:21.936 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 130 M 2019-10-23T08:32:21.937 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:32:21.983 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:32:22.207 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:22.207 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:32:22.208 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:22.208 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:32:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:32:22.209 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:22.209 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:32:22.209 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test x86_64 2:15.0.0-6281.g1214c80.el7 ceph 37 M 2019-10-23T08:32:22.209 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:32:22.210 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:22.211 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+4 Dependent packages) 2019-10-23T08:32:22.211 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:22.211 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 37 M 2019-10-23T08:32:22.211 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 130 M 2019-10-23T08:32:22.211 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:32:23.862 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:32:23.862 INFO:teuthology.orchestra.run.smithi062.stdout:Total 19 MB/s | 37 MB 00:01 2019-10-23T08:32:23.867 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:32:23.902 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:32:23.971 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:32:23.971 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:32:24.704 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-10-23T08:32:24.971 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-10-23T08:32:25.247 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-10-23T08:32:27.587 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:32:27.587 INFO:teuthology.orchestra.run.smithi038.stdout:Total 6.9 MB/s | 37 MB 00:05 2019-10-23T08:32:27.591 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:32:27.633 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:32:27.684 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:32:27.684 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:32:28.518 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-10-23T08:32:28.766 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-10-23T08:32:29.038 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-10-23T08:32:29.269 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-10-23T08:32:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 5/5 2019-10-23T08:32:29.690 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-10-23T08:32:29.798 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-10-23T08:32:29.906 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 3/5 2019-10-23T08:32:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-10-23T08:32:30.550 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-10-23T08:32:30.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-10-23T08:32:30.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:30.552 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:32:30.674 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:32:30.674 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2019-10-23T08:32:30.946 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:32:30.992 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:32:30.993 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:32:30.993 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:32:30.993 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:32:30.994 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:32:31.641 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:32:31.992 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:32:31.993 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:31.993 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:31.995 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.026 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.027 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.028 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.030 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:32.030 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mds.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:32.040 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:32.042 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.043 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.045 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.047 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.047 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.048 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:32.049 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mon.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:32.052 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-osd.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:32.057 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:32.057 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-10-23T08:32:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-10-23T08:32:32.059 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-10-23T08:32:32.060 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:32.061 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:32.062 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:32.062 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:32.063 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:32.064 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-10-23T08:32:32.065 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-10-23T08:32:32.066 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-10-23T08:32:32.066 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-10-23T08:32:32.066 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-10-23T08:32:32.068 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:32.068 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-10-23T08:32:32.068 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-10-23T08:32:32.068 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-10-23T08:32:32.069 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-10-23T08:32:32.070 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-10-23T08:32:32.070 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-10-23T08:32:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-10-23T08:32:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-10-23T08:32:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-10-23T08:32:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-10-23T08:32:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-10-23T08:32:32.072 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-10-23T08:32:32.072 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:32.072 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-10-23T08:32:32.073 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-10-23T08:32:32.073 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:32.073 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-10-23T08:32:32.441 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:32:32.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:32.669 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:32:32.672 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:32.672 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:32.672 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:32:32.672 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:32:32.672 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:32.672 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:32:32.673 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:15.0.0-6281.g1214c80.el7 ceph 2.0 k 2019-10-23T08:32:32.673 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:32:32.673 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:15.0.0-6281.g1214c80.el7 ceph 1.9 M 2019-10-23T08:32:32.673 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:15.0.0-6281.g1214c80.el7 ceph 1.6 M 2019-10-23T08:32:32.673 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:15.0.0-6281.g1214c80.el7 ceph 4.3 M 2019-10-23T08:32:32.673 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:15.0.0-6281.g1214c80.el7 ceph 16 M 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-10-23T08:32:32.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-10-23T08:32:32.675 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:32.676 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+21 Dependent packages) 2019-10-23T08:32:32.677 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:32.677 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 27 M 2019-10-23T08:32:32.677 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 86 M 2019-10-23T08:32:32.677 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:32:33.064 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-10-23T08:32:33.355 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 5/5 2019-10-23T08:32:33.469 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-10-23T08:32:33.578 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-10-23T08:32:33.712 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-test-15.0.0-6281.g1214c80.el7.x86_64 3/5 2019-10-23T08:32:33.814 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-10-23T08:32:34.289 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-10-23T08:32:34.289 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:34.289 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:32:34.289 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-test.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:34.290 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:34.290 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:32:34.290 INFO:teuthology.orchestra.run.smithi038.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-10-23T08:32:34.290 INFO:teuthology.orchestra.run.smithi038.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-10-23T08:32:34.290 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:34.290 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:32:34.414 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:32:34.414 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph 2019-10-23T08:32:34.693 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:32:34.739 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:32:34.740 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:32:34.741 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:32:34.741 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:32:34.742 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:32:35.404 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:32:35.752 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:32:35.752 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.753 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:35.755 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.786 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.787 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.788 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.789 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.789 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mds.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:35.800 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:35.802 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.803 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.805 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.806 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.807 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.808 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:35.809 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mon.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:35.812 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-osd.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:35.817 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.817 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-10-23T08:32:35.818 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-10-23T08:32:35.819 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-10-23T08:32:35.820 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:35.821 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:35.821 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:35.822 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:35.823 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-10-23T08:32:35.824 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-10-23T08:32:35.825 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-10-23T08:32:35.826 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-10-23T08:32:35.826 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-10-23T08:32:35.827 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-10-23T08:32:35.828 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.828 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-10-23T08:32:35.828 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-10-23T08:32:35.829 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-10-23T08:32:35.830 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-10-23T08:32:35.830 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-10-23T08:32:35.830 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-10-23T08:32:35.831 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-10-23T08:32:35.831 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-10-23T08:32:35.831 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-10-23T08:32:35.831 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.831 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-10-23T08:32:35.832 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-10-23T08:32:35.832 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-10-23T08:32:35.832 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.833 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-10-23T08:32:35.833 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-10-23T08:32:35.833 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:35.834 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-10-23T08:32:36.202 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:32:36.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:36.430 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:32:36.433 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:36.433 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:36.434 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:32:36.434 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:32:36.434 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:36.434 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:32:36.434 INFO:teuthology.orchestra.run.smithi038.stdout: ceph x86_64 2:15.0.0-6281.g1214c80.el7 ceph 2.0 k 2019-10-23T08:32:36.434 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:32:36.435 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds x86_64 2:15.0.0-6281.g1214c80.el7 ceph 1.9 M 2019-10-23T08:32:36.435 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr x86_64 2:15.0.0-6281.g1214c80.el7 ceph 1.6 M 2019-10-23T08:32:36.435 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon x86_64 2:15.0.0-6281.g1214c80.el7 ceph 4.3 M 2019-10-23T08:32:36.435 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd x86_64 2:15.0.0-6281.g1214c80.el7 ceph 16 M 2019-10-23T08:32:36.435 INFO:teuthology.orchestra.run.smithi038.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-10-23T08:32:36.436 INFO:teuthology.orchestra.run.smithi038.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-10-23T08:32:36.437 INFO:teuthology.orchestra.run.smithi038.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+21 Dependent packages) 2019-10-23T08:32:36.438 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:36.439 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 27 M 2019-10-23T08:32:36.439 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 86 M 2019-10-23T08:32:36.439 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:32:38.396 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:32:38.397 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.8 MB/s | 27 MB 00:05 2019-10-23T08:32:38.415 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:32:38.421 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:32:38.421 INFO:teuthology.orchestra.run.smithi038.stdout:Total 14 MB/s | 27 MB 00:01 2019-10-23T08:32:38.442 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:32:38.450 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:32:38.477 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:32:38.714 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:32:38.715 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:32:38.745 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:32:38.746 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:32:39.501 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-10-23T08:32:39.520 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-10-23T08:32:39.820 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-10-23T08:32:39.870 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-10-23T08:32:41.674 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-10-23T08:32:41.738 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-10-23T08:32:42.083 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-osd-15.0.0-6281.g1214c80.el7.x86_64 4/22 2019-10-23T08:32:42.124 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-osd-15.0.0-6281.g1214c80.el7.x86_64 4/22 2019-10-23T08:32:42.558 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-10-23T08:32:42.575 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-10-23T08:32:42.910 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-10-23T08:32:42.936 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-10-23T08:32:43.303 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-10-23T08:32:43.376 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-10-23T08:32:43.798 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-10-23T08:32:43.902 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-10-23T08:32:44.369 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-10-23T08:32:44.459 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-10-23T08:32:44.811 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mds-15.0.0-6281.g1214c80.el7.x86_64 10/22 2019-10-23T08:32:44.826 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mds-15.0.0-6281.g1214c80.el7.x86_64 10/22 2019-10-23T08:32:45.211 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-10-23T08:32:45.215 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-10-23T08:32:45.485 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-10-23T08:32:45.511 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-mako-0.8.1-2.el7.noarch 12/22 2019-10-23T08:32:45.788 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-10-23T08:32:45.845 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-10-23T08:32:46.127 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-10-23T08:32:46.162 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-10-23T08:32:46.836 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-10-23T08:32:46.917 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-10-23T08:32:47.117 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mon-15.0.0-6281.g1214c80.el7.x86_64 16/22 2019-10-23T08:32:47.314 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-10-23T08:32:47.359 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mon-15.0.0-6281.g1214c80.el7.x86_64 16/22 2019-10-23T08:32:47.580 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-10-23T08:32:47.819 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-10-23T08:32:47.826 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-10-23T08:32:48.205 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-10-23T08:32:48.244 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-10-23T08:32:48.870 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-10-23T08:32:49.249 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 21/22 2019-10-23T08:32:49.303 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-10-23T08:32:49.463 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 22/22 2019-10-23T08:32:49.574 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-10-23T08:32:49.707 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-10-23T08:32:49.716 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 21/22 2019-10-23T08:32:49.825 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-10-23T08:32:49.934 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-10-23T08:32:50.051 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mon-15.0.0-6281.g1214c80.el7.x86_64 5/22 2019-10-23T08:32:50.062 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 22/22 2019-10-23T08:32:50.168 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-10-23T08:32:50.173 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-10-23T08:32:50.269 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-10-23T08:32:50.307 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-10-23T08:32:50.377 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 8/22 2019-10-23T08:32:50.390 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-10-23T08:32:50.482 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-10-23T08:32:50.486 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 9/22 2019-10-23T08:32:50.575 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mon-15.0.0-6281.g1214c80.el7.x86_64 5/22 2019-10-23T08:32:50.616 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 10/22 2019-10-23T08:32:50.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-10-23T08:32:50.720 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-10-23T08:32:50.813 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 12/22 2019-10-23T08:32:50.817 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-10-23T08:32:50.913 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mds-15.0.0-6281.g1214c80.el7.x86_64 13/22 2019-10-23T08:32:50.917 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 8/22 2019-10-23T08:32:51.005 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 14/22 2019-10-23T08:32:51.010 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 9/22 2019-10-23T08:32:51.122 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 15/22 2019-10-23T08:32:51.160 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 10/22 2019-10-23T08:32:51.248 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-10-23T08:32:51.269 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 11/22 2019-10-23T08:32:51.365 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-10-23T08:32:51.381 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 12/22 2019-10-23T08:32:51.474 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-10-23T08:32:51.478 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mds-15.0.0-6281.g1214c80.el7.x86_64 13/22 2019-10-23T08:32:51.579 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 14/22 2019-10-23T08:32:51.599 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-10-23T08:32:51.696 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-15.0.0-6281.g1214c80.el7.x86_64 15/22 2019-10-23T08:32:51.708 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-10-23T08:32:51.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-10-23T08:32:51.825 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-10-23T08:32:51.972 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-10-23T08:32:52.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-10-23T08:32:52.173 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-10-23T08:32:52.265 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-10-23T08:32:52.312 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-osd-15.0.0-6281.g1214c80.el7.x86_64 22/22 2019-10-23T08:32:52.313 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:52.313 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:32:52.313 INFO:teuthology.orchestra.run.smithi038.stdout: ceph.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.313 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:52.313 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:32:52.313 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mds.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mon.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-osd.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-10-23T08:32:52.314 INFO:teuthology.orchestra.run.smithi038.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-10-23T08:32:52.315 INFO:teuthology.orchestra.run.smithi038.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-10-23T08:32:52.316 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:52.317 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:32:52.365 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-10-23T08:32:52.436 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:32:52.436 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-daemon 2019-10-23T08:32:52.647 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:32:52.687 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:32:52.687 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:32:52.688 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:32:52.688 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:32:52.688 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:32:52.816 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-osd-15.0.0-6281.g1214c80.el7.x86_64 22/22 2019-10-23T08:32:52.816 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:52.816 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:32:52.816 INFO:teuthology.orchestra.run.smithi062.stdout: ceph.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.816 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:52.816 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-10-23T08:32:52.817 INFO:teuthology.orchestra.run.smithi062.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-10-23T08:32:52.818 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-10-23T08:32:52.818 INFO:teuthology.orchestra.run.smithi062.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-10-23T08:32:52.818 INFO:teuthology.orchestra.run.smithi062.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-10-23T08:32:52.818 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-10-23T08:32:52.818 INFO:teuthology.orchestra.run.smithi062.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-10-23T08:32:52.818 INFO:teuthology.orchestra.run.smithi062.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-10-23T08:32:52.819 INFO:teuthology.orchestra.run.smithi062.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-10-23T08:32:52.819 INFO:teuthology.orchestra.run.smithi062.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-10-23T08:32:52.819 INFO:teuthology.orchestra.run.smithi062.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-10-23T08:32:52.819 INFO:teuthology.orchestra.run.smithi062.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-10-23T08:32:52.819 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-10-23T08:32:52.819 INFO:teuthology.orchestra.run.smithi062.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-10-23T08:32:52.820 INFO:teuthology.orchestra.run.smithi062.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-10-23T08:32:52.820 INFO:teuthology.orchestra.run.smithi062.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-10-23T08:32:52.820 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:52.820 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:32:52.952 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:32:52.952 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-daemon 2019-10-23T08:32:53.249 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:32:53.296 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:32:53.296 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:32:53.297 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:32:53.297 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:32:53.297 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:32:53.326 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:32:53.661 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:32:53.661 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:53.661 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:53.662 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: podman for package: 2:ceph-daemon-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:53.695 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:53.696 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package podman.x86_64 0:1.4.4-4.el7.centos will be installed 2019-10-23T08:32:53.704 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: skopeo-containers >= 0.1.29-3 for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:53.706 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: containernetworking-plugins >= 0.8.1-1 for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:53.708 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: runc for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:53.709 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: container-selinux for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:53.711 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:53.711 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package container-selinux.noarch 2:2.107-3.el7 will be installed 2019-10-23T08:32:53.715 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package containernetworking-plugins.x86_64 0:0.8.1-2.el7.centos will be installed 2019-10-23T08:32:53.716 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package containers-common.x86_64 1:0.1.37-3.el7.centos will be installed 2019-10-23T08:32:53.716 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package runc.x86_64 0:1.0.0-65.rc8.el7.centos will be installed 2019-10-23T08:32:53.716 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: criu for package: runc-1.0.0-65.rc8.el7.centos.x86_64 2019-10-23T08:32:53.717 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:53.718 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package criu.x86_64 0:3.12-2.el7 will be installed 2019-10-23T08:32:53.718 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libprotobuf-c.so.1(LIBPROTOBUF_C_1.0.0)(64bit) for package: criu-3.12-2.el7.x86_64 2019-10-23T08:32:53.720 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libprotobuf-c.so.1()(64bit) for package: criu-3.12-2.el7.x86_64 2019-10-23T08:32:53.720 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libnet.so.1()(64bit) for package: criu-3.12-2.el7.x86_64 2019-10-23T08:32:53.721 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:32:53.722 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package libnet.x86_64 0:1.1.6-7.el7 will be installed 2019-10-23T08:32:53.722 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package protobuf-c.x86_64 0:1.0.2-3.el7 will be installed 2019-10-23T08:32:53.943 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:32:54.090 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:32:54.292 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:32:54.293 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:54.293 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:32:54.294 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: podman for package: 2:ceph-daemon-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:32:54.315 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:54.316 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:32:54.317 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:54.317 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:54.317 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:32:54.317 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-daemon x86_64 2:15.0.0-6281.g1214c80.el7 ceph 11 k 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout: container-selinux noarch 2:2.107-3.el7 extras 39 k 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout: containernetworking-plugins x86_64 0.8.1-2.el7.centos extras 16 M 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout: containers-common x86_64 1:0.1.37-3.el7.centos extras 21 k 2019-10-23T08:32:54.318 INFO:teuthology.orchestra.run.smithi038.stdout: criu x86_64 3.12-2.el7 base 453 k 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout: libnet x86_64 1.1.6-7.el7 base 59 k 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout: podman x86_64 1.4.4-4.el7.centos extras 9.3 M 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-c x86_64 1.0.2-3.el7 base 28 k 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout: runc x86_64 1.0.0-65.rc8.el7.centos extras 2.0 M 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:32:54.319 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:32:54.320 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+8 Dependent packages) 2019-10-23T08:32:54.320 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:32:54.320 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 28 M 2019-10-23T08:32:54.321 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 112 M 2019-10-23T08:32:54.321 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:32:54.327 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:54.327 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package podman.x86_64 0:1.4.4-4.el7.centos will be installed 2019-10-23T08:32:54.335 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: skopeo-containers >= 0.1.29-3 for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:54.338 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: containernetworking-plugins >= 0.8.1-1 for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:54.339 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: runc for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:54.341 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: container-selinux for package: podman-1.4.4-4.el7.centos.x86_64 2019-10-23T08:32:54.342 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:54.343 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package container-selinux.noarch 2:2.107-3.el7 will be installed 2019-10-23T08:32:54.347 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package containernetworking-plugins.x86_64 0:0.8.1-2.el7.centos will be installed 2019-10-23T08:32:54.347 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package containers-common.x86_64 1:0.1.37-3.el7.centos will be installed 2019-10-23T08:32:54.348 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package runc.x86_64 0:1.0.0-65.rc8.el7.centos will be installed 2019-10-23T08:32:54.349 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: criu for package: runc-1.0.0-65.rc8.el7.centos.x86_64 2019-10-23T08:32:54.349 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:54.350 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package criu.x86_64 0:3.12-2.el7 will be installed 2019-10-23T08:32:54.350 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libprotobuf-c.so.1(LIBPROTOBUF_C_1.0.0)(64bit) for package: criu-3.12-2.el7.x86_64 2019-10-23T08:32:54.351 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libprotobuf-c.so.1()(64bit) for package: criu-3.12-2.el7.x86_64 2019-10-23T08:32:54.352 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libnet.so.1()(64bit) for package: criu-3.12-2.el7.x86_64 2019-10-23T08:32:54.353 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:32:54.353 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libnet.x86_64 0:1.1.6-7.el7 will be installed 2019-10-23T08:32:54.353 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package protobuf-c.x86_64 0:1.0.2-3.el7 will be installed 2019-10-23T08:32:54.721 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:32:54.945 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:54.945 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:32:54.946 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:54.946 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:54.946 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-daemon x86_64 2:15.0.0-6281.g1214c80.el7 ceph 11 k 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout: container-selinux noarch 2:2.107-3.el7 extras 39 k 2019-10-23T08:32:54.947 INFO:teuthology.orchestra.run.smithi062.stdout: containernetworking-plugins x86_64 0.8.1-2.el7.centos extras 16 M 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: containers-common x86_64 1:0.1.37-3.el7.centos extras 21 k 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: criu x86_64 3.12-2.el7 base 453 k 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: libnet x86_64 1.1.6-7.el7 base 59 k 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: podman x86_64 1.4.4-4.el7.centos extras 9.3 M 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-c x86_64 1.0.2-3.el7 base 28 k 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: runc x86_64 1.0.0-65.rc8.el7.centos extras 2.0 M 2019-10-23T08:32:54.948 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:54.949 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:32:54.949 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:32:54.949 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+8 Dependent packages) 2019-10-23T08:32:54.949 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:32:54.950 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 28 M 2019-10-23T08:32:54.950 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 112 M 2019-10-23T08:32:54.950 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:32:56.030 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:32:56.030 INFO:teuthology.orchestra.run.smithi038.stdout:Total 16 MB/s | 28 MB 00:01 2019-10-23T08:32:56.036 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:32:56.060 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:32:56.158 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:32:56.158 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:32:56.700 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:32:56.701 INFO:teuthology.orchestra.run.smithi062.stdout:Total 16 MB/s | 28 MB 00:01 2019-10-23T08:32:56.713 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:32:56.749 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:32:56.815 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:32:56.816 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:06.707 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:container-selinux-2.107-3.el7.noarch 1/9 2019-10-23T08:33:06.992 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : libnet-1.1.6-7.el7.x86_64 2/9 2019-10-23T08:33:07.408 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:container-selinux-2.107-3.el7.noarch 1/9 2019-10-23T08:33:07.645 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libnet-1.1.6-7.el7.x86_64 2/9 2019-10-23T08:33:09.005 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 1:containers-common-0.1.37-3.el7.centos.x86_64 3/9 2019-10-23T08:33:09.258 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : containernetworking-plugins-0.8.1-2.el7.centos.x86_64 4/9 2019-10-23T08:33:09.598 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : protobuf-c-1.0.2-3.el7.x86_64 5/9 2019-10-23T08:33:09.626 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 1:containers-common-0.1.37-3.el7.centos.x86_64 3/9 2019-10-23T08:33:09.878 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : containernetworking-plugins-0.8.1-2.el7.centos.x86_64 4/9 2019-10-23T08:33:10.136 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : criu-3.12-2.el7.x86_64 6/9 2019-10-23T08:33:10.234 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-c-1.0.2-3.el7.x86_64 5/9 2019-10-23T08:33:10.729 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : criu-3.12-2.el7.x86_64 6/9 2019-10-23T08:33:11.579 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : runc-1.0.0-65.rc8.el7.centos.x86_64 7/9 2019-10-23T08:33:11.858 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : podman-1.4.4-4.el7.centos.x86_64 8/9 2019-10-23T08:33:12.087 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-daemon-15.0.0-6281.g1214c80.el7.x86_64 9/9 2019-10-23T08:33:12.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : runc-1.0.0-65.rc8.el7.centos.x86_64 7/9 2019-10-23T08:33:12.211 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : protobuf-c-1.0.2-3.el7.x86_64 1/9 2019-10-23T08:33:12.337 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:container-selinux-2.107-3.el7.noarch 2/9 2019-10-23T08:33:12.462 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : containernetworking-plugins-0.8.1-2.el7.centos.x86_64 3/9 2019-10-23T08:33:12.501 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : podman-1.4.4-4.el7.centos.x86_64 8/9 2019-10-23T08:33:12.579 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 1:containers-common-0.1.37-3.el7.centos.x86_64 4/9 2019-10-23T08:33:12.697 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : criu-3.12-2.el7.x86_64 5/9 2019-10-23T08:33:12.717 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-daemon-15.0.0-6281.g1214c80.el7.x86_64 9/9 2019-10-23T08:33:12.789 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : podman-1.4.4-4.el7.centos.x86_64 6/9 2019-10-23T08:33:12.813 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-c-1.0.2-3.el7.x86_64 1/9 2019-10-23T08:33:12.906 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : libnet-1.1.6-7.el7.x86_64 7/9 2019-10-23T08:33:12.931 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:container-selinux-2.107-3.el7.noarch 2/9 2019-10-23T08:33:13.023 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : containernetworking-plugins-0.8.1-2.el7.centos.x86_64 3/9 2019-10-23T08:33:13.148 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:containers-common-0.1.37-3.el7.centos.x86_64 4/9 2019-10-23T08:33:13.265 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : criu-3.12-2.el7.x86_64 5/9 2019-10-23T08:33:13.366 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : podman-1.4.4-4.el7.centos.x86_64 6/9 2019-10-23T08:33:13.508 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-daemon-15.0.0-6281.g1214c80.el7.x86_64 8/9 2019-10-23T08:33:13.917 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libnet-1.1.6-7.el7.x86_64 7/9 2019-10-23T08:33:13.935 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : runc-1.0.0-65.rc8.el7.centos.x86_64 9/9 2019-10-23T08:33:13.935 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:13.935 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:13.935 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-daemon.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:13.935 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:13.936 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:33:13.936 INFO:teuthology.orchestra.run.smithi038.stdout: container-selinux.noarch 2:2.107-3.el7 2019-10-23T08:33:13.936 INFO:teuthology.orchestra.run.smithi038.stdout: containernetworking-plugins.x86_64 0:0.8.1-2.el7.centos 2019-10-23T08:33:13.936 INFO:teuthology.orchestra.run.smithi038.stdout: containers-common.x86_64 1:0.1.37-3.el7.centos 2019-10-23T08:33:13.936 INFO:teuthology.orchestra.run.smithi038.stdout: criu.x86_64 0:3.12-2.el7 2019-10-23T08:33:13.936 INFO:teuthology.orchestra.run.smithi038.stdout: libnet.x86_64 0:1.1.6-7.el7 2019-10-23T08:33:13.937 INFO:teuthology.orchestra.run.smithi038.stdout: podman.x86_64 0:1.4.4-4.el7.centos 2019-10-23T08:33:13.937 INFO:teuthology.orchestra.run.smithi038.stdout: protobuf-c.x86_64 0:1.0.2-3.el7 2019-10-23T08:33:13.937 INFO:teuthology.orchestra.run.smithi038.stdout: runc.x86_64 0:1.0.0-65.rc8.el7.centos 2019-10-23T08:33:13.937 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:13.938 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:14.043 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-daemon-15.0.0-6281.g1214c80.el7.x86_64 8/9 2019-10-23T08:33:14.070 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:14.070 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr 2019-10-23T08:33:14.338 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:14.378 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:14.379 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:14.379 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:14.379 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:14.380 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:14.535 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : runc-1.0.0-65.rc8.el7.centos.x86_64 9/9 2019-10-23T08:33:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:14.536 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-daemon.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:14.536 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:33:14.536 INFO:teuthology.orchestra.run.smithi062.stdout: container-selinux.noarch 2:2.107-3.el7 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: containernetworking-plugins.x86_64 0:0.8.1-2.el7.centos 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: containers-common.x86_64 1:0.1.37-3.el7.centos 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: criu.x86_64 0:3.12-2.el7 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: libnet.x86_64 0:1.1.6-7.el7 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: podman.x86_64 0:1.4.4-4.el7.centos 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-c.x86_64 0:1.0.2-3.el7 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: runc.x86_64 0:1.0.0-65.rc8.el7.centos 2019-10-23T08:33:14.537 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:14.538 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:14.672 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:14.672 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2019-10-23T08:33:14.942 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:14.986 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:14.986 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:14.987 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:15.030 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:15.369 INFO:teuthology.orchestra.run.smithi038.stdout:Package 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:33:15.369 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do 2019-10-23T08:33:15.430 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:15.430 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-dashboard 2019-10-23T08:33:15.632 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:15.648 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:15.693 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:15.694 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:15.695 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:15.974 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:ceph-mgr-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:33:15.975 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-10-23T08:33:16.035 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:16.035 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2019-10-23T08:33:16.239 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:16.276 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:16.277 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:16.277 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:16.278 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:16.278 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:16.337 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:16.679 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:16.680 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:16.680 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:16.683 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:16.714 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:16.715 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:16.715 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:16.715 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-10-23T08:33:16.716 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-10-23T08:33:16.717 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:16.717 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-10-23T08:33:16.936 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:17.092 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:17.272 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:17.272 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:17.273 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:17.275 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-6281.g1214c80.el7 for package: 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:17.306 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:17.308 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:17.308 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:17.308 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-10-23T08:33:17.309 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-10-23T08:33:17.309 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:17.310 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-10-23T08:33:17.319 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:17.327 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:17.327 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:17.328 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:17.328 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:33:17.328 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:17.328 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:17.328 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 3.9 M 2019-10-23T08:33:17.328 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 18 k 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:17.329 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+3 Dependent packages) 2019-10-23T08:33:17.330 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:17.330 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 4.6 M 2019-10-23T08:33:17.330 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 20 M 2019-10-23T08:33:17.330 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:17.684 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:17.909 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:17.909 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:17.911 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:17.911 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:17.911 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:33:17.911 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:17.911 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 3.9 M 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 18 k 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:17.912 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:17.913 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:17.913 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+3 Dependent packages) 2019-10-23T08:33:17.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:17.913 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 4.6 M 2019-10-23T08:33:17.913 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 20 M 2019-10-23T08:33:17.913 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:17.914 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:17.914 INFO:teuthology.orchestra.run.smithi038.stdout:Total 7.7 MB/s | 4.6 MB 00:00 2019-10-23T08:33:17.918 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:17.926 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:18.185 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:18.185 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:18.434 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:18.434 INFO:teuthology.orchestra.run.smithi062.stdout:Total 8.7 MB/s | 4.6 MB 00:00 2019-10-23T08:33:18.439 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:18.447 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:18.625 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:19.056 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-6281.g1214c80.el7.noarch 1/4 2019-10-23T08:33:19.357 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-6281.g1214c80.el7.noarch 1/4 2019-10-23T08:33:19.488 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-10-23T08:33:19.806 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-10-23T08:33:20.709 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-10-23T08:33:20.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-10-23T08:33:21.050 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 4/4 2019-10-23T08:33:21.167 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 1/4 2019-10-23T08:33:21.276 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-routes-1.13-2.el7.noarch 2/4 2019-10-23T08:33:21.314 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 4/4 2019-10-23T08:33:21.385 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 3/4 2019-10-23T08:33:21.432 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-6281.g1214c80.el7.noarch 1/4 2019-10-23T08:33:21.549 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-routes-1.13-2.el7.noarch 2/4 2019-10-23T08:33:21.683 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 3/4 2019-10-23T08:33:21.844 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-6281.g1214c80.el7.noarch 4/4 2019-10-23T08:33:21.844 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:21.844 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:21.844 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout: python-routes.noarch 0:1.13-2.el7 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:21.845 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:22.009 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:22.009 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-10-23T08:33:22.167 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-6281.g1214c80.el7.noarch 4/4 2019-10-23T08:33:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:22.168 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:33:22.168 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-10-23T08:33:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: python-routes.noarch 0:1.13-2.el7 2019-10-23T08:33:22.169 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:22.169 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:22.271 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:22.300 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:22.300 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-10-23T08:33:22.317 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:22.318 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:22.318 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:22.319 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:22.319 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:22.560 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:22.603 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:22.604 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:22.605 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:22.964 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:23.257 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:23.311 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:23.312 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:23.312 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:23.605 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:23.605 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:23.605 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:23.685 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:23.870 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:23.870 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:23.871 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:23.871 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-cloud 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout: noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 83 k 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:23.872 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2019-10-23T08:33:23.873 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 83 k 2019-10-23T08:33:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 412 k 2019-10-23T08:33:23.873 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:23.977 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:24.163 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:24.164 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:24.164 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-cloud 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 83 k 2019-10-23T08:33:24.165 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 83 k 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 412 k 2019-10-23T08:33:24.166 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:24.188 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:24.192 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:24.244 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:24.244 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:24.508 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:24.508 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:24.561 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:24.562 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:24.977 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-6281.g1214c80.el7.n 1/1 2019-10-23T08:33:25.374 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-6281.g1214c80.el7.n 1/1 2019-10-23T08:33:25.406 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-6281.g1214c80.el7.n 1/1 2019-10-23T08:33:25.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:25.407 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:25.407 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:25.407 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:25.543 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:25.543 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-diskprediction-local 2019-10-23T08:33:25.813 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:25.828 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-6281.g1214c80.el7.n 1/1 2019-10-23T08:33:25.828 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:25.829 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:25.829 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:25.829 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:25.829 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:25.859 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:25.860 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:25.860 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:25.860 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:25.861 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:25.972 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:25.973 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2019-10-23T08:33:26.254 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:26.300 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:26.301 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:26.301 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:26.302 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:26.302 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:26.508 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:26.855 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:26.856 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:26.856 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:26.859 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:26.890 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:26.890 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-10-23T08:33:26.897 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-10-23T08:33:26.898 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-10-23T08:33:26.900 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-10-23T08:33:26.900 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:26.901 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-10-23T08:33:26.901 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-10-23T08:33:26.902 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-10-23T08:33:26.904 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-10-23T08:33:26.904 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:26.905 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-10-23T08:33:26.951 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:27.278 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:27.296 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:27.297 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:27.297 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:27.299 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:27.331 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:27.331 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-10-23T08:33:27.338 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-10-23T08:33:27.339 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-10-23T08:33:27.341 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-10-23T08:33:27.342 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:27.342 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-10-23T08:33:27.342 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-10-23T08:33:27.343 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-10-23T08:33:27.345 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-10-23T08:33:27.346 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:27.346 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-10-23T08:33:27.503 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:27.504 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:27.504 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:27.505 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:27.505 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:33:27.505 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:27.505 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:27.505 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local 2019-10-23T08:33:27.505 INFO:teuthology.orchestra.run.smithi038.stdout: noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 1.1 M 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:27.506 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:27.507 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:27.507 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+4 Dependent packages) 2019-10-23T08:33:27.507 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:27.508 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 12 M 2019-10-23T08:33:27.508 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 66 M 2019-10-23T08:33:27.508 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:27.716 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:27.942 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:27.942 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:27.943 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:27.943 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:27.944 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:33:27.944 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:27.944 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:27.944 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local 2019-10-23T08:33:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 1.1 M 2019-10-23T08:33:27.950 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:33:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-10-23T08:33:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-10-23T08:33:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-10-23T08:33:27.950 INFO:teuthology.orchestra.run.smithi062.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+4 Dependent packages) 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 12 M 2019-10-23T08:33:27.951 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 66 M 2019-10-23T08:33:27.952 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:28.240 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:28.240 INFO:teuthology.orchestra.run.smithi038.stdout:Total 16 MB/s | 12 MB 00:00 2019-10-23T08:33:28.250 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:28.284 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:28.383 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:28.383 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:28.473 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:28.474 INFO:teuthology.orchestra.run.smithi062.stdout:Total 22 MB/s | 12 MB 00:00 2019-10-23T08:33:28.479 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:28.496 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:28.651 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:28.652 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:29.231 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-10-23T08:33:29.540 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-10-23T08:33:29.674 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-10-23T08:33:30.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-10-23T08:33:31.405 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-10-23T08:33:31.866 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-10-23T08:33:32.201 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-10-23T08:33:32.460 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-6281.g1214c80.el7.n 5/5 2019-10-23T08:33:32.583 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-6281.g1214c80.el7.n 1/5 2019-10-23T08:33:32.645 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-10-23T08:33:32.717 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-10-23T08:33:32.826 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-10-23T08:33:32.936 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-10-23T08:33:33.002 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-6281.g1214c80.el7.n 5/5 2019-10-23T08:33:33.095 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-6281.g1214c80.el7.n 1/5 2019-10-23T08:33:33.214 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-10-23T08:33:33.313 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-10-23T08:33:33.411 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-10-23T08:33:33.411 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-10-23T08:33:33.412 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:33.413 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:33.455 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-10-23T08:33:33.557 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:33.558 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-rook 2019-10-23T08:33:33.833 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:33.880 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:33.881 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:33.882 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:33.882 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:33.883 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:33.940 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-10-23T08:33:33.940 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:33.940 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:33.940 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:33.941 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:33:33.941 INFO:teuthology.orchestra.run.smithi062.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-10-23T08:33:33.941 INFO:teuthology.orchestra.run.smithi062.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-10-23T08:33:33.941 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:33.941 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:34.075 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:34.075 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2019-10-23T08:33:34.264 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:34.303 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:34.304 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:34.304 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:34.305 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:34.305 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:34.535 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:34.885 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:34.886 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:34.886 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:34.887 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:34.919 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:34.919 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-kubernetes.noarch 0:8.0.1-1.el7 will be installed 2019-10-23T08:33:34.921 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:34.922 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:34.923 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:34.925 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:34.926 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:34.926 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-10-23T08:33:34.926 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-10-23T08:33:34.926 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-10-23T08:33:34.927 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-10-23T08:33:34.928 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-10-23T08:33:34.930 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-10-23T08:33:34.930 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-10-23T08:33:34.930 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-10-23T08:33:34.931 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:34.932 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-10-23T08:33:34.932 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-10-23T08:33:34.933 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-10-23T08:33:34.933 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-10-23T08:33:34.933 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-10-23T08:33:34.933 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:34.934 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-10-23T08:33:35.258 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:35.259 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:35.259 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:35.261 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:35.292 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-kubernetes.noarch 0:8.0.1-1.el7 will be installed 2019-10-23T08:33:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:35.296 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:35.296 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:35.298 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-8.0.1-1.el7.noarch 2019-10-23T08:33:35.299 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:35.299 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-10-23T08:33:35.299 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-10-23T08:33:35.299 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-10-23T08:33:35.300 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-10-23T08:33:35.301 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-10-23T08:33:35.302 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-10-23T08:33:35.303 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-10-23T08:33:35.303 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-10-23T08:33:35.307 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-10-23T08:33:35.307 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-10-23T08:33:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-10-23T08:33:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-10-23T08:33:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-10-23T08:33:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:35.308 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-10-23T08:33:35.534 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:35.534 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:35.536 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:35.536 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:35.536 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:33:35.536 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:35.537 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:35.537 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 24 k 2019-10-23T08:33:35.537 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:33:35.537 INFO:teuthology.orchestra.run.smithi038.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-10-23T08:33:35.537 INFO:teuthology.orchestra.run.smithi038.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-10-23T08:33:35.537 INFO:teuthology.orchestra.run.smithi038.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-10-23T08:33:35.538 INFO:teuthology.orchestra.run.smithi038.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-10-23T08:33:35.538 INFO:teuthology.orchestra.run.smithi038.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-10-23T08:33:35.538 INFO:teuthology.orchestra.run.smithi038.stdout: python2-kubernetes noarch 8.0.1-1.el7 epel 1.0 M 2019-10-23T08:33:35.538 INFO:teuthology.orchestra.run.smithi038.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-10-23T08:33:35.538 INFO:teuthology.orchestra.run.smithi038.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-10-23T08:33:35.539 INFO:teuthology.orchestra.run.smithi038.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-10-23T08:33:35.539 INFO:teuthology.orchestra.run.smithi038.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-10-23T08:33:35.539 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:35.539 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:35.539 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:35.540 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+10 Dependent packages) 2019-10-23T08:33:35.540 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:35.540 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 1.6 M 2019-10-23T08:33:35.540 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 22 M 2019-10-23T08:33:35.541 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:35.910 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:35.910 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:35.912 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:35.912 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:33:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:35.912 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:35.913 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 24 k 2019-10-23T08:33:35.913 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:33:35.913 INFO:teuthology.orchestra.run.smithi062.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-10-23T08:33:35.913 INFO:teuthology.orchestra.run.smithi062.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-10-23T08:33:35.913 INFO:teuthology.orchestra.run.smithi062.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-kubernetes noarch 8.0.1-1.el7 epel 1.0 M 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-10-23T08:33:35.914 INFO:teuthology.orchestra.run.smithi062.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-10-23T08:33:35.915 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:35.915 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:35.915 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:35.915 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+10 Dependent packages) 2019-10-23T08:33:35.915 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:35.916 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 1.6 M 2019-10-23T08:33:35.916 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 22 M 2019-10-23T08:33:35.916 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:36.016 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:36.017 INFO:teuthology.orchestra.run.smithi038.stdout:Total 3.3 MB/s | 1.6 MB 00:00 2019-10-23T08:33:36.032 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:36.045 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:36.116 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:36.116 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:36.411 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:36.411 INFO:teuthology.orchestra.run.smithi062.stdout:Total 3.2 MB/s | 1.6 MB 00:00 2019-10-23T08:33:36.423 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:36.435 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:36.497 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:36.498 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:36.865 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 1/11 2019-10-23T08:33:37.155 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 2/11 2019-10-23T08:33:37.235 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 1/11 2019-10-23T08:33:37.442 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 3/11 2019-10-23T08:33:37.516 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 2/11 2019-10-23T08:33:37.685 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 4/11 2019-10-23T08:33:37.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 3/11 2019-10-23T08:33:37.995 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-10-23T08:33:38.088 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 4/11 2019-10-23T08:33:38.362 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-10-23T08:33:38.859 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-10-23T08:33:38.974 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-10-23T08:33:39.174 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-10-23T08:33:39.313 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-10-23T08:33:39.440 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-10-23T08:33:39.763 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-10-23T08:33:40.672 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-10-23T08:33:40.914 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-10-23T08:33:40.978 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python2-kubernetes-8.0.1-1.el7.noarch 10/11 2019-10-23T08:33:41.255 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python2-kubernetes-8.0.1-1.el7.noarch 10/11 2019-10-23T08:33:41.265 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mgr-rook-15.0.0-6281.g1214c80.el7.noarch 11/11 2019-10-23T08:33:41.363 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-10-23T08:33:41.473 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-10-23T08:33:41.526 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-rook-15.0.0-6281.g1214c80.el7.noarch 11/11 2019-10-23T08:33:41.607 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-10-23T08:33:41.632 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-10-23T08:33:41.706 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-10-23T08:33:41.798 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-10-23T08:33:41.882 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-10-23T08:33:41.916 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-10-23T08:33:42.041 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-10-23T08:33:42.041 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-10-23T08:33:42.141 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-10-23T08:33:42.159 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 8/11 2019-10-23T08:33:42.241 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-10-23T08:33:42.259 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-10-23T08:33:42.334 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-10-23T08:33:42.351 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python2-kubernetes-8.0.1-1.el7.noarch 10/11 2019-10-23T08:33:42.443 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-10-23T08:33:42.526 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 8/11 2019-10-23T08:33:42.635 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-10-23T08:33:42.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python2-kubernetes-8.0.1-1.el7.noarch 10/11 2019-10-23T08:33:42.836 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-6281.g1214c80.el7.noarch 11/11 2019-10-23T08:33:42.836 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-rook.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-10-23T08:33:42.837 INFO:teuthology.orchestra.run.smithi038.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-kubernetes.noarch 0:8.0.1-1.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-10-23T08:33:42.838 INFO:teuthology.orchestra.run.smithi038.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-10-23T08:33:42.839 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:42.839 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:42.969 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:42.969 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-mgr-ssh 2019-10-23T08:33:43.221 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-6281.g1214c80.el7.noarch 11/11 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-10-23T08:33:43.222 INFO:teuthology.orchestra.run.smithi062.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python2-kubernetes.noarch 0:8.0.1-1.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-10-23T08:33:43.223 INFO:teuthology.orchestra.run.smithi062.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-10-23T08:33:43.224 INFO:teuthology.orchestra.run.smithi062.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-10-23T08:33:43.224 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:43.224 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:43.228 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:43.274 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:43.275 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:43.276 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:43.276 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:43.276 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:43.348 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:43.349 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-ssh 2019-10-23T08:33:43.611 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:43.656 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:43.657 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:43.658 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:43.658 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:43.658 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:43.928 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:44.275 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:44.275 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:44.275 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:44.277 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:44.309 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:44.309 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-10-23T08:33:44.309 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-10-23T08:33:44.310 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:44.310 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:44.310 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-10-23T08:33:44.652 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:44.653 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:44.653 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:44.654 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-6281.g1214c80.el7.noarch 2019-10-23T08:33:44.686 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:44.686 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-10-23T08:33:44.686 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-10-23T08:33:44.688 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:44.688 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-10-23T08:33:44.689 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:44.917 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:44.917 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:44.918 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:44.919 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:33:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:44.919 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:44.920 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-ssh noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 21 k 2019-10-23T08:33:44.920 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:33:44.920 INFO:teuthology.orchestra.run.smithi038.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-10-23T08:33:44.920 INFO:teuthology.orchestra.run.smithi038.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-10-23T08:33:44.921 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:44.921 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+2 Dependent packages) 2019-10-23T08:33:44.922 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 304 k 2019-10-23T08:33:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 1.0 M 2019-10-23T08:33:44.922 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:45.065 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:45.218 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:45.218 INFO:teuthology.orchestra.run.smithi038.stdout:Total 1.0 MB/s | 304 kB 00:00 2019-10-23T08:33:45.222 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:45.229 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:45.291 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:45.291 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:45.292 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:45.293 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:45.293 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:33:45.293 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:45.293 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:45.293 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-ssh noarch 2:15.0.0-6281.g1214c80.el7 ceph-noarch 21 k 2019-10-23T08:33:45.294 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:33:45.294 INFO:teuthology.orchestra.run.smithi062.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-10-23T08:33:45.294 INFO:teuthology.orchestra.run.smithi062.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-10-23T08:33:45.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:45.294 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:45.295 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:45.295 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+2 Dependent packages) 2019-10-23T08:33:45.295 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:45.295 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 304 k 2019-10-23T08:33:45.295 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.0 M 2019-10-23T08:33:45.296 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:45.306 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:45.306 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:45.602 INFO:teuthology.orchestra.run.smithi062.stdout:Total 982 kB/s | 304 kB 00:00 2019-10-23T08:33:45.605 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:45.612 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:45.686 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:45.695 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:46.032 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-10-23T08:33:46.275 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-10-23T08:33:46.448 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-10-23T08:33:46.565 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-6281.g1214c80.el7.noarch 3/3 2019-10-23T08:33:46.685 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-10-23T08:33:46.718 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-10-23T08:33:46.786 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-6281.g1214c80.el7.noarch 2/3 2019-10-23T08:33:46.977 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-6281.g1214c80.el7.noarch 3/3 2019-10-23T08:33:47.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-10-23T08:33:47.187 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-6281.g1214c80.el7.noarch 2/3 2019-10-23T08:33:47.353 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 3/3 2019-10-23T08:33:47.353 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-mgr-ssh.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:47.354 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:47.478 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:47.478 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install ceph-fuse 2019-10-23T08:33:47.701 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:47.705 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 3/3 2019-10-23T08:33:47.705 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:47.706 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:47.706 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-ssh.noarch 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:47.706 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:47.706 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:33:47.707 INFO:teuthology.orchestra.run.smithi062.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-10-23T08:33:47.707 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:47.707 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:47.742 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:47.743 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:47.744 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:47.744 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:47.744 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:47.833 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:47.833 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2019-10-23T08:33:48.105 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:48.150 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:48.152 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:48.152 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:48.152 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:48.153 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:48.405 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:48.753 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:48.754 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:48.764 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:33:48.798 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:48.800 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:33:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-10-23T08:33:48.801 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:48.806 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:48.806 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:48.806 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:48.807 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:48.807 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-10-23T08:33:48.812 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-10-23T08:33:48.812 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-10-23T08:33:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:49.148 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:49.158 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:33:49.192 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:33:49.193 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:49.193 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-10-23T08:33:49.193 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:49.195 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:49.196 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:49.205 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-10-23T08:33:49.205 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:49.205 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-10-23T08:33:49.205 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-10-23T08:33:49.205 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-10-23T08:33:49.205 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:49.426 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:49.426 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:49.427 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:49.427 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse x86_64 2:15.0.0-6281.g1214c80.el7 ceph 546 k 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:33:49.428 INFO:teuthology.orchestra.run.smithi038.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:49.429 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+4 Dependent packages) 2019-10-23T08:33:49.430 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:49.430 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 9.9 M 2019-10-23T08:33:49.430 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 49 M 2019-10-23T08:33:49.430 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:49.577 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:49.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:49.806 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:49.807 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:49.807 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:49.807 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:33:49.807 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:33:49.807 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:49.807 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:15.0.0-6281.g1214c80.el7 ceph 546 k 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-10-23T08:33:49.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+4 Dependent packages) 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 9.9 M 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 49 M 2019-10-23T08:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:49.928 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:49.928 INFO:teuthology.orchestra.run.smithi038.stdout:Total 20 MB/s | 9.9 MB 00:00 2019-10-23T08:33:49.938 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:49.952 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:50.061 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:50.062 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:50.325 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:50.328 INFO:teuthology.orchestra.run.smithi062.stdout:Total 19 MB/s | 9.9 MB 00:00 2019-10-23T08:33:50.339 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:50.364 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:52.323 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-10-23T08:33:52.778 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-10-23T08:33:52.808 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-10-23T08:33:53.266 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-10-23T08:33:53.685 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-10-23T08:33:54.103 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-10-23T08:33:54.110 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-10-23T08:33:54.316 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 5/5 2019-10-23T08:33:54.424 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 1/5 2019-10-23T08:33:54.524 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-10-23T08:33:54.569 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-10-23T08:33:54.650 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-10-23T08:33:54.742 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-10-23T08:33:54.800 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 5/5 2019-10-23T08:33:54.890 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:ceph-fuse-15.0.0-6281.g1214c80.el7.x86_64 1/5 2019-10-23T08:33:54.991 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-10-23T08:33:55.125 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-10-23T08:33:55.233 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-10-23T08:33:55.233 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:55.233 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:33:55.233 INFO:teuthology.orchestra.run.smithi038.stdout: ceph-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:55.234 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:55.234 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:33:55.234 INFO:teuthology.orchestra.run.smithi038.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-10-23T08:33:55.234 INFO:teuthology.orchestra.run.smithi038.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-10-23T08:33:55.235 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:55.235 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:33:55.235 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-10-23T08:33:55.353 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:55.353 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs2 2019-10-23T08:33:55.554 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:55.593 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:55.594 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:55.594 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:55.594 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:55.594 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:55.676 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-10-23T08:33:55.676 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:55.677 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:33:55.677 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:33:55.677 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:55.677 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:33:55.677 INFO:teuthology.orchestra.run.smithi062.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-10-23T08:33:55.678 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-10-23T08:33:55.678 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:55.678 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:33:55.797 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:55.798 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2019-10-23T08:33:56.060 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:56.106 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:56.107 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:56.108 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:56.109 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:56.236 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:56.574 INFO:teuthology.orchestra.run.smithi038.stdout:Package 2:libcephfs2-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:33:56.575 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do 2019-10-23T08:33:56.636 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:33:56.636 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install libcephfs-devel 2019-10-23T08:33:56.760 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:56.853 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:56.893 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:56.894 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:56.894 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:56.895 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:56.895 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:33:57.106 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:libcephfs2-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:33:57.106 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-10-23T08:33:57.167 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:33:57.167 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2019-10-23T08:33:57.388 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:33:57.433 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:33:57.434 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:33:57.435 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:33:57.435 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:33:57.435 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:33:57.521 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:57.848 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:33:57.849 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:57.849 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:57.850 INFO:teuthology.orchestra.run.smithi038.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-6281.g1214c80.el7 for package: 2:libcephfs-devel-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:33:57.881 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:33:57.882 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package librados-devel.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:58.089 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:33:58.268 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:58.431 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:33:58.431 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:58.432 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:58.432 INFO:teuthology.orchestra.run.smithi062.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-6281.g1214c80.el7 for package: 2:libcephfs-devel-15.0.0-6281.g1214c80.el7.x86_64 2019-10-23T08:33:58.462 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:33:58.462 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package librados-devel.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:33:58.498 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:58.498 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:33:58.499 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel x86_64 2:15.0.0-6281.g1214c80.el7 ceph 17 k 2019-10-23T08:33:58.500 INFO:teuthology.orchestra.run.smithi038.stdout:Installing for dependencies: 2019-10-23T08:33:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel x86_64 2:15.0.0-6281.g1214c80.el7 ceph 85 k 2019-10-23T08:33:58.501 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:58.501 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:33:58.501 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:33:58.501 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package (+1 Dependent package) 2019-10-23T08:33:58.502 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:33:58.502 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 101 k 2019-10-23T08:33:58.502 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 373 k 2019-10-23T08:33:58.502 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:33:58.826 INFO:teuthology.orchestra.run.smithi038.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:58.827 INFO:teuthology.orchestra.run.smithi038.stdout:Total 310 kB/s | 101 kB 00:00 2019-10-23T08:33:58.829 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:33:58.846 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:33:58.851 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:33:58.854 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:33:58.855 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:33:59.076 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:59.077 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:33:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:59.077 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:33:59.077 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:33:59.078 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:59.078 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:33:59.078 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:15.0.0-6281.g1214c80.el7 ceph 17 k 2019-10-23T08:33:59.078 INFO:teuthology.orchestra.run.smithi062.stdout:Installing for dependencies: 2019-10-23T08:33:59.079 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:15.0.0-6281.g1214c80.el7 ceph 85 k 2019-10-23T08:33:59.079 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:59.083 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:33:59.083 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:33:59.083 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package (+1 Dependent package) 2019-10-23T08:33:59.083 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:33:59.083 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 101 k 2019-10-23T08:33:59.084 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 373 k 2019-10-23T08:33:59.084 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:33:59.339 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:librados-devel-15.0.0-6281.g1214c80.el7.x86_64 1/2 2019-10-23T08:33:59.434 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2019-10-23T08:33:59.434 INFO:teuthology.orchestra.run.smithi062.stdout:Total 283 kB/s | 101 kB 00:00 2019-10-23T08:33:59.439 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:33:59.459 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:33:59.461 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:33:59.462 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:33:59.632 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:libcephfs-devel-15.0.0-6281.g1214c80.el7.x86_64 2/2 2019-10-23T08:33:59.741 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:librados-devel-15.0.0-6281.g1214c80.el7.x86_64 1/2 2019-10-23T08:34:00.004 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:librados-devel-15.0.0-6281.g1214c80.el7.x86_64 1/2 2019-10-23T08:34:00.224 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:libcephfs-devel-15.0.0-6281.g1214c80.el7.x86_64 2/2 2019-10-23T08:34:00.224 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:00.224 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:34:00.224 INFO:teuthology.orchestra.run.smithi038.stdout: libcephfs-devel.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:00.224 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:00.225 INFO:teuthology.orchestra.run.smithi038.stdout:Dependency Installed: 2019-10-23T08:34:00.225 INFO:teuthology.orchestra.run.smithi038.stdout: librados-devel.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:00.225 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:00.225 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:34:00.351 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:00.352 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install librados2 2019-10-23T08:34:00.408 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:libcephfs-devel-15.0.0-6281.g1214c80.el7.x86_64 2/2 2019-10-23T08:34:00.505 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:librados-devel-15.0.0-6281.g1214c80.el7.x86_64 1/2 2019-10-23T08:34:00.578 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:00.625 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:00.625 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:00.626 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:00.626 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:00.626 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:34:00.923 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:libcephfs-devel-15.0.0-6281.g1214c80.el7.x86_64 2/2 2019-10-23T08:34:00.923 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:34:00.923 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:00.923 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:00.923 INFO:teuthology.orchestra.run.smithi062.stdout:Dependency Installed: 2019-10-23T08:34:00.924 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:00.924 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:00.924 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:34:01.053 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:01.053 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2019-10-23T08:34:01.273 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:01.303 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:01.345 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:01.347 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:01.347 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:01.347 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:01.347 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:34:01.609 INFO:teuthology.orchestra.run.smithi038.stdout:Package 2:librados2-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:34:01.609 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do 2019-10-23T08:34:01.670 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:01.670 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install librbd1 2019-10-23T08:34:01.923 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:01.970 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:01.971 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:01.972 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:01.972 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:34:01.996 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:02.338 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:librados2-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:34:02.338 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-10-23T08:34:02.399 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:02.400 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2019-10-23T08:34:02.632 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:02.666 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:02.713 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:02.714 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:02.714 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:02.715 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:02.715 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:34:02.978 INFO:teuthology.orchestra.run.smithi038.stdout:Package 2:librbd1-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:34:02.978 INFO:teuthology.orchestra.run.smithi038.stdout:Nothing to do 2019-10-23T08:34:03.039 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:03.039 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install python-ceph 2019-10-23T08:34:03.306 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:03.353 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:03.354 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:03.354 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:03.355 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:03.355 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:34:03.372 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:03.719 INFO:teuthology.orchestra.run.smithi062.stdout:Package 2:librbd1-15.0.0-6281.g1214c80.el7.x86_64 already installed and latest version 2019-10-23T08:34:03.720 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do 2019-10-23T08:34:03.790 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:03.790 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install python-ceph 2019-10-23T08:34:03.959 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:03.996 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:03.996 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:03.997 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:03.997 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:03.998 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:34:04.005 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:04.356 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:34:04.356 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:34:04.357 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:34:04.613 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:04.737 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:34:04.925 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:04.925 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:34:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:04.926 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:34:04.926 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: Size 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: python-ceph-compat x86_64 2:15.0.0-6281.g1214c80.el7 ceph 2.2 k 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:34:04.927 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:34:04.928 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2019-10-23T08:34:04.928 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:04.928 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 2.2 k 2019-10-23T08:34:04.928 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 0 2019-10-23T08:34:04.928 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:34:04.942 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:34:04.942 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:34:04.942 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:34:05.185 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:34:05.186 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:34:05.187 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:34:05.188 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:34:05.323 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:34:05.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:05.512 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:34:05.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:05.513 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:34:05.513 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository 2019-10-23T08:34:05.513 INFO:teuthology.orchestra.run.smithi062.stdout: Size 2019-10-23T08:34:05.513 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:34:05.513 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-compat x86_64 2:15.0.0-6281.g1214c80.el7 ceph 2.2 k 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:05.514 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.2 k 2019-10-23T08:34:05.515 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 0 2019-10-23T08:34:05.515 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:34:05.721 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:python-ceph-compat-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:05.808 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:34:05.809 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:34:05.811 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:34:05.811 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:34:06.238 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:python-ceph-compat-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:06.238 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:06.238 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:34:06.238 INFO:teuthology.orchestra.run.smithi038.stdout: python-ceph-compat.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:06.238 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:06.239 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:34:06.356 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:06.356 INFO:teuthology.orchestra.run.smithi038:> sudo yum -y install rbd-fuse 2019-10-23T08:34:06.570 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:python-ceph-compat-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:06.614 INFO:teuthology.orchestra.run.smithi038.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:06.662 INFO:teuthology.orchestra.run.smithi038.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:06.662 INFO:teuthology.orchestra.run.smithi038.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:06.662 INFO:teuthology.orchestra.run.smithi038.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:06.662 INFO:teuthology.orchestra.run.smithi038.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:06.662 INFO:teuthology.orchestra.run.smithi038.stdout: * updates: repo1.ash.innoscale.net 2019-10-23T08:34:07.077 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:python-ceph-compat-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:07.078 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:07.078 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:34:07.078 INFO:teuthology.orchestra.run.smithi062.stdout: python-ceph-compat.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:07.078 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:07.078 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:34:07.205 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:07.207 INFO:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2019-10-23T08:34:07.319 INFO:teuthology.orchestra.run.smithi038.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:07.465 INFO:teuthology.orchestra.run.smithi062.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-10-23T08:34:07.514 INFO:teuthology.orchestra.run.smithi062.stdout:Loading mirror speeds from cached hostfile 2019-10-23T08:34:07.514 INFO:teuthology.orchestra.run.smithi062.stdout: * base: repos-va.psychz.net 2019-10-23T08:34:07.514 INFO:teuthology.orchestra.run.smithi062.stdout: * epel: ftp.linux.ncsu.edu 2019-10-23T08:34:07.515 INFO:teuthology.orchestra.run.smithi062.stdout: * extras: mirror.atlanticmetro.net 2019-10-23T08:34:07.515 INFO:teuthology.orchestra.run.smithi062.stdout: * updates: mirror.wdc1.us.leaseweb.net 2019-10-23T08:34:07.664 INFO:teuthology.orchestra.run.smithi038.stdout:Resolving Dependencies 2019-10-23T08:34:07.665 INFO:teuthology.orchestra.run.smithi038.stdout:--> Running transaction check 2019-10-23T08:34:07.665 INFO:teuthology.orchestra.run.smithi038.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:34:08.052 INFO:teuthology.orchestra.run.smithi038.stdout:--> Finished Dependency Resolution 2019-10-23T08:34:08.169 INFO:teuthology.orchestra.run.smithi062.stdout:7 packages excluded due to repository priority protections 2019-10-23T08:34:08.282 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:08.282 INFO:teuthology.orchestra.run.smithi038.stdout:Dependencies Resolved 2019-10-23T08:34:08.283 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:08.283 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:34:08.283 INFO:teuthology.orchestra.run.smithi038.stdout: Package Arch Version Repository Size 2019-10-23T08:34:08.283 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:34:08.283 INFO:teuthology.orchestra.run.smithi038.stdout:Installing: 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse x86_64 2:15.0.0-6281.g1214c80.el7 ceph 67 k 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction Summary 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout:================================================================================ 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout:Install 1 Package 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:08.284 INFO:teuthology.orchestra.run.smithi038.stdout:Total download size: 67 k 2019-10-23T08:34:08.285 INFO:teuthology.orchestra.run.smithi038.stdout:Installed size: 172 k 2019-10-23T08:34:08.285 INFO:teuthology.orchestra.run.smithi038.stdout:Downloading packages: 2019-10-23T08:34:08.516 INFO:teuthology.orchestra.run.smithi062.stdout:Resolving Dependencies 2019-10-23T08:34:08.517 INFO:teuthology.orchestra.run.smithi062.stdout:--> Running transaction check 2019-10-23T08:34:08.517 INFO:teuthology.orchestra.run.smithi062.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 will be installed 2019-10-23T08:34:08.599 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction check 2019-10-23T08:34:08.622 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction test 2019-10-23T08:34:08.624 INFO:teuthology.orchestra.run.smithi038.stdout:Transaction test succeeded 2019-10-23T08:34:08.624 INFO:teuthology.orchestra.run.smithi038.stdout:Running transaction 2019-10-23T08:34:08.909 INFO:teuthology.orchestra.run.smithi062.stdout:--> Finished Dependency Resolution 2019-10-23T08:34:09.128 INFO:teuthology.orchestra.run.smithi038.stdout: Installing : 2:rbd-fuse-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:09.136 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:09.136 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies Resolved 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:15.0.0-6281.g1214c80.el7 ceph 67 k 2019-10-23T08:34:09.137 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 67 k 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 172 k 2019-10-23T08:34:09.138 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading packages: 2019-10-23T08:34:09.575 INFO:teuthology.orchestra.run.smithi038.stdout: Verifying : 2:rbd-fuse-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:09.575 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:09.576 INFO:teuthology.orchestra.run.smithi038.stdout:Installed: 2019-10-23T08:34:09.576 INFO:teuthology.orchestra.run.smithi038.stdout: rbd-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:09.576 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:34:09.576 INFO:teuthology.orchestra.run.smithi038.stdout:Complete! 2019-10-23T08:34:09.695 DEBUG:teuthology.parallel:result is None 2019-10-23T08:34:09.763 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2019-10-23T08:34:09.784 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2019-10-23T08:34:09.785 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded 2019-10-23T08:34:09.786 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2019-10-23T08:34:10.243 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : 2:rbd-fuse-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:10.741 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : 2:rbd-fuse-15.0.0-6281.g1214c80.el7.x86_64 1/1 2019-10-23T08:34:10.741 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:10.741 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2019-10-23T08:34:10.741 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse.x86_64 2:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:10.742 INFO:teuthology.orchestra.run.smithi062.stdout: 2019-10-23T08:34:10.742 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2019-10-23T08:34:10.848 DEBUG:teuthology.parallel:result is None 2019-10-23T08:34:10.848 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:10.849 INFO:teuthology.orchestra.run.smithi038:> sudo lsb_release -is 2019-10-23T08:34:10.997 INFO:teuthology.orchestra.run.smithi038.stdout:CentOS 2019-10-23T08:34:10.999 DEBUG:teuthology.misc:System to be installed: CentOS 2019-10-23T08:34:11.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=1214c80e358aa5969cb9e43aaf279e75b8989198 2019-10-23T08:34:11.272 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:11.272 INFO:teuthology.orchestra.run.smithi038:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-10-23T08:34:11.413 INFO:teuthology.orchestra.run.smithi038.stdout:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:11.413 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-6281.g1214c80.el7 2019-10-23T08:34:11.413 INFO:teuthology.task.install:The correct ceph version 15.0.0-6281.g1214c80 is installed. 2019-10-23T08:34:11.414 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:11.414 INFO:teuthology.orchestra.run.smithi062:> sudo lsb_release -is 2019-10-23T08:34:11.569 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS 2019-10-23T08:34:11.571 DEBUG:teuthology.misc:System to be installed: CentOS 2019-10-23T08:34:11.571 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&sha1=1214c80e358aa5969cb9e43aaf279e75b8989198 2019-10-23T08:34:11.728 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:11.728 INFO:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-10-23T08:34:11.867 INFO:teuthology.orchestra.run.smithi062.stdout:15.0.0-6281.g1214c80.el7 2019-10-23T08:34:11.868 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-6281.g1214c80.el7 2019-10-23T08:34:11.868 INFO:teuthology.task.install:The correct ceph version 15.0.0-6281.g1214c80 is installed. 2019-10-23T08:34:11.868 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-10-23T08:34:11.868 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:11.869 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-10-23T08:34:11.992 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:11.992 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-10-23T08:34:12.118 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-10-23T08:34:12.118 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:12.118 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-10-23T08:34:12.243 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:12.244 INFO:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-10-23T08:34:12.359 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:12.359 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-10-23T08:34:12.485 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:12.485 INFO:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-10-23T08:34:12.609 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-10-23T08:34:12.609 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:12.609 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-10-23T08:34:12.731 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:12.731 INFO:teuthology.orchestra.run.smithi038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-10-23T08:34:12.839 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:12.839 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-10-23T08:34:12.962 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:12.963 INFO:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-10-23T08:34:13.068 INFO:teuthology.run_tasks:Running task ceph... 2019-10-23T08:34:13.152 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-10-23T08:34:13.152 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:13.152 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 777 /var/log/ceph 2019-10-23T08:34:13.157 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:13.157 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2019-10-23T08:34:13.278 INFO:tasks.ceph:Disabling ceph logrotate... 2019-10-23T08:34:13.278 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:13.278 INFO:teuthology.orchestra.run.smithi038:> sudo rm -f -- /etc/logrotate.d/ceph 2019-10-23T08:34:13.294 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:13.295 INFO:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2019-10-23T08:34:13.424 INFO:tasks.ceph:Creating extra log directories... 2019-10-23T08:34:13.424 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:13.425 INFO:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-10-23T08:34:13.433 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:13.433 INFO:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-10-23T08:34:13.560 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-10-23T08:34:13.560 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow requests'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd_pool_default_size': 2, 'osd_pool_default_min_size': 2, 'ms bind msgr1': False, 'ms type': 'async', 'ms bind msgr2': True, 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_recovery_max_single_start': 10, 'osd_recovery_max_active': 10}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'osd backoff on peering': True, 'mon osd backfillfull_ratio': 0.85, 'debug journal': 20, 'osd op queue cut off': 'debug_random', 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd debug verify missing on start': True, 'debug ms': 1, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'bdev async discard': True, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd debug verify cached snaps': True, 'osd op queue': 'debug_random', 'osd heartbeat use min delay socket': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}} 2019-10-23T08:34:13.560 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rados': {'op_weights': {'snap_remove': 50, 'write': 100, 'snap_create': 50, 'rollback': 50, 'read': 100, 'delete': 50, 'copy_from': 50}, 'clients': ['client.0'], 'objects': 50, 'ops': 4000}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.17304', 'owner': 'scheduled_sjust@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'targets': {'smithi038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSay8RRKHl6hyM/yoVefaYjw//r9Dn2++40dyF1+V3VAhuGIGPUfq6mlEBasCDma+WXZpngodPu1VAihHz353WeCUjwhPOc6021BlKg6kXkWS8FFXLjqcRZ2Vshdo30HdYR8pJmkQD2qjqtOVOBH2gIQCNKAPszEUwhEacmFZF5VD1CnmO4SRuMG32WUNCPlD3/VUyR++8xU+tOsJDssAKTMjo47HCXENz2cZ++hH0cyX2fi0W/gMoTWR8wD4rbKP+ETlwkmGitGj+CsEYEYvU3vE+2YJnvWJ5evOTizvLTv+hURnMgbcPAgWsXMq/W2BAwqZcqX8J2qmUxSbOpgrL', 'smithi062.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSgWQejVaUiCNSgXu+Q8J4Rk7qRrkt7vCHePdxgHgdNt/dMTihayyyXohuwCikobvgXs5+75tRwdPdNbjJofG3OBSmNrpNVWAXceBPdI6nct7xulSo170MIfOySbgF/49+oPn1lsFOgC001erY7PRQhzbRCIOqYioypedMkmYk5EWK8yLm+w7iddrtCFTP2SGfXVJJj2Cbr7jm6O7Pv0MbybCUPhNeuHYAT/I1eLemT1t+//9fi1VxZ5shUrEWBYzlwTVROb7EOinjiBolBhmyGy8lp3gE0qR+9wdzxoCYEvtSTSwUqh6T+01sMyfZVBzqucbswvpZuJb/vNfe9Ejz'}, 'job_id': '4435270', 'tube': 'smithi', 'suite_branch': 'wip-sjust-testing2', 'priority': 90, 'os_version': '7.6', 'first_in_suite': False, 'branch': 'wip-sjust-testing2', 'suite': 'rados', 'email': None, 'archive_path': '/home/teuthworker/archive/sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi/4435270', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198', 'name': 'sjust-2019-10-22_23:27:55-rados-wip-sjust-testing2-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198', 'os_type': 'centos', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow requests'], 'conf': {'global': {'osd_pool_default_size': 2, 'osd_pool_default_min_size': 2, 'ms bind msgr1': False, 'ms type': 'async', 'ms bind msgr2': True, 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_recovery_max_single_start': 10, 'osd_recovery_max_active': 10}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'osd backoff on peering': True, 'mon osd backfillfull_ratio': 0.85, 'debug journal': 20, 'osd op queue cut off': 'debug_random', 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd debug verify missing on start': True, 'debug ms': 1, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'bdev async discard': True, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd debug verify cached snaps': True, 'osd op queue': 'debug_random', 'osd heartbeat use min delay socket': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}, 'fs': 'xfs', 'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198'}}, 'admin_socket': {'branch': 'wip-sjust-testing2'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'workunit': {'sha1': '1214c80e358aa5969cb9e43aaf279e75b8989198', 'branch': 'wip-sjust-testing2'}}} 2019-10-23T08:34:13.561 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:13.561 INFO:teuthology.orchestra.run.smithi038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-10-23T08:34:13.567 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:13.567 INFO:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-10-23T08:34:13.658 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:13.658 INFO:teuthology.orchestra.run.smithi038:> sudo install -d -m0777 -- /var/run/ceph 2019-10-23T08:34:13.664 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:13.664 INFO:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2019-10-23T08:34:13.871 DEBUG:teuthology.orchestra.remote:smithi038:/scratch_devs is 72B 2019-10-23T08:34:13.957 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-10-23T08:34:13.957 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:13.957 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-10-23T08:34:14.036 INFO:teuthology.orchestra.run.smithi038.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-10-23T08:34:14.036 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.036 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 117859 Links: 1 2019-10-23T08:34:14.036 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.036 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.037 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2019-10-23 08:32:49.141573121 +0000 2019-10-23T08:34:14.037 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2019-10-23 08:31:00.611957422 +0000 2019-10-23T08:34:14.037 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2019-10-23 08:31:00.611957422 +0000 2019-10-23T08:34:14.037 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2019-10-23T08:34:14.066 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2019-10-23T08:34:14.066 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2019-10-23T08:34:14.066 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes (512 B) copied, 0.000443945 s, 1.2 MB/s 2019-10-23T08:34:14.072 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:14.072 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-10-23T08:34:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-10-23T08:34:14.141 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.141 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 118882 Links: 1 2019-10-23T08:34:14.142 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.142 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.142 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2019-10-23 08:32:49.142573121 +0000 2019-10-23T08:34:14.142 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2019-10-23 08:31:01.097947417 +0000 2019-10-23T08:34:14.142 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2019-10-23 08:31:01.097947417 +0000 2019-10-23T08:34:14.142 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2019-10-23T08:34:14.167 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2019-10-23T08:34:14.167 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2019-10-23T08:34:14.168 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes (512 B) copied, 0.000478661 s, 1.1 MB/s 2019-10-23T08:34:14.172 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:14.172 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-10-23T08:34:14.247 INFO:teuthology.orchestra.run.smithi038.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-10-23T08:34:14.247 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.247 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 111209 Links: 1 2019-10-23T08:34:14.247 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.247 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.248 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2019-10-23 08:32:49.142573121 +0000 2019-10-23T08:34:14.248 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2019-10-23 08:31:01.592937225 +0000 2019-10-23T08:34:14.248 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2019-10-23 08:31:01.592937225 +0000 2019-10-23T08:34:14.248 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2019-10-23T08:34:14.281 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2019-10-23T08:34:14.281 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2019-10-23T08:34:14.282 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes (512 B) copied, 0.000422101 s, 1.2 MB/s 2019-10-23T08:34:14.282 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:14.282 INFO:teuthology.orchestra.run.smithi038:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-10-23T08:34:14.364 INFO:teuthology.orchestra.run.smithi038.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-10-23T08:34:14.365 INFO:teuthology.orchestra.run.smithi038.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.365 INFO:teuthology.orchestra.run.smithi038.stdout:Device: 5h/5d Inode: 110145 Links: 1 2019-10-23T08:34:14.365 INFO:teuthology.orchestra.run.smithi038.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.366 INFO:teuthology.orchestra.run.smithi038.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.366 INFO:teuthology.orchestra.run.smithi038.stdout:Access: 2019-10-23 08:32:49.142573121 +0000 2019-10-23T08:34:14.366 INFO:teuthology.orchestra.run.smithi038.stdout:Modify: 2019-10-23 08:31:02.083927116 +0000 2019-10-23T08:34:14.366 INFO:teuthology.orchestra.run.smithi038.stdout:Change: 2019-10-23 08:31:02.083927116 +0000 2019-10-23T08:34:14.366 INFO:teuthology.orchestra.run.smithi038.stdout: Birth: - 2019-10-23T08:34:14.393 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records in 2019-10-23T08:34:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:1+0 records out 2019-10-23T08:34:14.394 INFO:teuthology.orchestra.run.smithi038.stderr:512 bytes (512 B) copied, 0.000447268 s, 1.1 MB/s 2019-10-23T08:34:14.399 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-10-23T08:34:14.399 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-10-23T08:34:14.399 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-10-23T08:34:14.399 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:14.498 DEBUG:teuthology.orchestra.remote:smithi062:/scratch_devs is 72B 2019-10-23T08:34:14.593 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-10-23T08:34:14.594 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:14.594 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-10-23T08:34:14.680 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 113115 Links: 1 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-10-23 08:32:49.580598889 +0000 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-10-23 08:31:00.702112483 +0000 2019-10-23T08:34:14.681 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-10-23 08:31:00.702112483 +0000 2019-10-23T08:34:14.682 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-10-23T08:34:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-10-23T08:34:14.708 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-10-23T08:34:14.709 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000395153 s, 1.3 MB/s 2019-10-23T08:34:14.713 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:14.714 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-10-23T08:34:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-10-23T08:34:14.778 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.779 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 113157 Links: 1 2019-10-23T08:34:14.779 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.779 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.779 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-10-23 08:32:49.580598889 +0000 2019-10-23T08:34:14.780 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-10-23 08:31:01.178105010 +0000 2019-10-23T08:34:14.780 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-10-23 08:31:01.178105010 +0000 2019-10-23T08:34:14.780 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-10-23T08:34:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-10-23T08:34:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-10-23T08:34:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000347332 s, 1.5 MB/s 2019-10-23T08:34:14.804 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:14.804 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-10-23T08:34:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-10-23T08:34:14.875 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.875 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 105325 Links: 1 2019-10-23T08:34:14.875 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.875 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.876 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-10-23 08:32:49.580598889 +0000 2019-10-23T08:34:14.876 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-10-23 08:31:01.656097507 +0000 2019-10-23T08:34:14.876 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-10-23 08:31:01.656097507 +0000 2019-10-23T08:34:14.876 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-10-23T08:34:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-10-23T08:34:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-10-23T08:34:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000370301 s, 1.4 MB/s 2019-10-23T08:34:14.915 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:14.915 INFO:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-10-23T08:34:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-10-23T08:34:14.978 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-10-23T08:34:14.978 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 116954 Links: 1 2019-10-23T08:34:14.978 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-10-23T08:34:14.978 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2019-10-23T08:34:14.979 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2019-10-23 08:32:49.580598889 +0000 2019-10-23T08:34:14.979 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2019-10-23 08:31:02.149089768 +0000 2019-10-23T08:34:14.979 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2019-10-23 08:31:02.149089768 +0000 2019-10-23T08:34:14.979 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2019-10-23T08:34:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2019-10-23T08:34:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2019-10-23T08:34:15.004 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes (512 B) copied, 0.000470977 s, 1.1 MB/s 2019-10-23T08:34:15.008 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-10-23T08:34:15.008 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-10-23T08:34:15.008 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-10-23T08:34:15.008 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:15.009 INFO:tasks.ceph:Generating config... 2019-10-23T08:34:15.010 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2019-10-23T08:34:15.010 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2019-10-23T08:34:15.010 INFO:tasks.ceph:[global] ms bind msgr1 = False 2019-10-23T08:34:15.010 INFO:tasks.ceph:[global] ms type = async 2019-10-23T08:34:15.010 INFO:tasks.ceph:[global] ms bind msgr2 = True 2019-10-23T08:34:15.010 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-10-23T08:34:15.011 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-10-23T08:34:15.011 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2019-10-23T08:34:15.011 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2019-10-23T08:34:15.011 INFO:tasks.ceph:[mon] debug mon = 20 2019-10-23T08:34:15.011 INFO:tasks.ceph:[mon] debug paxos = 20 2019-10-23T08:34:15.011 INFO:tasks.ceph:[mon] debug ms = 1 2019-10-23T08:34:15.011 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-10-23T08:34:15.011 INFO:tasks.ceph:[osd] osd backoff on peering = True 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] debug journal = 20 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] debug osd = 25 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-10-23T08:34:15.012 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] debug ms = 1 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] bdev async discard = True 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2019-10-23T08:34:15.013 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] osd op queue = debug_random 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] debug filestore = 20 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-10-23T08:34:15.014 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-10-23T08:34:15.015 INFO:tasks.ceph:Setting up mon.a... 2019-10-23T08:34:15.015 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:15.015 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-10-23T08:34:15.281 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.keyring 2019-10-23T08:34:15.286 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:15.286 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-10-23T08:34:15.432 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:15.432 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-10-23T08:34:15.555 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.38'), ('mon.c', '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]'), ('mon.b', '172.21.15.62')] 2019-10-23T08:34:15.556 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:15.556 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.38 --addv c '[v2:172.21.15.38:3301,v1:172.21.15.38:6790]' --add b 172.21.15.62 --print /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:15.694 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:15.695 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: generated fsid c18bce92-1bdb-468d-aa17-3a91fd33942e 2019-10-23T08:34:15.695 INFO:teuthology.orchestra.run.smithi038.stdout:epoch 0 2019-10-23T08:34:15.695 INFO:teuthology.orchestra.run.smithi038.stdout:fsid c18bce92-1bdb-468d-aa17-3a91fd33942e 2019-10-23T08:34:15.695 INFO:teuthology.orchestra.run.smithi038.stdout:last_changed 2019-10-23T08:34:15.695887+0000 2019-10-23T08:34:15.695 INFO:teuthology.orchestra.run.smithi038.stdout:created 2019-10-23T08:34:15.695887+0000 2019-10-23T08:34:15.695 INFO:teuthology.orchestra.run.smithi038.stdout:min_mon_release 0 (unknown) 2019-10-23T08:34:15.696 INFO:teuthology.orchestra.run.smithi038.stdout:0: [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] mon.a 2019-10-23T08:34:15.696 INFO:teuthology.orchestra.run.smithi038.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2019-10-23T08:34:15.696 INFO:teuthology.orchestra.run.smithi038.stdout:2: [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] mon.c 2019-10-23T08:34:15.696 INFO:teuthology.orchestra.run.smithi038.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-10-23T08:34:15.697 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c18bce92-1bdb-468d-aa17-3a91fd33942e... 2019-10-23T08:34:15.698 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:15.698 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-10-23T08:34:15.703 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:15.704 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-10-23T08:34:15.932 INFO:tasks.ceph:Creating admin key on mon.a... 2019-10-23T08:34:15.932 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:15.933 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-10-23T08:34:16.096 INFO:tasks.ceph:Copying monmap to all nodes... 2019-10-23T08:34:16.187 DEBUG:teuthology.orchestra.remote:smithi038:/etc/ceph/ceph.keyring is 206B 2019-10-23T08:34:16.357 DEBUG:teuthology.orchestra.remote:smithi038:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-10-23T08:34:16.432 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:34:16.433 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:16.433 INFO:teuthology.orchestra.run.smithi038:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-10-23T08:34:16.554 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:16.554 INFO:teuthology.orchestra.run.smithi038:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:16.618 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:34:16.619 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:16.619 INFO:teuthology.orchestra.run.smithi062:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-10-23T08:34:16.773 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:16.773 INFO:teuthology.orchestra.run.smithi062:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:16.855 INFO:tasks.ceph:Setting up mon nodes... 2019-10-23T08:34:16.855 INFO:tasks.ceph:Setting up mgr nodes... 2019-10-23T08:34:16.855 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:16.855 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-10-23T08:34:17.036 INFO:teuthology.orchestra.run.smithi038.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-10-23T08:34:17.041 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:17.041 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-10-23T08:34:17.278 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-10-23T08:34:17.283 INFO:tasks.ceph:Setting up mds nodes... 2019-10-23T08:34:17.284 INFO:tasks.ceph_client:Setting up client nodes... 2019-10-23T08:34:17.284 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:17.284 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-10-23T08:34:17.444 INFO:teuthology.orchestra.run.smithi038.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-10-23T08:34:17.480 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:17.481 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-10-23T08:34:17.639 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-10-23T08:34:17.676 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-10-23T08:34:17.676 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi038.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-10-23T08:34:17.677 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:17.677 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-10-23T08:34:17.798 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:17.798 INFO:tasks.ceph:{} 2019-10-23T08:34:17.798 INFO:tasks.ceph:osd.0 2019-10-23T08:34:17.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:34:17.798 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:17.798 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-10-23T08:34:19.239 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:19.239 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:19.239 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:19.239 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:19.239 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:19.240 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:19.240 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:19.240 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:19.240 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:19.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2019-10-23T08:34:19.243 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:19.243 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-10-23T08:34:19.388 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:19.388 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-10-23T08:34:19.495 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:19.495 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-10-23T08:34:19.580 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:19.580 INFO:tasks.ceph:{} 2019-10-23T08:34:19.581 INFO:tasks.ceph:osd.1 2019-10-23T08:34:19.581 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:34:19.581 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:19.581 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-10-23T08:34:20.987 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:20.987 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:20.988 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:20.988 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:20.988 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:20.988 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:20.989 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:20.989 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:20.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2019-10-23T08:34:20.995 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:20.995 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-10-23T08:34:21.131 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:21.132 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-10-23T08:34:21.223 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:21.224 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-10-23T08:34:21.325 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:21.326 INFO:tasks.ceph:{} 2019-10-23T08:34:21.326 INFO:tasks.ceph:osd.2 2019-10-23T08:34:21.326 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:34:21.326 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:21.327 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-10-23T08:34:22.755 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:22.758 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:22.758 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:22.758 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:22.759 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:22.759 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:22.759 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:22.759 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:22.759 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:22.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2019-10-23T08:34:22.760 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:22.760 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-10-23T08:34:22.893 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:22.893 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-10-23T08:34:23.002 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:23.002 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-10-23T08:34:23.085 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:23.085 INFO:tasks.ceph:{} 2019-10-23T08:34:23.085 INFO:tasks.ceph:osd.3 2019-10-23T08:34:23.086 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com 2019-10-23T08:34:23.086 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:23.086 INFO:teuthology.orchestra.run.smithi038:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-10-23T08:34:24.489 INFO:teuthology.orchestra.run.smithi038.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:24.490 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:24.490 INFO:teuthology.orchestra.run.smithi038.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:24.490 INFO:teuthology.orchestra.run.smithi038.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:24.490 INFO:teuthology.orchestra.run.smithi038.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:24.490 INFO:teuthology.orchestra.run.smithi038.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:24.491 INFO:teuthology.orchestra.run.smithi038.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:24.491 INFO:teuthology.orchestra.run.smithi038.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:24.491 INFO:teuthology.orchestra.run.smithi038.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:24.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi038.front.sepia.ceph.com -o noatime 2019-10-23T08:34:24.493 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:24.493 INFO:teuthology.orchestra.run.smithi038:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-10-23T08:34:24.635 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:24.635 INFO:teuthology.orchestra.run.smithi038:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-10-23T08:34:24.754 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:24.754 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:24.926 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:24.926+0000 7fc454271bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-10-23T08:34:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:24.927+0000 7fc454271bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-10-23T08:34:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:24.927+0000 7fc454271bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-10-23T08:34:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:24.927+0000 7fc454271bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-10-23T08:34:24.927 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:24.927+0000 7fc454271bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-10-23T08:34:24.929 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:24.928+0000 7fc454271bc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-10-23T08:34:27.236 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:27.236 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-10-23T08:34:27.367 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:27.367 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:27.501 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:27.501+0000 7fd353da0bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-10-23T08:34:27.502 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:27.502+0000 7fd353da0bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-10-23T08:34:27.502 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:27.502+0000 7fd353da0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-10-23T08:34:27.502 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:27.502+0000 7fd353da0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-10-23T08:34:27.502 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:27.502+0000 7fd353da0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-10-23T08:34:27.503 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:27.503+0000 7fd353da0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-10-23T08:34:29.811 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:29.811 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-10-23T08:34:29.935 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:29.935 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:30.099 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:30.099+0000 7ff80c736bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-10-23T08:34:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:30.100+0000 7ff80c736bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-10-23T08:34:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:30.100+0000 7ff80c736bc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-10-23T08:34:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:30.100+0000 7ff80c736bc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-10-23T08:34:30.100 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:30.100+0000 7ff80c736bc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-10-23T08:34:30.101 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:30.101+0000 7ff80c736bc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-10-23T08:34:32.418 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:32.418 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-10-23T08:34:32.537 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:32.537 INFO:teuthology.orchestra.run.smithi038:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:32.691 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:32.691+0000 7f2ea35fbbc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-10-23T08:34:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:32.692+0000 7f2ea35fbbc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-10-23T08:34:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:32.692+0000 7f2ea35fbbc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-10-23T08:34:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:32.692+0000 7f2ea35fbbc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-10-23T08:34:32.692 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:32.692+0000 7f2ea35fbbc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-10-23T08:34:32.693 INFO:teuthology.orchestra.run.smithi038.stderr:2019-10-23T08:34:32.693+0000 7f2ea35fbbc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-10-23T08:34:35.011 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:35.011 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-10-23T08:34:35.131 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:35.131 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-10-23T08:34:35.256 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:35.256 INFO:tasks.ceph:{} 2019-10-23T08:34:35.257 INFO:tasks.ceph:osd.4 2019-10-23T08:34:35.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:34:35.257 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:35.257 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-10-23T08:34:35.840 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:35.840 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:35.841 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:35.841 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:35.841 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:35.841 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:35.842 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:35.842 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:35.842 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:35.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-10-23T08:34:35.844 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:35.845 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-10-23T08:34:36.016 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:36.017 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-10-23T08:34:36.112 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:36.113 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-10-23T08:34:36.188 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:36.188 INFO:tasks.ceph:{} 2019-10-23T08:34:36.188 INFO:tasks.ceph:osd.5 2019-10-23T08:34:36.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:34:36.189 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:36.189 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-10-23T08:34:36.724 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:36.724 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:36.725 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:36.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-10-23T08:34:36.727 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:36.727 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-10-23T08:34:36.850 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:36.850 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-10-23T08:34:36.941 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:36.941 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-10-23T08:34:37.013 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:37.013 INFO:tasks.ceph:{} 2019-10-23T08:34:37.014 INFO:tasks.ceph:osd.6 2019-10-23T08:34:37.014 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:34:37.014 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:37.014 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-10-23T08:34:37.618 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:37.618 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:37.619 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:37.621 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-10-23T08:34:37.622 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:37.622 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-10-23T08:34:37.792 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:37.793 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-10-23T08:34:37.910 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:37.911 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-10-23T08:34:38.023 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-10-23T08:34:38.023 INFO:tasks.ceph:{} 2019-10-23T08:34:38.023 INFO:tasks.ceph:osd.7 2019-10-23T08:34:38.023 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2019-10-23T08:34:38.024 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:38.024 INFO:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-10-23T08:34:38.554 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-10-23T08:34:38.555 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2019-10-23T08:34:38.555 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=0, sparse=0 2019-10-23T08:34:38.555 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-10-23T08:34:38.555 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2019-10-23T08:34:38.555 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-10-23T08:34:38.555 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-10-23T08:34:38.556 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-10-23T08:34:38.556 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-10-23T08:34:38.557 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2019-10-23T08:34:38.557 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:38.557 INFO:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-10-23T08:34:38.682 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:38.682 INFO:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-10-23T08:34:38.762 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:38.762 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:38.879+0000 7fda40b32bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-10-23T08:34:38.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:38.881+0000 7fda40b32bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-10-23T08:34:38.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:38.881+0000 7fda40b32bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-10-23T08:34:38.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:38.881+0000 7fda40b32bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-10-23T08:34:38.882 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:38.881+0000 7fda40b32bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-10-23T08:34:38.884 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:38.884+0000 7fda40b32bc0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-10-23T08:34:41.188 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:41.188 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-10-23T08:34:41.322 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:41.322 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:41.466 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:41.465+0000 7f2cb84e6bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-10-23T08:34:41.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:41.466+0000 7f2cb84e6bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-10-23T08:34:41.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:41.466+0000 7f2cb84e6bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-10-23T08:34:41.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:41.466+0000 7f2cb84e6bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-10-23T08:34:41.467 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:41.466+0000 7f2cb84e6bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-10-23T08:34:41.468 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:41.467+0000 7f2cb84e6bc0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-10-23T08:34:43.771 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:43.771 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-10-23T08:34:43.892 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:43.892 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:44.034 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:44.033+0000 7f2ce791ebc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-10-23T08:34:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:44.034+0000 7f2ce791ebc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-10-23T08:34:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:44.034+0000 7f2ce791ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-10-23T08:34:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:44.034+0000 7f2ce791ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-10-23T08:34:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:44.034+0000 7f2ce791ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-10-23T08:34:44.035 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:44.035+0000 7f2ce791ebc0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-10-23T08:34:46.337 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:46.337 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-10-23T08:34:46.456 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:46.457 INFO:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:46.622 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:46.621+0000 7f23366a0bc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-10-23T08:34:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:46.622+0000 7f23366a0bc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-10-23T08:34:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:46.622+0000 7f23366a0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-10-23T08:34:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:46.622+0000 7f23366a0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-10-23T08:34:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:46.622+0000 7f23366a0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-10-23T08:34:46.623 INFO:teuthology.orchestra.run.smithi062.stderr:2019-10-23T08:34:46.623+0000 7f23366a0bc0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-10-23T08:34:48.923 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:48.923 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-10-23T08:34:49.048 INFO:tasks.ceph:Reading keys from all nodes... 2019-10-23T08:34:49.048 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.048 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:34:49.140 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.IpGLfhrRNJ 2019-10-23T08:34:49.140 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.141 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.IpGLfhrRNJ 2019-10-23T08:34:49.264 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.264 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.IpGLfhrRNJ 2019-10-23T08:34:49.478 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.IpGLfhrRNJ is 56B 2019-10-23T08:34:49.578 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.578 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.IpGLfhrRNJ 2019-10-23T08:34:49.661 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.661 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:34:49.733 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.LUf0iQpNXH 2019-10-23T08:34:49.733 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.733 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.LUf0iQpNXH 2019-10-23T08:34:49.827 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:49.827 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.LUf0iQpNXH 2019-10-23T08:34:50.007 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.LUf0iQpNXH is 56B 2019-10-23T08:34:50.084 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.084 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.LUf0iQpNXH 2019-10-23T08:34:50.156 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.156 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:34:50.226 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.PZnqH8q27q 2019-10-23T08:34:50.226 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.226 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.PZnqH8q27q 2019-10-23T08:34:50.320 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.320 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.PZnqH8q27q 2019-10-23T08:34:50.485 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.PZnqH8q27q is 56B 2019-10-23T08:34:50.567 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.567 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.PZnqH8q27q 2019-10-23T08:34:50.636 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.636 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:34:50.789 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.DvQAFIPgwA 2019-10-23T08:34:50.789 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.789 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.DvQAFIPgwA 2019-10-23T08:34:50.903 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:50.904 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.DvQAFIPgwA 2019-10-23T08:34:51.103 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.DvQAFIPgwA is 56B 2019-10-23T08:34:51.187 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:51.187 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.DvQAFIPgwA 2019-10-23T08:34:51.274 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:51.274 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:34:51.358 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.deBewSpJ79 2019-10-23T08:34:51.358 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:51.358 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.deBewSpJ79 2019-10-23T08:34:51.479 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:51.480 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.deBewSpJ79 2019-10-23T08:34:51.695 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.deBewSpJ79 is 56B 2019-10-23T08:34:51.791 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:51.791 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.deBewSpJ79 2019-10-23T08:34:51.876 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:51.876 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:34:51.972 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.HN0HD0gPdV 2019-10-23T08:34:51.973 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:51.973 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.HN0HD0gPdV 2019-10-23T08:34:52.093 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.093 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.HN0HD0gPdV 2019-10-23T08:34:52.291 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.HN0HD0gPdV is 56B 2019-10-23T08:34:52.372 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.372 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.HN0HD0gPdV 2019-10-23T08:34:52.451 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.451 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:34:52.525 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.waSVdcRgXT 2019-10-23T08:34:52.525 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.526 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.waSVdcRgXT 2019-10-23T08:34:52.627 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.627 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.waSVdcRgXT 2019-10-23T08:34:52.795 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.waSVdcRgXT is 56B 2019-10-23T08:34:52.865 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.865 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.waSVdcRgXT 2019-10-23T08:34:52.945 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:52.945 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:34:53.021 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.Nrb7gRdqYX 2019-10-23T08:34:53.021 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.022 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.Nrb7gRdqYX 2019-10-23T08:34:53.118 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.118 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.Nrb7gRdqYX 2019-10-23T08:34:53.281 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.Nrb7gRdqYX is 56B 2019-10-23T08:34:53.373 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.374 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.Nrb7gRdqYX 2019-10-23T08:34:53.460 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.461 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:34:53.538 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.TxmXxscYyb 2019-10-23T08:34:53.539 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.539 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.TxmXxscYyb 2019-10-23T08:34:53.664 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.664 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.TxmXxscYyb 2019-10-23T08:34:53.853 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.TxmXxscYyb is 56B 2019-10-23T08:34:53.943 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:53.943 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.TxmXxscYyb 2019-10-23T08:34:54.018 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:54.018 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:34:54.107 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.RaS4Kbb4CW 2019-10-23T08:34:54.107 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:54.107 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.RaS4Kbb4CW 2019-10-23T08:34:54.220 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:54.220 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.RaS4Kbb4CW 2019-10-23T08:34:54.428 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.RaS4Kbb4CW is 56B 2019-10-23T08:34:54.526 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:54.527 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.RaS4Kbb4CW 2019-10-23T08:34:54.712 DEBUG:teuthology.orchestra.remote:smithi038:/etc/ceph/ceph.client.0.keyring is 59B 2019-10-23T08:34:54.898 DEBUG:teuthology.orchestra.remote:smithi062:/etc/ceph/ceph.client.1.keyring is 59B 2019-10-23T08:34:54.994 INFO:tasks.ceph:Adding keys to all mons... 2019-10-23T08:34:54.994 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:54.995 INFO:teuthology.orchestra.run.smithi038:> sudo tee -a /etc/ceph/ceph.keyring 2019-10-23T08:34:54.999 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:54.999 INFO:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2019-10-23T08:34:55.105 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2019-10-23T08:34:55.105 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCJELBd7HpDAhAAc9yyRSXKgq4ht6+riA/25A== 2019-10-23T08:34:55.105 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2019-10-23T08:34:55.105 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCQELBduY1DNxAA4XJHiWyhln14vR6kRytRrw== 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTELBds573HRAA663dz4IIT2xTuFwdsK8sZQ== 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCWELBdYs3/BRAAoHVqa54r1qZic5ufAbX+TA== 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCYELBdQeRMKRAA9+mcTsctbuOg8n3cSuRd/w== 2019-10-23T08:34:55.106 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCJELBdKlScEBAA2SVINCK5HEtA7Y24RlTDpg== 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCeELBdOqeBNBAAhUW/9mlKU2Qm/G9KpVRNaA== 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQChELBdICzYGxAAyzcl1bsmR0Ays9eCSr0FCA== 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2019-10-23T08:34:55.107 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCkELBd7dYVAhAAWbMrXaIOhsOlycfMJsu4YQ== 2019-10-23T08:34:55.108 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2019-10-23T08:34:55.108 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCmELBd9uglJRAASHfRjWpnBnLGblF433tivA== 2019-10-23T08:34:55.108 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2019-10-23T08:34:55.108 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCJELBd3VKSGhAAX/+GvDDyrk6M71j0tW5FDg== 2019-10-23T08:34:55.108 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2019-10-23T08:34:55.109 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCJELBddr8eJhAASNZAYqC+0VmGXHXflBdo3Q== 2019-10-23T08:34:55.109 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.y] 2019-10-23T08:34:55.110 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCJELBd7HpDAhAAc9yyRSXKgq4ht6+riA/25A== 2019-10-23T08:34:55.110 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.0] 2019-10-23T08:34:55.110 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCQELBduY1DNxAA4XJHiWyhln14vR6kRytRrw== 2019-10-23T08:34:55.110 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.1] 2019-10-23T08:34:55.110 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCTELBds573HRAA663dz4IIT2xTuFwdsK8sZQ== 2019-10-23T08:34:55.110 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.2] 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCWELBdYs3/BRAAoHVqa54r1qZic5ufAbX+TA== 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.3] 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCYELBdQeRMKRAA9+mcTsctbuOg8n3cSuRd/w== 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout:[mgr.x] 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCJELBdKlScEBAA2SVINCK5HEtA7Y24RlTDpg== 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.4] 2019-10-23T08:34:55.111 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCeELBdOqeBNBAAhUW/9mlKU2Qm/G9KpVRNaA== 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.5] 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQChELBdICzYGxAAyzcl1bsmR0Ays9eCSr0FCA== 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.6] 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCkELBd7dYVAhAAWbMrXaIOhsOlycfMJsu4YQ== 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout:[osd.7] 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCmELBd9uglJRAASHfRjWpnBnLGblF433tivA== 2019-10-23T08:34:55.112 INFO:teuthology.orchestra.run.smithi038.stdout:[client.0] 2019-10-23T08:34:55.113 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCJELBd3VKSGhAAX/+GvDDyrk6M71j0tW5FDg== 2019-10-23T08:34:55.113 INFO:teuthology.orchestra.run.smithi038.stdout:[client.1] 2019-10-23T08:34:55.113 INFO:teuthology.orchestra.run.smithi038.stdout: key = AQCJELBddr8eJhAASNZAYqC+0VmGXHXflBdo3Q== 2019-10-23T08:34:55.114 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:55.115 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-10-23T08:34:55.119 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:55.119 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-10-23T08:34:55.291 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:55.291 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.295 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:55.295 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.460 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:55.461 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.465 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:55.465 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.633 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:55.633 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.638 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:55.638 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.812 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:55.812 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.817 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:55.817 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:55.988 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:55.988 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-10-23T08:34:55.992 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:55.993 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-10-23T08:34:56.148 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:56.148 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.152 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:56.153 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.325 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:56.326 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.330 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:56.330 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.502 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:56.503 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.508 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:56.508 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.672 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:56.672 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.677 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:56.677 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-10-23T08:34:56.842 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:56.842 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-10-23T08:34:56.846 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:56.846 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-10-23T08:34:57.022 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.022 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-10-23T08:34:57.027 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:57.027 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-10-23T08:34:57.211 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-10-23T08:34:57.211 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.212 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-10-23T08:34:57.332 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.332 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-10-23T08:34:57.521 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.521 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-10-23T08:34:57.630 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.630 INFO:teuthology.orchestra.run.smithi038:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-10-23T08:34:57.735 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.735 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-10-23T08:34:57.916 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:57.917 INFO:teuthology.orchestra.run.smithi038:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-10-23T08:34:58.035 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.036 INFO:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-10-23T08:34:58.160 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.160 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-10-23T08:34:58.338 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.338 INFO:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-10-23T08:34:58.447 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:58.448 INFO:teuthology.orchestra.run.smithi038:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:58.452 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.453 INFO:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-10-23T08:34:58.539 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-10-23T08:34:58.539 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:58.539 INFO:teuthology.orchestra.run.smithi038:> which systemctl 2019-10-23T08:34:58.625 INFO:teuthology.orchestra.run.smithi038.stdout:/usr/bin/systemctl 2019-10-23T08:34:58.626 INFO:tasks.ceph.mon.a:Restarting daemon 2019-10-23T08:34:58.626 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:58.626 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2019-10-23T08:34:58.632 INFO:tasks.ceph.mon.a:Started 2019-10-23T08:34:58.632 INFO:tasks.ceph.mon.c:Restarting daemon 2019-10-23T08:34:58.632 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:58.632 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2019-10-23T08:34:58.637 INFO:tasks.ceph.mon.c:Started 2019-10-23T08:34:58.637 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.637 INFO:teuthology.orchestra.run.smithi062:> which systemctl 2019-10-23T08:34:58.733 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/systemctl 2019-10-23T08:34:58.733 INFO:tasks.ceph.mon.b:Restarting daemon 2019-10-23T08:34:58.734 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.734 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2019-10-23T08:34:58.739 INFO:tasks.ceph.mon.b:Started 2019-10-23T08:34:58.739 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-10-23T08:34:58.739 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-10-23T08:34:58.739 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:58.740 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2019-10-23T08:34:58.743 INFO:tasks.ceph.mgr.y:Started 2019-10-23T08:34:58.744 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-10-23T08:34:58.744 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:34:58.744 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2019-10-23T08:34:58.748 INFO:tasks.ceph.mgr.x:Started 2019-10-23T08:34:58.748 INFO:tasks.ceph:Setting crush tunables to default 2019-10-23T08:34:58.749 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:34:58.749 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd crush tunables default 2019-10-23T08:35:04.322 INFO:teuthology.orchestra.run.smithi038.stderr:adjusted tunables profile to default 2019-10-23T08:35:04.339 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-10-23T08:35:04.340 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.340 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:35:04.409 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.kmvO71zSQT 2019-10-23T08:35:04.409 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.409 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.kmvO71zSQT 2019-10-23T08:35:04.490 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.490 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.kmvO71zSQT 2019-10-23T08:35:04.614 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.kmvO71zSQT is 37B 2019-10-23T08:35:04.664 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.664 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.kmvO71zSQT 2019-10-23T08:35:04.713 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.713 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:35:04.802 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.9UXZ3lQCd2 2019-10-23T08:35:04.803 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.803 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.9UXZ3lQCd2 2019-10-23T08:35:04.860 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:04.860 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.9UXZ3lQCd2 2019-10-23T08:35:04.961 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.9UXZ3lQCd2 is 37B 2019-10-23T08:35:05.010 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.011 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.9UXZ3lQCd2 2019-10-23T08:35:05.063 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.063 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:35:05.147 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.dlm6P3cTgU 2019-10-23T08:35:05.148 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.148 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.dlm6P3cTgU 2019-10-23T08:35:05.216 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.216 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.dlm6P3cTgU 2019-10-23T08:35:05.327 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.dlm6P3cTgU is 37B 2019-10-23T08:35:05.374 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.374 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.dlm6P3cTgU 2019-10-23T08:35:05.424 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.424 INFO:teuthology.orchestra.run.smithi038:> mktemp 2019-10-23T08:35:05.564 INFO:teuthology.orchestra.run.smithi038.stdout:/tmp/tmp.YYcjrL0Ilv 2019-10-23T08:35:05.564 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.565 INFO:teuthology.orchestra.run.smithi038:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.YYcjrL0Ilv 2019-10-23T08:35:05.639 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.639 INFO:teuthology.orchestra.run.smithi038:> sudo chmod 0666 /tmp/tmp.YYcjrL0Ilv 2019-10-23T08:35:05.749 DEBUG:teuthology.orchestra.remote:smithi038:/tmp/tmp.YYcjrL0Ilv is 37B 2019-10-23T08:35:05.796 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:05.796 INFO:teuthology.orchestra.run.smithi038:> rm -fr /tmp/tmp.YYcjrL0Ilv 2019-10-23T08:35:05.844 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:05.844 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:35:05.927 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.OJQa3bhq2e 2019-10-23T08:35:05.927 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:05.927 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.OJQa3bhq2e 2019-10-23T08:35:05.998 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:05.998 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.OJQa3bhq2e 2019-10-23T08:35:06.125 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.OJQa3bhq2e is 37B 2019-10-23T08:35:06.180 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.181 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.OJQa3bhq2e 2019-10-23T08:35:06.251 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.251 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:35:06.410 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.SNbGos5Mod 2019-10-23T08:35:06.410 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.411 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.SNbGos5Mod 2019-10-23T08:35:06.526 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.526 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.SNbGos5Mod 2019-10-23T08:35:06.731 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.SNbGos5Mod is 37B 2019-10-23T08:35:06.823 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.824 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.SNbGos5Mod 2019-10-23T08:35:06.902 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.903 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:35:06.988 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.DK64mFa5Lq 2019-10-23T08:35:06.989 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:06.989 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.DK64mFa5Lq 2019-10-23T08:35:07.107 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.108 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.DK64mFa5Lq 2019-10-23T08:35:07.284 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.DK64mFa5Lq is 37B 2019-10-23T08:35:07.369 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.370 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.DK64mFa5Lq 2019-10-23T08:35:07.456 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.457 INFO:teuthology.orchestra.run.smithi062:> mktemp 2019-10-23T08:35:07.547 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.gLQWhdQroI 2019-10-23T08:35:07.547 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.548 INFO:teuthology.orchestra.run.smithi062:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.gLQWhdQroI 2019-10-23T08:35:07.651 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.652 INFO:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.gLQWhdQroI 2019-10-23T08:35:07.831 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.gLQWhdQroI is 37B 2019-10-23T08:35:07.910 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.910 INFO:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.gLQWhdQroI 2019-10-23T08:35:07.974 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:07.974 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 467463ce-4116-4ad2-adc8-e2abf62fa42d 0 2019-10-23T08:35:08.452 INFO:teuthology.orchestra.run.smithi062.stdout:0 2019-10-23T08:35:08.466 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:08.466 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 9fb8b15b-b364-4ac4-a320-0738c031733d 1 2019-10-23T08:35:08.990 INFO:teuthology.orchestra.run.smithi062.stdout:1 2019-10-23T08:35:09.005 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:09.005 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new e19778b2-220f-4aad-aeb3-dabd9189cec8 2 2019-10-23T08:35:09.493 INFO:teuthology.orchestra.run.smithi062.stdout:2 2019-10-23T08:35:09.507 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:09.507 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new bcd51059-5407-4205-913e-afbbf311bef5 3 2019-10-23T08:35:10.035 INFO:teuthology.orchestra.run.smithi062.stdout:3 2019-10-23T08:35:10.054 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:10.054 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 9d978767-7a82-4960-9e35-8bb45964feb3 4 2019-10-23T08:35:10.578 INFO:teuthology.orchestra.run.smithi062.stdout:4 2019-10-23T08:35:10.592 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:10.592 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new cdd45766-2f32-4c04-ab92-d004c66880d7 5 2019-10-23T08:35:11.075 INFO:teuthology.orchestra.run.smithi062.stdout:5 2019-10-23T08:35:11.095 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:11.096 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new faa66080-86a2-4b4a-bc16-9f4474cb15a5 6 2019-10-23T08:35:11.645 INFO:teuthology.orchestra.run.smithi062.stdout:6 2019-10-23T08:35:11.665 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:11.665 INFO:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 63075cf6-8497-4d0e-abd1-207fa582152d 7 2019-10-23T08:35:12.177 INFO:teuthology.orchestra.run.smithi062.stdout:7 2019-10-23T08:35:12.189 INFO:tasks.ceph.osd.0:Restarting daemon 2019-10-23T08:35:12.190 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:12.190 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2019-10-23T08:35:12.194 INFO:tasks.ceph.osd.0:Started 2019-10-23T08:35:12.194 INFO:tasks.ceph.osd.1:Restarting daemon 2019-10-23T08:35:12.195 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:12.195 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2019-10-23T08:35:12.199 INFO:tasks.ceph.osd.1:Started 2019-10-23T08:35:12.199 INFO:tasks.ceph.osd.2:Restarting daemon 2019-10-23T08:35:12.199 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:12.199 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2019-10-23T08:35:12.203 INFO:tasks.ceph.osd.2:Started 2019-10-23T08:35:12.203 INFO:tasks.ceph.osd.3:Restarting daemon 2019-10-23T08:35:12.203 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:12.204 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2019-10-23T08:35:12.208 INFO:tasks.ceph.osd.3:Started 2019-10-23T08:35:12.208 INFO:tasks.ceph.osd.4:Restarting daemon 2019-10-23T08:35:12.208 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:12.209 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2019-10-23T08:35:12.213 INFO:tasks.ceph.osd.4:Started 2019-10-23T08:35:12.213 INFO:tasks.ceph.osd.5:Restarting daemon 2019-10-23T08:35:12.213 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:12.213 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2019-10-23T08:35:12.217 INFO:tasks.ceph.osd.5:Started 2019-10-23T08:35:12.217 INFO:tasks.ceph.osd.6:Restarting daemon 2019-10-23T08:35:12.217 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:12.218 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2019-10-23T08:35:12.222 INFO:tasks.ceph.osd.6:Started 2019-10-23T08:35:12.222 INFO:tasks.ceph.osd.7:Restarting daemon 2019-10-23T08:35:12.222 INFO:teuthology.orchestra.run.smithi062:Running: 2019-10-23T08:35:12.222 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2019-10-23T08:35:12.226 INFO:tasks.ceph.osd.7:Started 2019-10-23T08:35:12.226 INFO:tasks.ceph:Waiting for OSDs to come up 2019-10-23T08:35:12.848 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T08:35:12.848+0000 7f0f65990bc0 -1 Falling back to public interface 2019-10-23T08:35:12.849 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T08:35:12.848+0000 7f2d28093bc0 -1 Falling back to public interface 2019-10-23T08:35:12.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:35:12.861+0000 7f6c3e587bc0 -1 Falling back to public interface 2019-10-23T08:35:12.862 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T08:35:12.863+0000 7f4b61642bc0 -1 Falling back to public interface 2019-10-23T08:35:12.865 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:35:12.866+0000 7f4e484d6bc0 -1 Falling back to public interface 2019-10-23T08:35:12.870 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T08:35:12.869+0000 7f9e371c9bc0 -1 Falling back to public interface 2019-10-23T08:35:12.870 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T08:35:12.870+0000 7fa177612bc0 -1 Falling back to public interface 2019-10-23T08:35:12.875 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T08:35:12.874+0000 7fc3e7dbfbc0 -1 Falling back to public interface 2019-10-23T08:35:13.038 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:13.038 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-10-23T08:35:13.461 INFO:teuthology.misc.health.smithi038.stdout: 2019-10-23T08:35:13.461 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":10,"fsid":"c18bce92-1bdb-468d-aa17-3a91fd33942e","created":"2019-10-23T08:35:04.036535+0000","modified":"2019-10-23T08:35:12.165213+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"467463ce-4116-4ad2-adc8-e2abf62fa42d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9fb8b15b-b364-4ac4-a320-0738c031733d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e19778b2-220f-4aad-aeb3-dabd9189cec8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bcd51059-5407-4205-913e-afbbf311bef5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9d978767-7a82-4960-9e35-8bb45964feb3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cdd45766-2f32-4c04-ab92-d004c66880d7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"faa66080-86a2-4b4a-bc16-9f4474cb15a5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"63075cf6-8497-4d0e-abd1-207fa582152d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-10-23T08:35:13.473 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-10-23T08:35:13.904 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T08:35:13.903+0000 7f0f65990bc0 -1 osd.5 0 log_to_monitors {default=true} 2019-10-23T08:35:13.918 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T08:35:13.919+0000 7f2d28093bc0 -1 osd.0 0 log_to_monitors {default=true} 2019-10-23T08:35:13.927 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T08:35:13.927+0000 7fa177612bc0 -1 osd.4 0 log_to_monitors {default=true} 2019-10-23T08:35:13.936 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T08:35:13.936+0000 7f9e371c9bc0 -1 osd.7 0 log_to_monitors {default=true} 2019-10-23T08:35:13.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:35:13.939+0000 7f6c3e587bc0 -1 osd.1 0 log_to_monitors {default=true} 2019-10-23T08:35:13.938 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T08:35:13.939+0000 7f4b61642bc0 -1 osd.3 0 log_to_monitors {default=true} 2019-10-23T08:35:13.940 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:35:13.941+0000 7f4e484d6bc0 -1 osd.2 0 log_to_monitors {default=true} 2019-10-23T08:35:13.942 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T08:35:13.942+0000 7fc3e7dbfbc0 -1 osd.6 0 log_to_monitors {default=true} 2019-10-23T08:35:15.823 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T08:35:15.823+0000 7fa15fc21700 -1 osd.4 0 waiting for initial osdmap 2019-10-23T08:35:15.823 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T08:35:15.823+0000 7f0f4df9f700 -1 osd.5 0 waiting for initial osdmap 2019-10-23T08:35:15.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:35:15.824+0000 7f6c26b96700 -1 osd.1 0 waiting for initial osdmap 2019-10-23T08:35:15.825 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T08:35:15.824+0000 7f4b49c51700 -1 osd.3 0 waiting for initial osdmap 2019-10-23T08:35:15.825 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:35:15.824+0000 7f4e30ae5700 -1 osd.2 0 waiting for initial osdmap 2019-10-23T08:35:15.825 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T08:35:15.825+0000 7f2d106a2700 -1 osd.0 0 waiting for initial osdmap 2019-10-23T08:35:15.825 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T08:35:15.824+0000 7fc3d03ce700 -1 osd.6 0 waiting for initial osdmap 2019-10-23T08:35:15.826 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T08:35:15.824+0000 7f9e1f7d8700 -1 osd.7 0 waiting for initial osdmap 2019-10-23T08:35:20.279 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:20.280 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-10-23T08:35:20.804 INFO:teuthology.misc.health.smithi038.stdout: 2019-10-23T08:35:20.804 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":14,"fsid":"c18bce92-1bdb-468d-aa17-3a91fd33942e","created":"2019-10-23T08:35:04.036535+0000","modified":"2019-10-23T08:35:17.843112+0000","last_up_change":"2019-10-23T08:35:16.817951+0000","last_in_change":"2019-10-23T08:35:16.817951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"467463ce-4116-4ad2-adc8-e2abf62fa42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":12965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6801","nonce":12965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6803","nonce":12965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":12965}]},"public_addr":"172.21.15.38:6800/12965","cluster_addr":"172.21.15.38:6801/12965","heartbeat_back_addr":"172.21.15.38:6803/12965","heartbeat_front_addr":"172.21.15.38:6802/12965","state":["exists","up"]},{"osd":1,"uuid":"9fb8b15b-b364-4ac4-a320-0738c031733d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":12966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6805","nonce":12966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6807","nonce":12966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":12966}]},"public_addr":"172.21.15.38:6804/12966","cluster_addr":"172.21.15.38:6805/12966","heartbeat_back_addr":"172.21.15.38:6807/12966","heartbeat_front_addr":"172.21.15.38:6806/12966","state":["exists","up"]},{"osd":2,"uuid":"e19778b2-220f-4aad-aeb3-dabd9189cec8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":12969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":12969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":12969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":12969}]},"public_addr":"172.21.15.38:6812/12969","cluster_addr":"172.21.15.38:6813/12969","heartbeat_back_addr":"172.21.15.38:6815/12969","heartbeat_front_addr":"172.21.15.38:6814/12969","state":["exists","up"]},{"osd":3,"uuid":"bcd51059-5407-4205-913e-afbbf311bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":12967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":12967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6811","nonce":12967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":12967}]},"public_addr":"172.21.15.38:6808/12967","cluster_addr":"172.21.15.38:6809/12967","heartbeat_back_addr":"172.21.15.38:6811/12967","heartbeat_front_addr":"172.21.15.38:6810/12967","state":["exists","up"]},{"osd":4,"uuid":"9d978767-7a82-4960-9e35-8bb45964feb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":13122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":13122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":13122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":13122}]},"public_addr":"172.21.15.62:6809/13122","cluster_addr":"172.21.15.62:6810/13122","heartbeat_back_addr":"172.21.15.62:6812/13122","heartbeat_front_addr":"172.21.15.62:6811/13122","state":["exists","up"]},{"osd":5,"uuid":"cdd45766-2f32-4c04-ab92-d004c66880d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":13111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":13111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":13111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6803","nonce":13111}]},"public_addr":"172.21.15.62:6801/13111","cluster_addr":"172.21.15.62:6802/13111","heartbeat_back_addr":"172.21.15.62:6804/13111","heartbeat_front_addr":"172.21.15.62:6803/13111","state":["exists","up"]},{"osd":6,"uuid":"faa66080-86a2-4b4a-bc16-9f4474cb15a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":13129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":13129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":13129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":13129}]},"public_addr":"172.21.15.62:6813/13129","cluster_addr":"172.21.15.62:6814/13129","heartbeat_back_addr":"172.21.15.62:6816/13129","heartbeat_front_addr":"172.21.15.62:6815/13129","state":["exists","up"]},{"osd":7,"uuid":"63075cf6-8497-4d0e-abd1-207fa582152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":13113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":13113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":13113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":13113}]},"public_addr":"172.21.15.62:6805/13113","cluster_addr":"172.21.15.62:6806/13113","heartbeat_back_addr":"172.21.15.62:6808/13113","heartbeat_front_addr":"172.21.15.62:6807/13113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.945315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.902043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.946743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.888724+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.934577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.958132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-10-23T08:35:20.815 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-10-23T08:35:20.816 INFO:tasks.ceph:Creating RBD pool 2019-10-23T08:35:20.816 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:20.816 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool create rbd 8 2019-10-23T08:35:22.014 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'rbd' created 2019-10-23T08:35:22.033 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:22.033 INFO:teuthology.orchestra.run.smithi038:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-10-23T08:35:23.041 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rbd' on pool 'rbd' 2019-10-23T08:35:23.062 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-10-23T08:35:23.062 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:23.062 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-10-23T08:35:23.063 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-10-23T08:35:23.624 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:35:23.625 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":16,"fsid":"c18bce92-1bdb-468d-aa17-3a91fd33942e","created":"2019-10-23T08:35:04.036535+0000","modified":"2019-10-23T08:35:22.991775+0000","last_up_change":"2019-10-23T08:35:16.817951+0000","last_in_change":"2019-10-23T08:35:16.817951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-10-23T08:35:21.274375+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"467463ce-4116-4ad2-adc8-e2abf62fa42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":12965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6801","nonce":12965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6803","nonce":12965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":12965}]},"public_addr":"172.21.15.38:6800/12965","cluster_addr":"172.21.15.38:6801/12965","heartbeat_back_addr":"172.21.15.38:6803/12965","heartbeat_front_addr":"172.21.15.38:6802/12965","state":["exists","up"]},{"osd":1,"uuid":"9fb8b15b-b364-4ac4-a320-0738c031733d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":12966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6805","nonce":12966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6807","nonce":12966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":12966}]},"public_addr":"172.21.15.38:6804/12966","cluster_addr":"172.21.15.38:6805/12966","heartbeat_back_addr":"172.21.15.38:6807/12966","heartbeat_front_addr":"172.21.15.38:6806/12966","state":["exists","up"]},{"osd":2,"uuid":"e19778b2-220f-4aad-aeb3-dabd9189cec8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":12969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":12969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":12969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":12969}]},"public_addr":"172.21.15.38:6812/12969","cluster_addr":"172.21.15.38:6813/12969","heartbeat_back_addr":"172.21.15.38:6815/12969","heartbeat_front_addr":"172.21.15.38:6814/12969","state":["exists","up"]},{"osd":3,"uuid":"bcd51059-5407-4205-913e-afbbf311bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":12967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":12967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6811","nonce":12967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":12967}]},"public_addr":"172.21.15.38:6808/12967","cluster_addr":"172.21.15.38:6809/12967","heartbeat_back_addr":"172.21.15.38:6811/12967","heartbeat_front_addr":"172.21.15.38:6810/12967","state":["exists","up"]},{"osd":4,"uuid":"9d978767-7a82-4960-9e35-8bb45964feb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":13122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":13122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":13122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":13122}]},"public_addr":"172.21.15.62:6809/13122","cluster_addr":"172.21.15.62:6810/13122","heartbeat_back_addr":"172.21.15.62:6812/13122","heartbeat_front_addr":"172.21.15.62:6811/13122","state":["exists","up"]},{"osd":5,"uuid":"cdd45766-2f32-4c04-ab92-d004c66880d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":13111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":13111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":13111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6803","nonce":13111}]},"public_addr":"172.21.15.62:6801/13111","cluster_addr":"172.21.15.62:6802/13111","heartbeat_back_addr":"172.21.15.62:6804/13111","heartbeat_front_addr":"172.21.15.62:6803/13111","state":["exists","up"]},{"osd":6,"uuid":"faa66080-86a2-4b4a-bc16-9f4474cb15a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":13129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":13129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":13129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":13129}]},"public_addr":"172.21.15.62:6813/13129","cluster_addr":"172.21.15.62:6814/13129","heartbeat_back_addr":"172.21.15.62:6816/13129","heartbeat_front_addr":"172.21.15.62:6815/13129","state":["exists","up"]},{"osd":7,"uuid":"63075cf6-8497-4d0e-abd1-207fa582152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":13113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":13113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":13113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":13113}]},"public_addr":"172.21.15.62:6805/13113","cluster_addr":"172.21.15.62:6806/13113","heartbeat_back_addr":"172.21.15.62:6808/13113","heartbeat_front_addr":"172.21.15.62:6807/13113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.945315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.902043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.946743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.888724+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.934577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.958132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-10-23T08:35:23.638 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-10-23T08:35:21.274375+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 2, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-10-23T08:35:23.639 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:23.639 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-10-23T08:35:24.119 INFO:teuthology.orchestra.run.smithi038.stdout:pg_num: 8 2019-10-23T08:35:24.132 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-10-23T08:35:24.133 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-10-23T08:35:24.133 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:24.133 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-10-23T08:35:24.676 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:35:24.689 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":11801}]},"active_addr":"172.21.15.62:6800/11801","active_change":"2019-10-23T08:35:05.911389+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-10-23T08:35:24.696 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-10-23T08:35:25.506 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:25.507 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-10-23T08:35:26.031 INFO:teuthology.misc.health.smithi038.stdout: 2019-10-23T08:35:26.031 INFO:teuthology.misc.health.smithi038.stdout:{"epoch":17,"fsid":"c18bce92-1bdb-468d-aa17-3a91fd33942e","created":"2019-10-23T08:35:04.036535+0000","modified":"2019-10-23T08:35:24.003510+0000","last_up_change":"2019-10-23T08:35:16.817951+0000","last_in_change":"2019-10-23T08:35:16.817951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-10-23T08:35:21.274375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"467463ce-4116-4ad2-adc8-e2abf62fa42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":12965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6801","nonce":12965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6803","nonce":12965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":12965}]},"public_addr":"172.21.15.38:6800/12965","cluster_addr":"172.21.15.38:6801/12965","heartbeat_back_addr":"172.21.15.38:6803/12965","heartbeat_front_addr":"172.21.15.38:6802/12965","state":["exists","up"]},{"osd":1,"uuid":"9fb8b15b-b364-4ac4-a320-0738c031733d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":12966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6805","nonce":12966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6807","nonce":12966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":12966}]},"public_addr":"172.21.15.38:6804/12966","cluster_addr":"172.21.15.38:6805/12966","heartbeat_back_addr":"172.21.15.38:6807/12966","heartbeat_front_addr":"172.21.15.38:6806/12966","state":["exists","up"]},{"osd":2,"uuid":"e19778b2-220f-4aad-aeb3-dabd9189cec8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":12969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":12969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":12969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":12969}]},"public_addr":"172.21.15.38:6812/12969","cluster_addr":"172.21.15.38:6813/12969","heartbeat_back_addr":"172.21.15.38:6815/12969","heartbeat_front_addr":"172.21.15.38:6814/12969","state":["exists","up"]},{"osd":3,"uuid":"bcd51059-5407-4205-913e-afbbf311bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":12967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":12967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6811","nonce":12967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":12967}]},"public_addr":"172.21.15.38:6808/12967","cluster_addr":"172.21.15.38:6809/12967","heartbeat_back_addr":"172.21.15.38:6811/12967","heartbeat_front_addr":"172.21.15.38:6810/12967","state":["exists","up"]},{"osd":4,"uuid":"9d978767-7a82-4960-9e35-8bb45964feb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":13122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":13122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":13122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":13122}]},"public_addr":"172.21.15.62:6809/13122","cluster_addr":"172.21.15.62:6810/13122","heartbeat_back_addr":"172.21.15.62:6812/13122","heartbeat_front_addr":"172.21.15.62:6811/13122","state":["exists","up"]},{"osd":5,"uuid":"cdd45766-2f32-4c04-ab92-d004c66880d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":13111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":13111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":13111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6803","nonce":13111}]},"public_addr":"172.21.15.62:6801/13111","cluster_addr":"172.21.15.62:6802/13111","heartbeat_back_addr":"172.21.15.62:6804/13111","heartbeat_front_addr":"172.21.15.62:6803/13111","state":["exists","up"]},{"osd":6,"uuid":"faa66080-86a2-4b4a-bc16-9f4474cb15a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":13129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":13129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":13129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":13129}]},"public_addr":"172.21.15.62:6813/13129","cluster_addr":"172.21.15.62:6814/13129","heartbeat_back_addr":"172.21.15.62:6816/13129","heartbeat_front_addr":"172.21.15.62:6815/13129","state":["exists","up"]},{"osd":7,"uuid":"63075cf6-8497-4d0e-abd1-207fa582152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":13113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":13113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":13113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":13113}]},"public_addr":"172.21.15.62:6805/13113","cluster_addr":"172.21.15.62:6806/13113","heartbeat_back_addr":"172.21.15.62:6808/13113","heartbeat_front_addr":"172.21.15.62:6807/13113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.945315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.902043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.946743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.888724+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.934577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.958132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-10-23T08:35:26.049 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-10-23T08:35:26.049 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:26.050 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-10-23T08:35:26.563 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:35:26.564 INFO:teuthology.orchestra.run.smithi038.stdout:{"epoch":17,"fsid":"c18bce92-1bdb-468d-aa17-3a91fd33942e","created":"2019-10-23T08:35:04.036535+0000","modified":"2019-10-23T08:35:24.003510+0000","last_up_change":"2019-10-23T08:35:16.817951+0000","last_in_change":"2019-10-23T08:35:16.817951+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-10-23T08:35:21.274375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"467463ce-4116-4ad2-adc8-e2abf62fa42d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6800","nonce":12965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6801","nonce":12965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6803","nonce":12965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6802","nonce":12965}]},"public_addr":"172.21.15.38:6800/12965","cluster_addr":"172.21.15.38:6801/12965","heartbeat_back_addr":"172.21.15.38:6803/12965","heartbeat_front_addr":"172.21.15.38:6802/12965","state":["exists","up"]},{"osd":1,"uuid":"9fb8b15b-b364-4ac4-a320-0738c031733d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6804","nonce":12966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6805","nonce":12966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6807","nonce":12966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6806","nonce":12966}]},"public_addr":"172.21.15.38:6804/12966","cluster_addr":"172.21.15.38:6805/12966","heartbeat_back_addr":"172.21.15.38:6807/12966","heartbeat_front_addr":"172.21.15.38:6806/12966","state":["exists","up"]},{"osd":2,"uuid":"e19778b2-220f-4aad-aeb3-dabd9189cec8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6812","nonce":12969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6813","nonce":12969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6815","nonce":12969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6814","nonce":12969}]},"public_addr":"172.21.15.38:6812/12969","cluster_addr":"172.21.15.38:6813/12969","heartbeat_back_addr":"172.21.15.38:6815/12969","heartbeat_front_addr":"172.21.15.38:6814/12969","state":["exists","up"]},{"osd":3,"uuid":"bcd51059-5407-4205-913e-afbbf311bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6808","nonce":12967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6809","nonce":12967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6811","nonce":12967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.38:6810","nonce":12967}]},"public_addr":"172.21.15.38:6808/12967","cluster_addr":"172.21.15.38:6809/12967","heartbeat_back_addr":"172.21.15.38:6811/12967","heartbeat_front_addr":"172.21.15.38:6810/12967","state":["exists","up"]},{"osd":4,"uuid":"9d978767-7a82-4960-9e35-8bb45964feb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":13122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":13122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":13122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":13122}]},"public_addr":"172.21.15.62:6809/13122","cluster_addr":"172.21.15.62:6810/13122","heartbeat_back_addr":"172.21.15.62:6812/13122","heartbeat_front_addr":"172.21.15.62:6811/13122","state":["exists","up"]},{"osd":5,"uuid":"cdd45766-2f32-4c04-ab92-d004c66880d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":13111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":13111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":13111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6803","nonce":13111}]},"public_addr":"172.21.15.62:6801/13111","cluster_addr":"172.21.15.62:6802/13111","heartbeat_back_addr":"172.21.15.62:6804/13111","heartbeat_front_addr":"172.21.15.62:6803/13111","state":["exists","up"]},{"osd":6,"uuid":"faa66080-86a2-4b4a-bc16-9f4474cb15a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":13129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":13129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":13129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6815","nonce":13129}]},"public_addr":"172.21.15.62:6813/13129","cluster_addr":"172.21.15.62:6814/13129","heartbeat_back_addr":"172.21.15.62:6816/13129","heartbeat_front_addr":"172.21.15.62:6815/13129","state":["exists","up"]},{"osd":7,"uuid":"63075cf6-8497-4d0e-abd1-207fa582152d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":13113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":13113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":13113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":13113}]},"public_addr":"172.21.15.62:6805/13113","cluster_addr":"172.21.15.62:6806/13113","heartbeat_back_addr":"172.21.15.62:6808/13113","heartbeat_front_addr":"172.21.15.62:6807/13113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.945315+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.902043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911481+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.911189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.946743+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.888724+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.934577+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-10-23T08:35:14.958132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-10-23T08:35:26.573 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:26.573 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-10-23T08:35:26.929 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2019-10-23T08:35:26.929 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:26.929 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-10-23T08:35:27.289 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2019-10-23T08:35:27.290 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:27.290 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-10-23T08:35:27.625 INFO:teuthology.orchestra.run.smithi038.stdout:55834574853 2019-10-23T08:35:27.626 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:27.626 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-10-23T08:35:28.000 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:28.001 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:28.001 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-10-23T08:35:28.251 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:28.251 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:28.252 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-10-23T08:35:28.617 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:28.618 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:28.618 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-10-23T08:35:28.901 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:28.902 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:28.902 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-10-23T08:35:29.172 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:29.173 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:29.173 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-10-23T08:35:29.689 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:29.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2019-10-23T08:35:29.708 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:29.708 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-10-23T08:35:30.209 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:30.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2019-10-23T08:35:30.223 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:30.223 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-10-23T08:35:30.745 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:30.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2019-10-23T08:35:30.758 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:30.758 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-10-23T08:35:31.234 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:31.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2019-10-23T08:35:31.247 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:31.247 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-10-23T08:35:31.669 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:31.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2019-10-23T08:35:31.682 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:31.682 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-10-23T08:35:32.172 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:32.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2019-10-23T08:35:32.186 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:32.186 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-10-23T08:35:32.711 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:32.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2019-10-23T08:35:32.721 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:32.721 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-10-23T08:35:33.210 INFO:teuthology.orchestra.run.smithi038.stdout:55834574854 2019-10-23T08:35:33.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2019-10-23T08:35:33.224 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-10-23T08:35:33.224 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:33.224 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-10-23T08:35:33.765 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2019-10-23T08:35:33.765 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:35:33.772 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2019-10-23T08:35:31.923449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8393344,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746581376,"statfs":{"total":773094113280,"available":764499329024,"internally_reserved":8589934592,"allocated":4718592,"data_stored":350752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.008699+0000","last_change":"2019-10-23T08:35:23.007934+0000","last_active":"2019-10-23T08:35:23.008699+0000","last_peered":"2019-10-23T08:35:23.008699+0000","last_clean":"2019-10-23T08:35:23.008699+0000","last_became_active":"2019-10-23T08:35:23.007196+0000","last_became_peered":"2019-10-23T08:35:23.007196+0000","last_unstale":"2019-10-23T08:35:23.008699+0000","last_undegraded":"2019-10-23T08:35:23.008699+0000","last_fullsized":"2019-10-23T08:35:23.008699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.012737+0000","last_change":"2019-10-23T08:35:23.012275+0000","last_active":"2019-10-23T08:35:23.012737+0000","last_peered":"2019-10-23T08:35:23.012737+0000","last_clean":"2019-10-23T08:35:23.012737+0000","last_became_active":"2019-10-23T08:35:23.010951+0000","last_became_peered":"2019-10-23T08:35:23.010951+0000","last_unstale":"2019-10-23T08:35:23.012737+0000","last_undegraded":"2019-10-23T08:35:23.012737+0000","last_fullsized":"2019-10-23T08:35:23.012737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.011738+0000","last_change":"2019-10-23T08:35:23.010892+0000","last_active":"2019-10-23T08:35:23.011738+0000","last_peered":"2019-10-23T08:35:23.011738+0000","last_clean":"2019-10-23T08:35:23.011738+0000","last_became_active":"2019-10-23T08:35:23.010050+0000","last_became_peered":"2019-10-23T08:35:23.010050+0000","last_unstale":"2019-10-23T08:35:23.011738+0000","last_undegraded":"2019-10-23T08:35:23.011738+0000","last_fullsized":"2019-10-23T08:35:23.011738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.008232+0000","last_change":"2019-10-23T08:35:23.007631+0000","last_active":"2019-10-23T08:35:23.008232+0000","last_peered":"2019-10-23T08:35:23.008232+0000","last_clean":"2019-10-23T08:35:23.008232+0000","last_became_active":"2019-10-23T08:35:23.006144+0000","last_became_peered":"2019-10-23T08:35:23.006144+0000","last_unstale":"2019-10-23T08:35:23.008232+0000","last_undegraded":"2019-10-23T08:35:23.008232+0000","last_fullsized":"2019-10-23T08:35:23.008232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.012494+0000","last_change":"2019-10-23T08:35:23.010525+0000","last_active":"2019-10-23T08:35:23.012494+0000","last_peered":"2019-10-23T08:35:23.012494+0000","last_clean":"2019-10-23T08:35:23.012494+0000","last_became_active":"2019-10-23T08:35:23.009638+0000","last_became_peered":"2019-10-23T08:35:23.009638+0000","last_unstale":"2019-10-23T08:35:23.012494+0000","last_undegraded":"2019-10-23T08:35:23.012494+0000","last_fullsized":"2019-10-23T08:35:23.012494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.012556+0000","last_change":"2019-10-23T08:35:23.011969+0000","last_active":"2019-10-23T08:35:23.012556+0000","last_peered":"2019-10-23T08:35:23.012556+0000","last_clean":"2019-10-23T08:35:23.012556+0000","last_became_active":"2019-10-23T08:35:23.010958+0000","last_became_peered":"2019-10-23T08:35:23.010958+0000","last_unstale":"2019-10-23T08:35:23.012556+0000","last_undegraded":"2019-10-23T08:35:23.012556+0000","last_fullsized":"2019-10-23T08:35:23.012556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.008238+0000","last_change":"2019-10-23T08:35:23.007176+0000","last_active":"2019-10-23T08:35:23.008238+0000","last_peered":"2019-10-23T08:35:23.008238+0000","last_clean":"2019-10-23T08:35:23.008238+0000","last_became_active":"2019-10-23T08:35:23.006042+0000","last_became_peered":"2019-10-23T08:35:23.006042+0000","last_unstale":"2019-10-23T08:35:23.008238+0000","last_undegraded":"2019-10-23T08:35:23.008238+0000","last_fullsized":"2019-10-23T08:35:23.008238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.006456+0000","last_change":"2019-10-23T08:35:23.005972+0000","last_active":"2019-10-23T08:35:23.006456+0000","last_peered":"2019-10-23T08:35:23.006456+0000","last_clean":"2019-10-23T08:35:23.006456+0000","last_became_active":"2019-10-23T08:35:23.005311+0000","last_became_peered":"2019-10-23T08:35:23.005311+0000","last_unstale":"2019-10-23T08:35:23.006456+0000","last_undegraded":"2019-10-23T08:35:23.006456+0000","last_fullsized":"2019-10-23T08:35:23.006456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.486}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.702}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.840}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.614}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.938}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.889}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.383}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.757}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.723}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.685}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.831}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.035}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.987}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.710}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.880}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.772}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.963}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.818}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.166}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.651}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.778}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.581}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.985}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.908}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.685}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.604}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.743}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.689}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.956}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.831}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.924}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.649}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.706}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.074}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.865}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.921}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.179}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.618}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.942}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.913}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.710}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.769}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.264}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.220}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.990}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.048}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.390}]}]}]}} 2019-10-23T08:35:33.775 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:33.775 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-10-23T08:35:34.277 INFO:teuthology.orchestra.run.smithi038.stderr:dumped all 2019-10-23T08:35:34.277 INFO:teuthology.orchestra.run.smithi038.stdout: 2019-10-23T08:35:34.290 INFO:teuthology.orchestra.run.smithi038.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2019-10-23T08:35:33.923956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8393344,"kb_used_data":4608,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746581376,"statfs":{"total":773094113280,"available":764499329024,"internally_reserved":8589934592,"allocated":4718592,"data_stored":350752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.008699+0000","last_change":"2019-10-23T08:35:23.007934+0000","last_active":"2019-10-23T08:35:23.008699+0000","last_peered":"2019-10-23T08:35:23.008699+0000","last_clean":"2019-10-23T08:35:23.008699+0000","last_became_active":"2019-10-23T08:35:23.007196+0000","last_became_peered":"2019-10-23T08:35:23.007196+0000","last_unstale":"2019-10-23T08:35:23.008699+0000","last_undegraded":"2019-10-23T08:35:23.008699+0000","last_fullsized":"2019-10-23T08:35:23.008699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.012737+0000","last_change":"2019-10-23T08:35:23.012275+0000","last_active":"2019-10-23T08:35:23.012737+0000","last_peered":"2019-10-23T08:35:23.012737+0000","last_clean":"2019-10-23T08:35:23.012737+0000","last_became_active":"2019-10-23T08:35:23.010951+0000","last_became_peered":"2019-10-23T08:35:23.010951+0000","last_unstale":"2019-10-23T08:35:23.012737+0000","last_undegraded":"2019-10-23T08:35:23.012737+0000","last_fullsized":"2019-10-23T08:35:23.012737+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.011738+0000","last_change":"2019-10-23T08:35:23.010892+0000","last_active":"2019-10-23T08:35:23.011738+0000","last_peered":"2019-10-23T08:35:23.011738+0000","last_clean":"2019-10-23T08:35:23.011738+0000","last_became_active":"2019-10-23T08:35:23.010050+0000","last_became_peered":"2019-10-23T08:35:23.010050+0000","last_unstale":"2019-10-23T08:35:23.011738+0000","last_undegraded":"2019-10-23T08:35:23.011738+0000","last_fullsized":"2019-10-23T08:35:23.011738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.008232+0000","last_change":"2019-10-23T08:35:23.007631+0000","last_active":"2019-10-23T08:35:23.008232+0000","last_peered":"2019-10-23T08:35:23.008232+0000","last_clean":"2019-10-23T08:35:23.008232+0000","last_became_active":"2019-10-23T08:35:23.006144+0000","last_became_peered":"2019-10-23T08:35:23.006144+0000","last_unstale":"2019-10-23T08:35:23.008232+0000","last_undegraded":"2019-10-23T08:35:23.008232+0000","last_fullsized":"2019-10-23T08:35:23.008232+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.012494+0000","last_change":"2019-10-23T08:35:23.010525+0000","last_active":"2019-10-23T08:35:23.012494+0000","last_peered":"2019-10-23T08:35:23.012494+0000","last_clean":"2019-10-23T08:35:23.012494+0000","last_became_active":"2019-10-23T08:35:23.009638+0000","last_became_peered":"2019-10-23T08:35:23.009638+0000","last_unstale":"2019-10-23T08:35:23.012494+0000","last_undegraded":"2019-10-23T08:35:23.012494+0000","last_fullsized":"2019-10-23T08:35:23.012494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.012556+0000","last_change":"2019-10-23T08:35:23.011969+0000","last_active":"2019-10-23T08:35:23.012556+0000","last_peered":"2019-10-23T08:35:23.012556+0000","last_clean":"2019-10-23T08:35:23.012556+0000","last_became_active":"2019-10-23T08:35:23.010958+0000","last_became_peered":"2019-10-23T08:35:23.010958+0000","last_unstale":"2019-10-23T08:35:23.012556+0000","last_undegraded":"2019-10-23T08:35:23.012556+0000","last_fullsized":"2019-10-23T08:35:23.012556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.008238+0000","last_change":"2019-10-23T08:35:23.007176+0000","last_active":"2019-10-23T08:35:23.008238+0000","last_peered":"2019-10-23T08:35:23.008238+0000","last_clean":"2019-10-23T08:35:23.008238+0000","last_became_active":"2019-10-23T08:35:23.006042+0000","last_became_peered":"2019-10-23T08:35:23.006042+0000","last_unstale":"2019-10-23T08:35:23.008238+0000","last_undegraded":"2019-10-23T08:35:23.008238+0000","last_fullsized":"2019-10-23T08:35:23.008238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-10-23T08:35:23.006456+0000","last_change":"2019-10-23T08:35:23.005972+0000","last_active":"2019-10-23T08:35:23.006456+0000","last_peered":"2019-10-23T08:35:23.006456+0000","last_clean":"2019-10-23T08:35:23.006456+0000","last_became_active":"2019-10-23T08:35:23.005311+0000","last_became_peered":"2019-10-23T08:35:23.005311+0000","last_unstale":"2019-10-23T08:35:23.006456+0000","last_undegraded":"2019-10-23T08:35:23.006456+0000","last_fullsized":"2019-10-23T08:35:23.006456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-10-23T08:35:21.981590+0000","last_clean_scrub_stamp":"2019-10-23T08:35:21.981590+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.541}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.935}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.605}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.835}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.160}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.129}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.607}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.731}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.984}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.691}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.785}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.824}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.085}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.925}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.642}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.845}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.781}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.896}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.048}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.654}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.952}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.020}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.844}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.903}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.929}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.543}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.600}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.053}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.863}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.903}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.133}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.649}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.381}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.490}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.778}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.932}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.062}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.448}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.836}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.576}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.899}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.972}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.945}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1049168,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322672,"statfs":{"total":96636764160,"available":95562416128,"internally_reserved":1073741824,"allocated":589824,"data_stored":43844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.586}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.398}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.027}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.916}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.824}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.966}]}]}]}} 2019-10-23T08:35:34.292 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-10-23T08:35:34.293 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-10-23T08:35:34.293 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:34.293 INFO:teuthology.orchestra.run.smithi038:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph health 2019-10-23T08:35:34.775 INFO:teuthology.misc.health.smithi038.stdout:HEALTH_OK 2019-10-23T08:35:34.786 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2019-10-23T08:35:34.786 INFO:teuthology.run_tasks:Running task rados... 2019-10-23T08:35:34.798 INFO:tasks.rados:Beginning rados... 2019-10-23T08:35:34.798 DEBUG:teuthology.run_tasks:Unwinding manager rados 2019-10-23T08:35:34.815 INFO:tasks.rados:joining rados 2019-10-23T08:35:34.815 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2019-10-23T08:35:34.815 INFO:tasks.rados:starting run 0 out of 1 2019-10-23T08:35:34.815 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2019-10-23T08:35:34.816 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:34.816 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2019-10-23T08:35:35.933 INFO:teuthology.orchestra.run.smithi038.stderr:pool 'unique_pool_0' created 2019-10-23T08:35:35.955 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:35.955 INFO:teuthology.orchestra.run.smithi038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2019-10-23T08:35:36.921 INFO:teuthology.orchestra.run.smithi038.stderr:enabled application 'rados' on pool 'unique_pool_0' 2019-10-23T08:35:37.939 INFO:teuthology.orchestra.run.smithi038:Running: 2019-10-23T08:35:37.940 INFO:teuthology.orchestra.run.smithi038:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0 2019-10-23T08:35:38.044 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight snap_remove -> 50 2019-10-23T08:35:38.044 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight snap_create -> 50 2019-10-23T08:35:38.044 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight rollback -> 50 2019-10-23T08:35:38.044 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight read -> 100 2019-10-23T08:35:38.044 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight copy_from -> 50 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight write -> 50 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight write_excl -> 50 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout:adding op weight delete -> 50 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout:ceph version 15.0.0-6281-g1214c80 (1214c80e358aa5969cb9e43aaf279e75b8989198) octopus (dev) 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout:Configuration: 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout: Number of operations: 4000 2019-10-23T08:35:38.045 INFO:tasks.rados.rados.0.smithi038.stdout: Number of objects: 50 2019-10-23T08:35:38.046 INFO:tasks.rados.rados.0.smithi038.stdout: Max in flight operations: 16 2019-10-23T08:35:38.046 INFO:tasks.rados.rados.0.smithi038.stdout: Object size (in bytes): 4000000 2019-10-23T08:35:38.046 INFO:tasks.rados.rados.0.smithi038.stdout: Write stride min: 400000 2019-10-23T08:35:38.046 INFO:tasks.rados.rados.0.smithi038.stdout: Write stride max: 800000 2019-10-23T08:35:38.935 INFO:tasks.rados.rados.0.smithi038.stdout:1: write initial oid 1 2019-10-23T08:35:38.936 INFO:tasks.rados.rados.0.smithi038.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2019-10-23T08:35:38.945 INFO:tasks.rados.rados.0.smithi038.stdout:1: writing smithi03815196-1 from 416807 to 892056 tid 1 2019-10-23T08:35:38.958 INFO:tasks.rados.rados.0.smithi038.stdout:1: writing smithi03815196-1 from 1542129 to 2016807 tid 2 2019-10-23T08:35:38.958 INFO:tasks.rados.rados.0.smithi038.stdout:2: write initial oid 2 2019-10-23T08:35:38.958 INFO:tasks.rados.rados.0.smithi038.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2019-10-23T08:35:38.966 INFO:tasks.rados.rados.0.smithi038.stdout:2: writing smithi03815196-2 from 416807 to 892056 tid 1 2019-10-23T08:35:38.977 INFO:tasks.rados.rados.0.smithi038.stdout:2: writing smithi03815196-2 from 1542129 to 2016807 tid 2 2019-10-23T08:35:38.977 INFO:tasks.rados.rados.0.smithi038.stdout:3: write initial oid 3 2019-10-23T08:35:38.978 INFO:tasks.rados.rados.0.smithi038.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2019-10-23T08:35:38.986 INFO:tasks.rados.rados.0.smithi038.stdout:3: writing smithi03815196-3 from 433614 to 984112 tid 1 2019-10-23T08:35:38.996 INFO:tasks.rados.rados.0.smithi038.stdout:3: writing smithi03815196-3 from 1600611 to 2033614 tid 2 2019-10-23T08:35:38.996 INFO:tasks.rados.rados.0.smithi038.stdout:4: write initial oid 4 2019-10-23T08:35:38.996 INFO:tasks.rados.rados.0.smithi038.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2019-10-23T08:35:39.004 INFO:tasks.rados.rados.0.smithi038.stdout:4: writing smithi03815196-4 from 450421 to 1076168 tid 1 2019-10-23T08:35:39.013 INFO:tasks.rados.rados.0.smithi038.stdout:4: writing smithi03815196-4 from 1659093 to 2050421 tid 2 2019-10-23T08:35:39.013 INFO:tasks.rados.rados.0.smithi038.stdout:5: write initial oid 5 2019-10-23T08:35:39.013 INFO:tasks.rados.rados.0.smithi038.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2019-10-23T08:35:39.020 INFO:tasks.rados.rados.0.smithi038.stdout:5: writing smithi03815196-5 from 467228 to 1168224 tid 1 2019-10-23T08:35:39.026 INFO:tasks.rados.rados.0.smithi038.stdout:5: writing smithi03815196-5 from 1717575 to 2067228 tid 2 2019-10-23T08:35:39.026 INFO:tasks.rados.rados.0.smithi038.stdout:6: write initial oid 6 2019-10-23T08:35:39.026 INFO:tasks.rados.rados.0.smithi038.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2019-10-23T08:35:39.033 INFO:tasks.rados.rados.0.smithi038.stdout:6: writing smithi03815196-6 from 484035 to 1260280 tid 1 2019-10-23T08:35:39.038 INFO:tasks.rados.rados.0.smithi038.stdout:6: writing smithi03815196-6 from 2059704 to 2084035 tid 2 2019-10-23T08:35:39.038 INFO:tasks.rados.rados.0.smithi038.stdout:7: write initial oid 7 2019-10-23T08:35:39.038 INFO:tasks.rados.rados.0.smithi038.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2019-10-23T08:35:39.043 INFO:tasks.rados.rados.0.smithi038.stdout:7: writing smithi03815196-7 from 500842 to 952336 tid 1 2019-10-23T08:35:39.052 INFO:tasks.rados.rados.0.smithi038.stdout:7: writing smithi03815196-7 from 1718186 to 2100842 tid 2 2019-10-23T08:35:39.052 INFO:tasks.rados.rados.0.smithi038.stdout:8: write initial oid 8 2019-10-23T08:35:39.052 INFO:tasks.rados.rados.0.smithi038.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2019-10-23T08:35:39.057 INFO:tasks.rados.rados.0.smithi038.stdout:8: writing smithi03815196-8 from 517649 to 1044392 tid 1 2019-10-23T08:35:39.063 INFO:tasks.rados.rados.0.smithi038.stdout:8: writing smithi03815196-8 from 1776668 to 2117649 tid 2 2019-10-23T08:35:39.064 INFO:tasks.rados.rados.0.smithi038.stdout:9: write initial oid 9 2019-10-23T08:35:39.065 INFO:tasks.rados.rados.0.smithi038.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2019-10-23T08:35:39.071 INFO:tasks.rados.rados.0.smithi038.stdout:9: writing smithi03815196-9 from 534456 to 1252801 tid 1 2019-10-23T08:35:39.076 INFO:tasks.rados.rados.0.smithi038.stdout:9: writing smithi03815196-9 from 1951503 to 2134456 tid 2 2019-10-23T08:35:39.076 INFO:tasks.rados.rados.0.smithi038.stdout:10: write initial oid 10 2019-10-23T08:35:39.076 INFO:tasks.rados.rados.0.smithi038.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2019-10-23T08:35:39.084 INFO:tasks.rados.rados.0.smithi038.stdout:10: writing smithi03815196-10 from 551263 to 1344857 tid 1 2019-10-23T08:35:39.089 INFO:tasks.rados.rados.0.smithi038.stdout:10: writing smithi03815196-10 from 1893632 to 2151263 tid 2 2019-10-23T08:35:39.089 INFO:tasks.rados.rados.0.smithi038.stdout:11: write initial oid 11 2019-10-23T08:35:39.089 INFO:tasks.rados.rados.0.smithi038.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2019-10-23T08:35:39.095 INFO:tasks.rados.rados.0.smithi038.stdout:11: writing smithi03815196-11 from 568070 to 1036913 tid 1 2019-10-23T08:35:39.104 INFO:tasks.rados.rados.0.smithi038.stdout:11: writing smithi03815196-11 from 1552114 to 2168070 tid 2 2019-10-23T08:35:39.104 INFO:tasks.rados.rados.0.smithi038.stdout:12: write initial oid 12 2019-10-23T08:35:39.104 INFO:tasks.rados.rados.0.smithi038.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2019-10-23T08:35:39.112 INFO:tasks.rados.rados.0.smithi038.stdout:12: writing smithi03815196-12 from 584877 to 1128969 tid 1 2019-10-23T08:35:39.118 INFO:tasks.rados.rados.0.smithi038.stdout:12: writing smithi03815196-12 from 1610596 to 2172599 tid 2 2019-10-23T08:35:39.118 INFO:tasks.rados.rados.0.smithi038.stdout:13: write initial oid 13 2019-10-23T08:35:39.118 INFO:tasks.rados.rados.0.smithi038.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2019-10-23T08:35:39.124 INFO:tasks.rados.rados.0.smithi038.stdout:13: writing smithi03815196-13 from 601684 to 1221025 tid 1 2019-10-23T08:35:39.130 INFO:tasks.rados.rados.0.smithi038.stdout:13: writing smithi03815196-13 from 1669078 to 2201684 tid 2 2019-10-23T08:35:39.130 INFO:tasks.rados.rados.0.smithi038.stdout:14: write initial oid 14 2019-10-23T08:35:39.131 INFO:tasks.rados.rados.0.smithi038.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2019-10-23T08:35:39.138 INFO:tasks.rados.rados.0.smithi038.stdout:14: writing smithi03815196-14 from 618491 to 1313081 tid 1 2019-10-23T08:35:39.143 INFO:tasks.rados.rados.0.smithi038.stdout:14: writing smithi03815196-14 from 2011207 to 2218491 tid 2 2019-10-23T08:35:39.144 INFO:tasks.rados.rados.0.smithi038.stdout:15: write initial oid 15 2019-10-23T08:35:39.144 INFO:tasks.rados.rados.0.smithi038.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2019-10-23T08:35:39.152 INFO:tasks.rados.rados.0.smithi038.stdout:15: writing smithi03815196-15 from 635298 to 1405137 tid 1 2019-10-23T08:35:39.157 INFO:tasks.rados.rados.0.smithi038.stdout:15: writing smithi03815196-15 from 2069689 to 2235298 tid 2 2019-10-23T08:35:39.157 INFO:tasks.rados.rados.0.smithi038.stdout:16: write initial oid 16 2019-10-23T08:35:39.157 INFO:tasks.rados.rados.0.smithi038.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2019-10-23T08:35:39.164 INFO:tasks.rados.rados.0.smithi038.stdout:16: writing smithi03815196-16 from 652105 to 1097193 tid 1 2019-10-23T08:35:39.179 INFO:tasks.rados.rados.0.smithi038.stdout:16: writing smithi03815196-16 from 1728171 to 2181159 tid 2 2019-10-23T08:35:39.179 INFO:tasks.rados.rados.0.smithi038.stdout: waiting on 16 2019-10-23T08:36:16.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:16.782+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:36:16.844 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:36:16.845+0000 7f4e3dd05700 -1 osd.2 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.049476+0000 front 2019-10-23T08:35:50.049456+0000 (oldest deadline 2019-10-23T08:36:15.949356+0000) 2019-10-23T08:36:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:17.760+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:36:17.846 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:36:17.847+0000 7f4e3dd05700 -1 osd.2 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.049476+0000 front 2019-10-23T08:35:50.049456+0000 (oldest deadline 2019-10-23T08:36:15.949356+0000) 2019-10-23T08:36:18.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:18.749+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:36:18.871 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:36:18.868+0000 7f4e3dd05700 -1 osd.2 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.049476+0000 front 2019-10-23T08:35:50.049456+0000 (oldest deadline 2019-10-23T08:36:15.949356+0000) 2019-10-23T08:36:19.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:19.723+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:36:19.819 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:36:19.820+0000 7f4e3dd05700 -1 osd.2 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.049476+0000 front 2019-10-23T08:35:50.049456+0000 (oldest deadline 2019-10-23T08:36:15.949356+0000) 2019-10-23T08:36:20.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:20.744+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:36:20.785 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:36:20.787+0000 7f4e3dd05700 -1 osd.2 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.049476+0000 front 2019-10-23T08:35:50.049456+0000 (oldest deadline 2019-10-23T08:36:15.949356+0000) 2019-10-23T08:36:21.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:21.733+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:36:22.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:36:22.733+0000 7f6c33db6700 -1 osd.1 21 heartbeat_check: no reply from 172.21.15.38:6810 osd.3 since back 2019-10-23T08:35:50.847047+0000 front 2019-10-23T08:35:50.846940+0000 (oldest deadline 2019-10-23T08:36:16.746966+0000) 2019-10-23T08:37:01.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:01.810+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:01.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:01.810+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:01.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:01.810+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:01.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:01.810+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:01.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:01.810+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:02.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:02.839+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:02.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:02.839+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:02.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:02.839+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:02.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:02.839+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:02.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:02.839+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:03.860+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:03.860+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:03.860+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:03.860+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:03.860+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:04.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:04.899+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:04.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:04.899+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:04.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:04.899+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:04.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:04.899+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:04.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:04.899+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:05.016 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:05.017+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.853207+0000 front 2019-10-23T08:36:38.853235+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:05.016 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:05.017+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.853276+0000 front 2019-10-23T08:36:38.853326+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:05.016 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:05.018+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.853403+0000 front 2019-10-23T08:36:38.853414+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:05.016 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:05.018+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.853493+0000 front 2019-10-23T08:36:38.853475+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:05.017 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:05.018+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.853453+0000 front 2019-10-23T08:36:38.853383+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:05.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:05.894+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:05.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:05.894+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:05.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:05.894+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:05.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:05.894+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:05.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:05.894+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:06.005 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:06.006+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.853207+0000 front 2019-10-23T08:36:38.853235+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:06.005 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:06.006+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.853276+0000 front 2019-10-23T08:36:38.853326+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:06.005 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:06.006+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.853403+0000 front 2019-10-23T08:36:38.853414+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:06.005 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:06.006+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.853493+0000 front 2019-10-23T08:36:38.853475+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:06.005 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:06.006+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.853453+0000 front 2019-10-23T08:36:38.853383+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:06.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:06.882+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:06.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:06.882+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:06.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:06.882+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:06.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:06.882+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:06.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:06.882+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:07.034 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.032+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.853207+0000 front 2019-10-23T08:36:38.853235+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.035 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.032+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.853276+0000 front 2019-10-23T08:36:38.853326+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.035 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.032+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.853403+0000 front 2019-10-23T08:36:38.853414+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.035 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.032+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.853493+0000 front 2019-10-23T08:36:38.853475+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.035 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.032+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.853453+0000 front 2019-10-23T08:36:38.853383+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:07.841+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:07.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:07.841+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:07.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:07.841+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:07.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:07.841+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:07.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:07.841+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:07.997 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.999+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.853207+0000 front 2019-10-23T08:36:38.853235+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.997 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.999+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.853276+0000 front 2019-10-23T08:36:38.853326+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.998 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.999+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.853403+0000 front 2019-10-23T08:36:38.853414+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.998 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.999+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.853493+0000 front 2019-10-23T08:36:38.853475+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:07.998 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:07.999+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.853453+0000 front 2019-10-23T08:36:38.853383+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:08.854+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.850191+0000 front 2019-10-23T08:36:38.850342+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:08.854+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.850299+0000 front 2019-10-23T08:36:38.850243+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:08.854+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.850263+0000 front 2019-10-23T08:36:38.850441+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:08.854+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.850382+0000 front 2019-10-23T08:36:38.850326+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:08.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:37:08.854+0000 7f6c33db6700 -1 osd.1 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.850491+0000 front 2019-10-23T08:36:38.850358+0000 (oldest deadline 2019-10-23T08:37:01.150236+0000) 2019-10-23T08:37:09.002 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:09.003+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.38:6802 osd.0 since back 2019-10-23T08:36:38.853207+0000 front 2019-10-23T08:36:38.853235+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:09.003 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:09.003+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6811 osd.4 since back 2019-10-23T08:36:38.853276+0000 front 2019-10-23T08:36:38.853326+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:09.003 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:09.003+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6803 osd.5 since back 2019-10-23T08:36:38.853403+0000 front 2019-10-23T08:36:38.853414+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:09.003 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:09.003+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6815 osd.6 since back 2019-10-23T08:36:38.853493+0000 front 2019-10-23T08:36:38.853475+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:37:09.003 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:37:09.003+0000 7f4e3dd05700 -1 osd.2 23 heartbeat_check: no reply from 172.21.15.62:6807 osd.7 since back 2019-10-23T08:36:38.853453+0000 front 2019-10-23T08:36:38.853383+0000 (oldest deadline 2019-10-23T08:37:04.753278+0000) 2019-10-23T08:46:54.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:46:54.522+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:46:55.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:46:55.474+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:46:56.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:46:56.478+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:46:57.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:46:57.460+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:46:58.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:46:58.437+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:46:59.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:46:59.390+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:00.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:00.379+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:01.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:01.396+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:02.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:02.375+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:03.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:03.365+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:04.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:04.385+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:05.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:05.419+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:06.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:06.457+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:07.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:07.429+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:08.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:08.477+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:09.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:09.439+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:10.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:10.473+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:11.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:11.509+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:12.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:12.501+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:13.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:13.476+0000 7f6c33db6700 -1 osd.1 28 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:14.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:14.476+0000 7f6c33db6700 -1 osd.1 29 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:15.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:15.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:16.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:16.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:17.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:17.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:18.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:18.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:19.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:19.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:20.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:20.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:21.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:21.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:22.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:22.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:23.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:23.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:24.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:24.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:25.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:25.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:26.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:26.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:27.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:27.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:28.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:28.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:29.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:29.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:30.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:30.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:31.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:31.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:32.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:32.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:33.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:33.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:34.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:34.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:35.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:35.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:36.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:36.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:37.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:37.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:38.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:38.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:39.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:39.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:40.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:40.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:41.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:41.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:42.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:42.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:43.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:43.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:44.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:44.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:45.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:45.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:46.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:46.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:47.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:47.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:48.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:48.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:49.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:49.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:50.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:50.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:51.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:51.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:52.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:52.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:53.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:53.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:54.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:54.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:55.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:55.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:56.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:56.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:57.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:57.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:58.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:58.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:47:59.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:47:59.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:00.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:00.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:01.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:01.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:02.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:02.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:03.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:03.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:04.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:04.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:05.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:05.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:05.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:05.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:06.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:06.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:06.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:06.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:07.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:07.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:07.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:07.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:08.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:08.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:08.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:08.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:09.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:09.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:09.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:09.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:10.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:10.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:10.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:10.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:11.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:11.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:11.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:11.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:12.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:12.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:12.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:12.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:13.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:13.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:13.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:13.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:14.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:14.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:14.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:14.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:15.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:15.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:15.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:15.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:16.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:16.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:16.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:16.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:17.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:17.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:17.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:17.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:18.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:18.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:18.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:18.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:19.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:19.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:19.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:19.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:20.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:20.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:20.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:20.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:21.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:21.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:21.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:21.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:22.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:22.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:22.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:22.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:23.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:23.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:23.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:23.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:24.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:24.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:24.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:24.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:25.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:25.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:25.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:25.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:26.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:26.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:26.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:26.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:27.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:27.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:27.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:27.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:28.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:28.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:28.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:28.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:29.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:29.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:29.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:29.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:30.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:30.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:30.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:30.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:31.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:31.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:31.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:31.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:32.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:32.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:32.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:32.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:33.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:33.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:33.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:33.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:34.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:34.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:34.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:34.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:35.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:35.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:35.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:35.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:36.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:36.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:36.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:36.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:37.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:37.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:37.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:37.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:38.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:38.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:38.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:38.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:39.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:39.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:39.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:39.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:40.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:40.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:40.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:40.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:41.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:41.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:41.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:41.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:42.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:42.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:42.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:42.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:43.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:43.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:43.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:43.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:44.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:44.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:44.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:44.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:45.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:45.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:45.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:45.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:46.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:46.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:46.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:46.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:47.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:47.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:47.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:47.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:48.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:48.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:48.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:48.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:49.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:49.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:49.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:49.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:50.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:50.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:50.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:50.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:51.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:51.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:51.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:51.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:52.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:52.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:52.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:52.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:53.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:53.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:53.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:53.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:54.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:54.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:54.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:54.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:55.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:55.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:55.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:55.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:56.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:56.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:56.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:56.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:57.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:57.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:57.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:57.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:58.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:58.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:58.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:58.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:48:59.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:59.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:48:59.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:48:59.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:00.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:00.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:00.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:00.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:01.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:01.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:01.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:01.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:02.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:02.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:02.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:02.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:03.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:03.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:03.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:03.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:04.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:04.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:04.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:04.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:05.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:05.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:05.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:05.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:06.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:06.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:06.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:06.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:07.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:07.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:07.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:07.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:08.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:08.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:08.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:08.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:09.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:09.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:09.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:09.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:10.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:10.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:10.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:10.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:11.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:11.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:11.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:11.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:12.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:12.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:12.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:12.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:13.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:13.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:13.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:13.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:14.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:14.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:14.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:14.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:15.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:15.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:15.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:15.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:16.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:16.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:16.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:16.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:17.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:17.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:17.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:17.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:18.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:18.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:18.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:18.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:19.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:19.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:19.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:19.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:20.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:20.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:20.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:20.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:21.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:21.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:21.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:21.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:22.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:22.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:22.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:22.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:23.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:23.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:23.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:23.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:24.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:24.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:24.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:24.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:25.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:25.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:25.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:25.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:26.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:26.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:26.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:26.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:27.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:27.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:27.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:27.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:28.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:28.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:28.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:28.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:29.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:29.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:29.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:29.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:30.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:30.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:30.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:30.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:31.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:31.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:31.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:31.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:32.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:32.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:32.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:32.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:33.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:33.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:33.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:33.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:34.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:34.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:34.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:34.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:35.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:35.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:35.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:35.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:36.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:36.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:36.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:36.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:37.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:37.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:37.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:37.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:38.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:38.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:38.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:38.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:39.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:39.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:39.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:39.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:40.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:40.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:40.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:40.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:41.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:41.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:41.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:41.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:42.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:42.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:42.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:42.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:43.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:43.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:43.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:43.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:44.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:44.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:44.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:44.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:45.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:45.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:45.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:45.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:46.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:46.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:46.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:46.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:47.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:47.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:47.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:47.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:48.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:48.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:48.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:48.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:49.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:49.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:49.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:49.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:50.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:50.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:50.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:50.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:51.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:51.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:51.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:51.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:52.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:52.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:52.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:52.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:53.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:53.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:53.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:53.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:54.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:54.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:54.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:54.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:55.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:55.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:55.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:55.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:56.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:56.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:48:04.779464+0000) 2019-10-23T08:49:56.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:56.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:57.199 INFO:tasks.ceph.osd.2.smithi038.stderr:*** Caught signal (Aborted) ** 2019-10-23T08:49:57.199 INFO:tasks.ceph.osd.2.smithi038.stderr: in thread 7f4e252ce700 thread_name:tp_osd_tp 2019-10-23T08:49:57.203 INFO:tasks.ceph.osd.2.smithi038.stderr: ceph version 15.0.0-6281-g1214c80 (1214c80e358aa5969cb9e43aaf279e75b8989198) octopus (dev) 2019-10-23T08:49:57.203 INFO:tasks.ceph.osd.2.smithi038.stderr: 1: (()+0xf5d0) [0x7f4e4654d5d0] 2019-10-23T08:49:57.204 INFO:tasks.ceph.osd.2.smithi038.stderr: 2: (PrimaryLogPG::finish_ctx(PrimaryLogPG::OpContext*, int, int)+0x436) [0x560721268036] 2019-10-23T08:49:57.204 INFO:tasks.ceph.osd.2.smithi038.stderr: 3: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x24c) [0x5607212bf1cc] 2019-10-23T08:49:57.204 INFO:tasks.ceph.osd.2.smithi038.stderr: 4: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3d2) [0x5607212bf8b2] 2019-10-23T08:49:57.204 INFO:tasks.ceph.osd.2.smithi038.stderr: 5: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d16) [0x5607212c38d6] 2019-10-23T08:49:57.205 INFO:tasks.ceph.osd.2.smithi038.stderr: 6: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x5607212c9aad] 2019-10-23T08:49:57.205 INFO:tasks.ceph.osd.2.smithi038.stderr: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x56072116a6b9] 2019-10-23T08:49:57.205 INFO:tasks.ceph.osd.2.smithi038.stderr: 8: (PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5607213ac099] 2019-10-23T08:49:57.205 INFO:tasks.ceph.osd.2.smithi038.stderr: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x143a) [0x560721184d8a] 2019-10-23T08:49:57.206 INFO:tasks.ceph.osd.2.smithi038.stderr: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5b6) [0x560721753646] 2019-10-23T08:49:57.206 INFO:tasks.ceph.osd.2.smithi038.stderr: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560721756190] 2019-10-23T08:49:57.206 INFO:tasks.ceph.osd.2.smithi038.stderr: 12: (()+0x7dd5) [0x7f4e46545dd5] 2019-10-23T08:49:57.206 INFO:tasks.ceph.osd.2.smithi038.stderr: 13: (clone()+0x6d) [0x7f4e4540c02d] 2019-10-23T08:49:57.207 INFO:tasks.ceph.osd.2.smithi038.stderr:2019-10-23T08:49:57.216+0000 7f4e252ce700 -1 *** Caught signal (Aborted) ** 2019-10-23T08:49:57.207 INFO:tasks.ceph.osd.2.smithi038.stderr: in thread 7f4e252ce700 thread_name:tp_osd_tp 2019-10-23T08:49:57.207 INFO:tasks.ceph.osd.2.smithi038.stderr: 2019-10-23T08:49:57.207 INFO:tasks.ceph.osd.2.smithi038.stderr: ceph version 15.0.0-6281-g1214c80 (1214c80e358aa5969cb9e43aaf279e75b8989198) octopus (dev) 2019-10-23T08:49:57.208 INFO:tasks.ceph.osd.2.smithi038.stderr: 1: (()+0xf5d0) [0x7f4e4654d5d0] 2019-10-23T08:49:57.208 INFO:tasks.ceph.osd.2.smithi038.stderr: 2: (PrimaryLogPG::finish_ctx(PrimaryLogPG::OpContext*, int, int)+0x436) [0x560721268036] 2019-10-23T08:49:57.208 INFO:tasks.ceph.osd.2.smithi038.stderr: 3: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x24c) [0x5607212bf1cc] 2019-10-23T08:49:57.213 INFO:tasks.ceph.osd.2.smithi038.stderr: 4: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3d2) [0x5607212bf8b2] 2019-10-23T08:49:57.216 INFO:tasks.ceph.osd.2.smithi038.stderr: 5: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d16) [0x5607212c38d6] 2019-10-23T08:49:57.216 INFO:tasks.ceph.osd.2.smithi038.stderr: 6: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x5607212c9aad] 2019-10-23T08:49:57.216 INFO:tasks.ceph.osd.2.smithi038.stderr: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x56072116a6b9] 2019-10-23T08:49:57.216 INFO:tasks.ceph.osd.2.smithi038.stderr: 8: (PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5607213ac099] 2019-10-23T08:49:57.217 INFO:tasks.ceph.osd.2.smithi038.stderr: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x143a) [0x560721184d8a] 2019-10-23T08:49:57.217 INFO:tasks.ceph.osd.2.smithi038.stderr: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5b6) [0x560721753646] 2019-10-23T08:49:57.217 INFO:tasks.ceph.osd.2.smithi038.stderr: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560721756190] 2019-10-23T08:49:57.217 INFO:tasks.ceph.osd.2.smithi038.stderr: 12: (()+0x7dd5) [0x7f4e46545dd5] 2019-10-23T08:49:57.217 INFO:tasks.ceph.osd.2.smithi038.stderr: 13: (clone()+0x6d) [0x7f4e4540c02d] 2019-10-23T08:49:57.218 INFO:tasks.ceph.osd.2.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-10-23T08:49:57.218 INFO:tasks.ceph.osd.2.smithi038.stderr: 2019-10-23T08:49:57.220 INFO:tasks.ceph.osd.2.smithi038.stderr: 0> 2019-10-23T08:49:57.216+0000 7f4e252ce700 -1 *** Caught signal (Aborted) ** 2019-10-23T08:49:57.220 INFO:tasks.ceph.osd.2.smithi038.stderr: in thread 7f4e252ce700 thread_name:tp_osd_tp 2019-10-23T08:49:57.221 INFO:tasks.ceph.osd.2.smithi038.stderr: 2019-10-23T08:49:57.221 INFO:tasks.ceph.osd.2.smithi038.stderr: ceph version 15.0.0-6281-g1214c80 (1214c80e358aa5969cb9e43aaf279e75b8989198) octopus (dev) 2019-10-23T08:49:57.221 INFO:tasks.ceph.osd.2.smithi038.stderr: 1: (()+0xf5d0) [0x7f4e4654d5d0] 2019-10-23T08:49:57.221 INFO:tasks.ceph.osd.2.smithi038.stderr: 2: (PrimaryLogPG::finish_ctx(PrimaryLogPG::OpContext*, int, int)+0x436) [0x560721268036] 2019-10-23T08:49:57.221 INFO:tasks.ceph.osd.2.smithi038.stderr: 3: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x24c) [0x5607212bf1cc] 2019-10-23T08:49:57.221 INFO:tasks.ceph.osd.2.smithi038.stderr: 4: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3d2) [0x5607212bf8b2] 2019-10-23T08:49:57.222 INFO:tasks.ceph.osd.2.smithi038.stderr: 5: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d16) [0x5607212c38d6] 2019-10-23T08:49:57.222 INFO:tasks.ceph.osd.2.smithi038.stderr: 6: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x5607212c9aad] 2019-10-23T08:49:57.222 INFO:tasks.ceph.osd.2.smithi038.stderr: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x56072116a6b9] 2019-10-23T08:49:57.222 INFO:tasks.ceph.osd.2.smithi038.stderr: 8: (PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5607213ac099] 2019-10-23T08:49:57.222 INFO:tasks.ceph.osd.2.smithi038.stderr: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x143a) [0x560721184d8a] 2019-10-23T08:49:57.223 INFO:tasks.ceph.osd.2.smithi038.stderr: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5b6) [0x560721753646] 2019-10-23T08:49:57.223 INFO:tasks.ceph.osd.2.smithi038.stderr: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560721756190] 2019-10-23T08:49:57.223 INFO:tasks.ceph.osd.2.smithi038.stderr: 12: (()+0x7dd5) [0x7f4e46545dd5] 2019-10-23T08:49:57.223 INFO:tasks.ceph.osd.2.smithi038.stderr: 13: (clone()+0x6d) [0x7f4e4540c02d] 2019-10-23T08:49:57.223 INFO:tasks.ceph.osd.2.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-10-23T08:49:57.223 INFO:tasks.ceph.osd.2.smithi038.stderr: 2019-10-23T08:49:57.239 INFO:tasks.ceph.osd.2.smithi038.stderr: 0> 2019-10-23T08:49:57.216+0000 7f4e252ce700 -1 *** Caught signal (Aborted) ** 2019-10-23T08:49:57.239 INFO:tasks.ceph.osd.2.smithi038.stderr: in thread 7f4e252ce700 thread_name:tp_osd_tp 2019-10-23T08:49:57.239 INFO:tasks.ceph.osd.2.smithi038.stderr: 2019-10-23T08:49:57.239 INFO:tasks.ceph.osd.2.smithi038.stderr: ceph version 15.0.0-6281-g1214c80 (1214c80e358aa5969cb9e43aaf279e75b8989198) octopus (dev) 2019-10-23T08:49:57.239 INFO:tasks.ceph.osd.2.smithi038.stderr: 1: (()+0xf5d0) [0x7f4e4654d5d0] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 2: (PrimaryLogPG::finish_ctx(PrimaryLogPG::OpContext*, int, int)+0x436) [0x560721268036] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 3: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x24c) [0x5607212bf1cc] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 4: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3d2) [0x5607212bf8b2] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 5: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x2d16) [0x5607212c38d6] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 6: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x5607212c9aad] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 7: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x56072116a6b9] 2019-10-23T08:49:57.240 INFO:tasks.ceph.osd.2.smithi038.stderr: 8: (PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x5607213ac099] 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: 9: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x143a) [0x560721184d8a] 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: 10: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5b6) [0x560721753646] 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: 11: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560721756190] 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: 12: (()+0x7dd5) [0x7f4e46545dd5] 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: 13: (clone()+0x6d) [0x7f4e4540c02d] 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-10-23T08:49:57.241 INFO:tasks.ceph.osd.2.smithi038.stderr: 2019-10-23T08:49:57.486 INFO:tasks.ceph.osd.2.smithi038.stderr:daemon-helper: command crashed with signal 6 2019-10-23T08:49:57.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:57.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:58.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:58.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:49:59.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:49:59.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:00.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:00.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:01.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2019-10-23T08:50:01.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:01.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:02.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:02.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:03.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:03.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:04.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:04.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:05.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:05.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:06.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:06.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:07.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:07.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:07.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2019-10-23T08:50:08.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:08.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:09.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:09.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:10.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:10.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:11.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:11.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:12.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:12.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:13.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:13.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:14.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2019-10-23T08:50:14.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:14.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:15.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:15.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:17.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:17.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:18.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:18.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:18.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:18.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:18.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:18.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:18.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:18.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:19.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:19.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:19.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:19.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:20.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~19s 2019-10-23T08:50:21.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:21.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:21.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:22.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:22.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:22.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:22.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:23.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:23.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:23.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:23.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:23.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:23.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:23.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:23.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:24.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:24.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:24.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:24.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:26.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:26.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:26.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:26.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:26.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2019-10-23T08:50:27.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:27.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:27.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:27.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:28.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:28.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:28.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:28.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:29.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:29.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:29.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:29.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:30.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:30.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:30.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:30.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:31.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:31.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:31.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:31.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:32.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:32.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:32.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:32.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:32.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~31s 2019-10-23T08:50:33.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:33.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:33.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:33.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:34.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:34.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:34.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:34.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:35.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:35.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:35.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:35.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:36.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:36.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:36.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:36.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:37.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:37.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:37.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:37.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:38.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:38.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:38.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:38.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:39.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~37s 2019-10-23T08:50:39.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:39.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:39.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:39.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:40.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:40.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:40.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:40.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:41.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:41.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:41.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:41.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:42.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:42.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:42.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:42.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:43.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:43.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:43.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:43.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:44.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:44.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:44.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:44.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:45.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:45.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:45.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:45.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:45.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~44s 2019-10-23T08:50:46.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:46.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:46.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:46.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:47.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:47.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:47.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:47.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:48.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:48.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:48.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:48.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:49.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:49.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:49.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:49.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:50.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:50.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:50.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:50.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:51.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:51.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:51.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:51.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:51.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2019-10-23T08:50:52.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:52.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:52.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:52.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:53.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:53.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:53.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:53.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:54.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:54.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:54.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:54.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:55.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:55.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:55.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:55.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:56.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:56.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:56.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:56.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:57.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:57.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:57.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:57.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:57.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~56s 2019-10-23T08:50:58.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:58.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:58.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:58.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:50:59.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:59.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:50:59.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:50:59.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:00.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:00.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:00.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:00.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:01.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:01.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:01.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:01.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:02.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:02.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:02.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:02.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:03.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:03.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:03.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:03.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:03.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~62s 2019-10-23T08:51:04.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:04.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:04.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:04.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:05.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:05.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:05.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:05.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:06.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:06.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:06.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:06.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:07.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:07.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:07.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:07.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:08.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:08.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:08.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:08.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:09.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:09.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:09.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:09.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:10.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~68s 2019-10-23T08:51:10.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:10.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:10.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:10.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:11.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:11.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:11.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:11.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:12.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:12.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:12.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:12.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:13.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:13.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:13.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:13.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:14.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:14.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:14.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:14.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:15.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:15.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:15.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:15.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:16.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:16.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:16.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:16.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:16.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2019-10-23T08:51:17.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:17.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:17.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:17.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:18.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:18.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:18.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:18.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:19.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:19.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:19.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:19.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:20.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:20.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:20.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:20.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:21.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:21.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:21.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:21.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:22.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:22.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:22.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:22.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:22.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~81s 2019-10-23T08:51:23.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:23.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:23.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:23.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:24.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:24.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:24.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:24.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:25.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:25.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:25.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:25.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:26.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:26.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:26.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:26.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:27.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:27.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:27.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:27.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:28.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:28.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:28.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:28.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:28.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~87s 2019-10-23T08:51:29.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:29.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:29.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:29.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:30.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:30.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:30.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:30.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:31.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:31.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:31.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:31.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:32.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:32.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:32.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:32.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:33.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:33.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:33.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:33.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:34.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:34.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:34.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:34.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:34.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~93s 2019-10-23T08:51:35.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:35.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:35.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:35.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:36.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:36.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:36.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:36.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:37.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:37.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:37.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:37.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:38.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:38.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:38.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:38.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:39.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:39.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:39.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:39.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:40.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:40.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:40.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:40.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:41.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2019-10-23T08:51:41.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:41.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:41.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:41.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:42.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:42.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:42.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:42.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:43.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:43.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:43.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:43.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:44.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:44.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:44.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:44.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:45.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:45.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:45.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:45.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:46.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:46.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:46.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:46.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:47.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:47.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:47.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:47.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:47.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2019-10-23T08:51:48.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:48.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:48.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:48.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:49.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:49.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:49.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:49.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:50.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:50.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:50.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:50.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:51.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:51.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:51.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:51.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:52.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:52.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:52.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:52.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:53.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:53.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:53.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:53.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:53.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~112s 2019-10-23T08:51:54.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:54.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:54.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:54.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:55.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:55.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:55.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:55.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:56.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:56.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:56.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:56.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:57.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:57.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:57.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:57.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:58.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:58.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:58.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:58.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:59.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:59.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:51:59.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:51:59.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:51:59.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~118s 2019-10-23T08:52:00.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:00.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:00.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:00.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:01.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:01.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:01.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:01.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:02.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:02.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:02.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:02.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:03.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:03.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:03.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:03.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:04.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:04.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:04.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:04.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:05.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:05.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:05.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:05.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:05.652 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:05.668+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8af54c400 0x55e8b062cc00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:05.653 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:05.668+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e49e000 0x559b6e34d600 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:05.853 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:05.869+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395000 0x55e8b1472c00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:05.854 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:05.869+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e49f000 0x559b6e63c680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:06.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~124s 2019-10-23T08:52:06.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:06.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:06.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:06.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:06.254 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:06.270+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395c00 0x55e8b1473180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:06.254 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:06.271+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296400 0x559b6e34c000 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:07.055 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:07.071+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0bb4c00 0x55e8b1470b00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:07.056 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:07.072+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296400 0x559b6e34c000 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:07.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:07.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:07.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:07.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:08.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:08.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:08.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:08.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:08.658 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:08.673+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8af54c400 0x55e8b062cc00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:08.658 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:08.674+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296c00 0x559b6e34f700 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:09.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:09.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:09.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:09.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:10.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:10.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:10.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:10.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:11.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:11.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:11.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:11.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:11.860 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:11.877+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8af54dc00 0x55e8b1472c00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:11.861 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:11.877+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e297000 0x559b6e34f180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:12.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~131s 2019-10-23T08:52:12.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:12.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:12.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:12.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:13.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:13.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:13.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:13.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:14.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:14.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:14.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:14.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:15.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:15.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:15.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:15.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:15.651 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:15.662+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3f058000 0x55fc3ef54580 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:15.851 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:15.862+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef99400 0x55fc3ef54b00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:16.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:16.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:16.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:16.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:16.254 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:16.263+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef99c00 0x55fc3ef56680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:17.053 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:17.065+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3f058000 0x55fc3ef54580 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:17.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:17.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:17.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:17.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:18.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:18.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:18.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:18.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:18.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~137s 2019-10-23T08:52:18.651 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:18.667+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395000 0x55e8b1473180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:18.652 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:18.667+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e49e000 0x559b6e34d600 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:18.652 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:18.662+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3f059c00 0x55fc3ef54000 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:18.851 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:18.868+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395c00 0x55e8b0e62680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:18.852 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:18.868+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e49f000 0x559b6e63c680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:18.852 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:18.862+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef98000 0x55fc3f337b80 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:19.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:19.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:19.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:19.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:19.252 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:19.269+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0380c00 0x55e8b0e62c00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:19.253 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:19.269+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e49f000 0x559b6e63c680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:19.253 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:19.264+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef98000 0x55fc3f337b80 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:20.054 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:20.069+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0380c00 0x55e8b0e62c00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:20.054 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:20.069+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296400 0x559b6e34c000 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:20.054 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:20.065+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef99400 0x55fc3ef54b00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:20.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:20.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:20.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:20.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:21.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:21.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:21.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:21.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:21.775 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:21.790+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296c00 0x559b6e34f700 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:21.775 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:21.790+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8af54dc00 0x55e8b062cc00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:21.775 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:21.786+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3f058000 0x55fc3ef56680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:21.988 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:21.987+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3f059c00 0x55fc3ef54580 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:21.988 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:21.991+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395000 0x55e8b0e63180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:21.989 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:21.991+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e297000 0x559b6e34f180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:22.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:22.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:22.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:22.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:22.385 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:22.392+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395c00 0x55e8b0e62680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:22.389 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:22.389+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef98000 0x55fc3f337b80 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:22.389 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:22.393+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e49e000 0x559b6e34d600 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:23.177 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:23.193+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8b0395c00 0x55e8b0e63180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:23.180 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:23.195+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296400 0x559b6e34c000 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:23.180 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:23.191+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef99400 0x55fc3ef54b00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:23.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:23.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:23.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:23.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:24.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:24.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:24.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:24.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:24.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~143s 2019-10-23T08:52:24.781 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:24.795+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8af54c400 0x55e8b0e62c00 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:24.782 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:24.793+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3ef99c00 0x55fc3ef56680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:24.782 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:24.797+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e296c00 0x559b6e34f700 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:25.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:25.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:25.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:25.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:26.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:26.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:26.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:26.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:27.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:27.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:27.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:27.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:27.984 INFO:tasks.ceph.mon.a.smithi038.stderr:2019-10-23T08:52:27.999+0000 7fedccfe0700 -1 --2- [v2:172.21.15.38:3300/0,v1:172.21.15.38:6789/0] >> conn(0x55e8af54dc00 0x55e8b0e62680 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:27.988 INFO:tasks.ceph.mon.b.smithi062.stderr:2019-10-23T08:52:27.996+0000 7f0b3a50f700 -1 --2- [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] >> conn(0x55fc3f058000 0x55fc3ef54000 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:27.988 INFO:tasks.ceph.mon.c.smithi038.stderr:2019-10-23T08:52:28.001+0000 7f4346697700 -1 --2- [v2:172.21.15.38:3301/0,v1:172.21.15.38:6790/0] >> conn(0x559b6e297000 0x559b6e34f180 secure :-1 s=AUTH_ACCEPTING_MORE pgs=0 cs=0 l=1 rx=0 tx=0).run_continuation failed decoding of frame header: buffer::end_of_buffer 2019-10-23T08:52:28.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:28.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:28.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:28.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:29.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:29.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:29.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:29.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:30.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:30.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:30.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:30.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:30.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~149s 2019-10-23T08:52:31.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:31.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:31.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:31.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:32.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:32.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:32.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:32.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:33.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:33.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:33.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:33.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:34.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:34.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:34.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:34.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:35.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:35.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:35.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:35.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:36.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:36.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:36.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:36.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:37.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2019-10-23T08:52:37.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:37.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:37.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:37.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:38.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:38.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:38.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:38.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:39.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:39.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:39.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:39.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:40.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:40.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:40.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:40.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:41.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:41.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:41.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:41.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:42.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:42.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:42.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:42.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:43.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:43.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:43.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:43.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:43.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~162s 2019-10-23T08:52:44.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:44.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:44.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:44.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:45.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:45.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:45.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:45.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:46.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:46.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:46.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:46.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:47.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:47.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:47.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:47.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:48.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:48.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:48.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:48.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:49.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:49.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:49.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:49.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:49.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~168s 2019-10-23T08:52:50.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:50.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:50.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:50.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:51.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:51.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:51.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:51.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:52.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:52.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:52.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:52.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:53.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:53.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:53.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:53.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:54.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:54.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:54.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:54.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:54.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:54.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:54.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:54.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:55.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~174s 2019-10-23T08:52:55.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:55.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:55.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:55.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:56.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:56.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:56.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:56.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:57.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:57.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:57.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:57.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:58.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:58.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:58.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:58.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:52:59.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:59.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:52:59.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:52:59.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:00.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:00.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:00.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:00.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:01.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:01.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:01.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:01.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:01.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2019-10-23T08:53:02.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:02.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:02.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:02.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:03.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:03.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:03.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:04.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:04.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:04.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:04.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:05.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:05.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:05.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:05.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:06.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:06.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:06.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:06.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:07.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:07.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:07.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:07.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:08.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~186s 2019-10-23T08:53:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:08.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:08.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:09.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:09.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:09.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:09.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:10.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:10.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:10.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:10.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:11.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:11.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:11.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:11.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:12.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:12.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:12.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:12.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:13.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:13.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:13.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:13.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:14.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~193s 2019-10-23T08:53:14.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:14.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:14.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:14.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:15.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:15.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:15.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:15.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:16.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:16.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:16.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:16.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:17.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:17.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:17.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:17.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:18.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:18.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:18.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:18.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:19.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:19.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:19.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:19.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:20.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~199s 2019-10-23T08:53:20.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:20.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:20.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:20.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:21.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:21.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:21.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:21.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:22.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:22.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:22.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:22.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:23.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:23.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:23.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:23.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:24.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:24.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:24.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:24.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:25.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:25.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:25.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:25.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:26.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:26.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:26.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:26.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:26.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2019-10-23T08:53:27.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:27.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:27.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:27.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:28.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:28.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:28.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:28.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:29.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:29.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:29.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:29.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:30.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:30.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:30.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:30.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:31.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:31.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:31.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:31.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:32.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:32.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:32.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:32.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:33.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~211s 2019-10-23T08:53:33.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:33.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:33.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:33.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:34.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:34.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:34.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:34.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:35.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:35.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:35.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:35.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:36.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:36.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:36.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:36.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:37.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:37.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:37.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:37.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:38.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:38.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:38.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:38.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:39.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~218s 2019-10-23T08:53:39.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:39.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:39.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:39.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:40.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:40.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:40.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:40.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:41.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:41.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:41.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:41.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:42.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:42.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:42.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:42.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:43.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:43.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:43.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:43.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:44.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:44.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:44.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:44.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:45.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~224s 2019-10-23T08:53:45.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:45.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:45.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:45.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:46.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:46.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:46.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:46.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:47.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:47.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:47.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:47.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:48.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:48.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:48.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:48.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:49.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:49.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:49.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:49.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:50.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:50.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:50.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:50.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:51.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2019-10-23T08:53:51.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:51.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:51.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:51.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:52.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:52.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:52.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:52.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:53.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:53.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:53.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:53.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:54.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:54.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:54.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:54.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:55.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:55.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:55.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:55.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:56.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:56.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:56.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:56.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:57.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~236s 2019-10-23T08:53:57.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:58.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:57.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:58.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:59.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:59.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:59.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:59.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:53:59.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:59.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:53:59.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:53:59.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:01.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:01.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:01.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:01.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:02.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:02.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:02.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:02.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:03.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:03.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:03.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:03.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:03.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:04.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:03.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:04.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:04.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~242s 2019-10-23T08:54:05.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:05.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:05.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:05.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:05.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:05.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:05.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:05.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:07.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:07.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:07.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:07.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:08.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:08.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:08.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:08.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:08.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:08.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:08.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:08.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:09.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:09.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:09.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:09.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:10.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~249s 2019-10-23T08:54:10.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:10.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:10.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:10.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:11.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:11.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:11.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:11.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:12.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:12.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:12.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:12.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:13.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:13.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:13.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:13.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:14.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:14.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:14.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:14.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:15.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:16.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:15.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:16.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:16.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2019-10-23T08:54:16.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:17.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:16.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:17.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:18.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:18.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:18.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:18.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:19.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:19.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:19.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:19.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:20.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:20.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:20.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:20.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:21.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:21.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:21.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:21.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:22.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:22.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:22.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:22.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:22.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~261s 2019-10-23T08:54:23.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:23.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:23.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:23.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:24.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:24.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:24.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:24.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:25.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:25.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:25.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:25.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:26.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:26.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:26.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:26.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:27.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:27.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:27.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:27.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:28.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:28.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:28.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:28.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:28.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~267s 2019-10-23T08:54:29.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:29.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:29.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:29.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:29.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:30.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:30.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:30.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:30.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:30.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:30.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:30.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:31.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:32.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:31.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:32.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:32.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:33.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:32.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:33.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:33.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:33.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:33.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:33.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:34.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:34.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:34.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:34.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:35.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~273s 2019-10-23T08:54:35.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:35.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:35.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:35.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:36.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:36.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:36.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:36.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:37.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:37.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:37.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:37.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:38.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:38.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:38.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:38.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:39.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:39.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:39.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:39.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:40.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:40.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:40.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:40.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:41.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~280s 2019-10-23T08:54:41.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:41.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:41.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:41.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:42.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:42.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:42.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:42.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:43.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:43.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:43.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:43.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:44.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:44.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:44.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:44.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:45.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:45.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:45.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:45.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:46.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:46.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:46.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:46.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:47.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~286s 2019-10-23T08:54:47.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:47.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:47.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:47.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:48.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:48.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:48.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:48.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:49.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:49.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:49.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:49.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:50.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:50.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:50.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:50.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:51.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:51.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:51.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:51.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:52.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:52.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:52.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:52.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:53.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:53.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:53.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:53.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:53.825 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~292s 2019-10-23T08:54:54.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:54.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:54.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:54.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:55.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:55.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:55.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:55.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:56.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:56.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:56.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:56.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:57.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:57.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:57.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:57.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:58.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:58.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:58.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:58.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:54:59.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:59.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:54:59.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:54:59.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:00.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~298s 2019-10-23T08:55:00.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:00.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:00.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:00.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:01.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:01.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:01.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:01.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:02.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:02.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:02.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:02.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:03.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:03.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:03.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:03.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:04.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:04.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:04.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:04.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:05.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:05.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:05.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:05.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:06.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~305s 2019-10-23T08:55:06.249 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-10-23T08:55:06.249 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-testing2/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-10-23T08:55:06.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:06.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:06.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:06.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:07.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:07.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:07.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:07.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:08.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:08.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:08.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:08.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:09.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:09.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:09.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:09.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:10.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:10.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:10.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:10.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:11.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:11.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:11.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:11.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:12.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:12.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:12.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:12.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:13.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:13.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:13.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:13.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:14.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:14.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:14.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:14.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:15.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:15.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:15.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:15.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:16.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:16.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:16.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:16.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:17.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:17.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:17.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:17.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:18.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:18.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:18.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:18.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:19.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:19.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:19.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:19.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:20.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:20.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:20.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:20.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:21.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:21.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:21.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:21.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:22.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:22.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:22.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:22.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:23.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:23.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:23.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:23.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:24.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:24.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:24.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:24.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:25.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:25.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:25.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:25.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:26.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:26.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:26.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:26.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:27.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:27.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:27.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:27.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:28.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:28.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:28.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:28.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:29.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:29.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:29.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:29.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:30.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:30.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:30.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:30.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:31.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:31.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:31.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:31.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:32.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:32.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:32.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:32.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:33.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:33.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:33.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:33.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:34.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:34.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:34.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:34.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:35.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:35.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:35.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:35.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:36.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:36.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:36.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:36.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:37.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:37.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:37.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:37.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:38.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:38.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:38.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:38.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:39.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:39.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:39.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:39.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:40.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:40.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:40.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:40.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:41.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:41.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:41.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:41.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:42.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:42.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:42.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:42.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:43.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:43.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:43.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:43.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:44.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:44.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:44.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:44.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:45.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:45.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:45.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:45.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:46.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:46.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:46.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:46.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:47.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:47.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:47.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:47.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:48.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:48.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:48.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:48.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:49.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:49.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:49.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:49.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:50.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:50.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:50.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:50.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:51.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:51.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:51.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:51.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:52.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:52.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:52.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:52.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:53.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:53.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:53.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:53.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:54.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:54.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:54.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:54.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:55.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:55.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:55.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:55.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:56.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:56.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:56.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:56.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:57.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:57.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:57.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:57.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:55:59.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:59.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:55:59.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:55:59.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:00.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:00.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:00.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:00.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:00.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:00.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:00.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:00.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:01.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:01.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:01.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:01.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:02.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:02.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:02.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:02.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:03.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:03.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:03.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:03.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:04.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:04.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:04.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:04.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:05.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:05.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:05.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:05.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:06.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:06.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:06.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:06.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:07.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:07.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:07.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:07.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:08.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:08.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:08.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:08.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:09.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:09.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:09.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:09.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:10.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:10.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:10.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:10.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:11.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:11.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:11.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:11.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:12.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:12.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:12.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:12.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:13.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:13.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:13.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:13.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:14.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:14.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:14.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:14.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:15.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:15.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:15.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:15.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:16.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:16.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:16.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:16.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:17.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:17.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:17.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:17.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:18.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:19.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:18.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:19.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:19.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:20.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:19.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:20.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:20.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:21.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:20.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:21.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:22.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:22.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:22.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:22.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:22.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:22.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:22.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:22.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:23.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:23.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:23.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:23.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:24.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:24.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:24.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:24.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:25.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:25.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:25.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:25.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:26.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:26.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:26.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:26.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:27.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:27.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:27.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:27.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:28.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:28.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:28.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:28.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:29.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:29.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:29.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:29.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:30.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:30.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:30.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:30.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:31.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:31.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:31.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:31.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:32.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:32.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:32.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:32.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:33.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:33.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:33.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:33.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:34.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:34.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:34.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:34.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:35.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:35.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:35.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:35.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:36.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:36.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:36.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:36.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:37.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:37.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:37.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:37.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:38.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:38.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:38.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:38.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:39.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:39.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:39.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:39.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:40.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:40.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:40.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:40.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:41.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:41.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:41.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:41.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:42.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:42.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:42.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:42.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:43.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:43.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:43.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:43.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:44.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:44.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:44.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:44.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:45.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:45.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:45.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:45.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:46.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:46.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:46.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:46.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:47.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:47.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:47.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:47.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:48.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:48.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:48.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:48.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:49.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:49.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:49.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:49.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:50.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:50.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:50.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:50.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:51.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:51.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:51.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:51.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:52.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:52.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:52.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:52.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:53.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:53.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:53.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:53.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:54.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:54.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:54.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:54.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:55.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:55.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:55.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:55.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:56.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:56.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:56.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:56.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:57.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:57.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:57.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:57.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:58.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:58.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:58.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:58.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:56:59.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:59.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:56:59.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:56:59.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:00.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:00.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:00.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:00.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:01.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:01.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:01.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:01.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:02.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:02.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:02.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:02.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:03.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:03.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:03.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:03.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:04.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:04.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:04.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:04.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:05.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:05.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:05.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:05.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:06.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:06.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:06.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:06.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:07.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:07.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:07.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:07.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:08.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:08.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:08.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:08.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:09.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:09.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:09.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:09.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:10.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:10.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:10.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:10.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:11.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:11.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:11.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:11.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:12.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:12.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:12.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:12.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:13.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:13.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:13.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:13.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:14.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:14.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:14.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:14.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:15.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:15.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:15.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:15.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:16.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:16.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:16.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:16.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:17.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:17.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:17.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:17.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:18.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:18.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:18.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:18.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:19.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:19.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:19.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:19.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:20.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:20.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:20.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:20.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:21.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:21.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:21.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:21.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:22.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:22.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:22.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:22.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:23.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:23.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:23.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:23.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:24.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:24.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:24.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:24.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:25.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:25.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:25.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:25.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:26.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:26.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:26.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:26.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:27.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:27.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:27.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:27.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:28.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:28.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:28.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:28.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:29.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:29.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:29.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:29.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:30.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:30.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:30.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:30.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:31.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:31.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:31.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:31.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:32.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:32.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:32.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:32.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:33.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:33.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:33.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:33.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:34.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:34.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:34.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:34.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:35.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:35.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:35.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:35.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:36.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:36.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:36.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:36.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:37.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:37.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:37.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:37.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:38.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:38.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:38.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:38.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:39.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:39.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:39.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:39.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:40.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:40.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:40.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:40.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:41.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:41.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:41.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:41.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:42.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:42.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:42.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:42.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:43.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:43.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:43.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:43.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:44.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:44.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:44.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:44.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:45.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:45.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:45.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:45.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:46.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:46.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:46.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:46.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:47.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:47.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:47.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:47.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:48.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:48.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:48.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:48.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:49.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:49.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:49.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:49.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:50.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:50.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:50.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:50.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:51.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:51.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:51.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:51.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:52.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:52.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:52.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:52.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:53.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:53.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:53.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:53.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:54.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:54.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:54.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:54.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:55.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:55.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:55.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:55.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:56.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:56.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:56.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:56.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:57.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:57.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:57.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:57.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:58.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:58.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:58.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:58.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:57:59.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:59.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:57:59.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:57:59.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:00.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:00.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:00.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:00.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:01.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:01.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:01.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:01.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:02.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:02.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:02.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:02.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:03.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:03.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:03.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:03.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:04.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:04.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:04.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:04.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:05.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:05.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:05.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:05.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:06.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:06.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:06.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:06.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:07.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:07.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:07.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:07.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:08.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:08.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:08.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:08.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:09.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:09.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:09.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:09.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:10.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:10.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:10.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:10.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:11.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:11.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:11.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:11.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:12.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:12.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:12.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:12.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:13.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:13.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:13.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:13.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:14.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:14.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:14.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:14.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:15.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:15.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:15.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:15.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:16.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:16.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:16.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:16.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:17.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:17.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:17.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:17.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:18.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:18.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:18.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:18.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:19.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:19.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:19.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:19.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:20.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:20.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:20.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:20.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:21.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:21.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:21.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:21.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:22.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:22.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:22.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:22.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:23.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:23.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:23.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:23.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:24.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:24.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:24.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:24.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:25.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:25.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:25.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:25.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:26.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:26.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:27.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:27.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:27.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:27.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:28.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:28.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:28.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:28.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:29.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:29.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:29.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:29.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:30.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:30.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:30.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:30.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:31.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:31.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:31.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:31.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:32.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:32.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:32.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:32.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:33.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:33.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:33.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:33.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:34.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:34.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:34.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:34.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:35.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:35.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:35.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:35.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:36.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:36.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:36.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:36.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:37.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:37.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:37.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:37.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:38.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:38.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:38.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:38.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:39.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:39.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:39.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:39.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:40.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:40.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:40.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:40.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:41.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:41.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:42.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:42.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:42.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:42.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:43.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:43.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:43.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:43.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:44.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:44.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:44.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:44.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:45.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:45.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:45.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:45.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:46.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:46.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:46.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:46.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:47.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:47.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:47.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:47.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:48.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:48.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:48.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:48.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:49.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:49.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:50.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:50.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:50.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:50.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:51.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:51.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:51.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:51.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:52.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:52.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:52.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:52.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:53.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:53.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:53.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:53.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:54.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:54.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:54.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:54.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:55.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:55.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:55.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:55.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:56.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:56.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:56.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:56.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:57.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:57.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:57.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:57.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:58.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:58.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:58.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:58.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:58:59.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:59.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:58:59.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:58:59.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:00.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:00.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:00.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:00.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:01.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:01.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:01.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:01.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:02.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:02.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:02.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:02.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:03.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:03.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:03.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:03.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:04.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:04.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:04.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:04.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:06.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:06.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:06.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:06.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:06.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:07.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:06.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:07.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:08.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:08.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:08.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:08.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:09.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:09.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:09.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:09.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:10.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:10.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:10.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:10.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:11.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:11.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:11.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:11.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:12.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:12.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:12.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:12.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:13.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:13.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:13.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:13.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:14.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:14.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:14.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:14.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:15.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:15.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:15.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:15.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:16.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:16.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:16.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:16.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:17.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:17.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:17.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:17.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:18.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:18.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:18.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:18.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:19.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:19.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:19.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:19.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:20.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:20.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:20.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:20.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:21.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:21.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:21.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:21.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:22.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:22.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:22.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:22.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:23.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:23.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:23.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:23.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:24.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:24.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:24.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:24.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:25.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:25.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:25.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:25.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:26.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:26.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:26.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:26.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:27.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:27.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:27.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:27.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:28.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:28.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:28.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:28.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:29.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:29.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:29.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:29.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:30.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:30.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:30.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:30.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:31.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:31.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:31.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:31.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:32.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:32.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:32.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:32.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:33.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:33.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:33.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:33.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:34.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:34.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:34.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:34.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:35.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:35.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:35.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:35.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:36.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:36.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:36.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:36.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:37.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:37.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:37.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:37.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:38.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:38.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:38.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:38.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:39.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:39.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:39.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:39.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:40.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:40.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:40.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:40.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:41.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:41.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:41.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:41.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:42.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:42.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:42.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:42.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:43.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:43.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:43.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:43.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:44.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:44.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:44.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:44.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:45.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:45.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:45.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:45.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:46.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:46.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:46.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:46.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:47.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:47.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:47.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:47.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:48.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:48.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:48.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:48.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:49.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:49.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:49.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:49.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:50.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:50.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:50.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:50.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:51.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:51.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:51.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:51.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:52.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:52.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:52.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:52.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:53.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:53.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:53.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:53.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:54.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:54.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:54.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:54.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:55.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:55.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:55.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:55.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:56.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:56.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:56.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:56.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:57.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:57.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:57.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:57.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:58.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:58.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:58.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:58.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T08:59:59.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:59.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T08:59:59.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T08:59:59.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:00.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:00.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:00.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:00.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:01.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:01.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:01.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:01.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:02.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:02.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:02.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:02.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:03.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:03.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:03.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:03.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:03.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:03.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:03.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:03.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:04.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:04.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:04.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:04.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:05.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:05.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:05.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:05.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:06.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:06.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:06.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:06.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:07.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:07.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:07.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:07.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:08.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:08.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:08.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:08.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:09.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:09.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:09.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:09.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:10.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:10.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:10.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:10.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:11.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:11.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:11.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:11.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:12.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:13.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:12.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:13.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:13.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:13.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:13.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:13.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:14.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:14.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:14.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:14.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:15.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:15.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:15.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:15.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:16.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:16.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:16.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:16.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:17.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:17.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:17.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:17.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:18.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:18.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:18.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:18.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:19.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:19.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:19.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:19.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:20.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:20.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:20.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:20.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:21.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:21.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:21.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:21.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:22.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:22.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:22.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:22.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:23.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:23.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:23.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:23.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:24.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:24.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:24.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:24.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:25.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:25.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:25.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:25.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:26.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:26.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:26.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:26.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:27.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:27.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:27.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:27.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:28.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:28.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:28.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:28.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:29.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:29.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:29.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:29.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:30.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:30.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:30.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:30.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:31.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:31.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:31.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:31.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:32.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:32.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:32.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:32.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:33.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:33.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:33.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:33.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:34.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:34.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:34.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:34.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:35.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:35.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:35.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:35.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:36.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:36.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 since back 2019-10-23T08:47:41.279478+0000 front 2019-10-23T08:47:41.279491+0000 (oldest deadline 2019-10-23T08:50:17.885560+0000) 2019-10-23T09:00:36.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:36.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:37.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:37.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:38.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:38.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:39.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:39.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:40.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:40.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:41.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:41.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:42.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:42.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:43.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:43.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:44.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:44.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:45.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:45.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:46.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:46.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:47.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:47.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:48.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:48.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:49.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:49.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:50.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:50.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:51.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:51.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:52.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:52.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:53.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:53.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:54.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:54.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:55.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:55.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:56.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:56.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:57.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:58.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:58.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:58.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:00:59.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:59.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:00:59.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:00:59.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:00.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:00.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:00.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:00.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:01.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:01.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:01.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:01.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:02.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:02.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:02.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:02.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:03.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:03.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:03.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:03.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:04.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:04.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:04.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:04.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:05.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:05.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:05.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:05.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:06.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:06.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:06.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:06.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:07.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:07.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:07.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:07.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:08.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:08.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:08.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:08.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:09.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:09.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:10.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:10.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:10.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:10.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:11.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:11.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:11.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:11.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:12.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:12.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:12.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:12.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:13.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:13.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:13.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:13.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:14.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:14.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:14.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:14.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:15.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:15.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:15.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:15.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:16.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:16.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:16.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:16.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:17.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:17.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:17.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:17.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:18.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:18.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:18.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:18.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:19.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:19.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:19.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:19.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:20.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:20.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:20.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:20.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:21.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:21.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:22.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:22.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:22.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:22.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:23.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:23.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:23.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:23.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:24.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:24.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:24.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:24.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:25.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:25.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:25.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:25.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:26.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:26.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:26.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:26.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:27.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:27.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:27.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:27.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:28.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:28.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:28.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:28.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:29.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:29.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:29.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:29.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:30.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:30.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:30.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:30.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:31.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:31.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:31.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:31.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:32.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:32.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:32.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:32.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:33.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:33.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:33.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:33.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:34.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:34.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:34.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:34.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:35.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:35.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:36.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:36.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:36.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:36.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:37.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:37.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:37.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:37.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:38.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:38.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:38.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:38.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:39.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:39.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:39.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:39.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:40.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:40.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:40.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:40.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:42.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:42.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:42.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:42.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:42.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:43.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:42.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:43.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:43.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:43.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:43.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:43.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:44.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:44.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:44.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:44.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:45.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:45.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:45.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:45.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:46.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:46.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:46.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:46.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:47.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:47.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:47.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:47.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:48.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:48.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:48.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:48.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:49.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:49.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:49.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:49.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:50.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:50.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:50.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:50.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:51.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:51.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:51.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:51.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:52.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:52.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:52.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:52.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:53.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:53.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:53.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:53.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:54.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:54.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:54.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:54.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:56.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:56.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:56.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:56.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:56.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:56.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:56.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:56.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:58.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:58.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:58.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:58.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:01:59.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:59.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:01:59.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:01:59.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:00.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:00.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:00.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:00.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:01.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:01.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:01.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:01.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:02.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:02.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:02.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:02.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:03.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:03.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:03.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:03.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:04.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:04.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:04.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:04.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:04.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:05.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:04.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:05.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:06.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:06.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:06.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:06.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:07.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:07.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:07.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:07.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:07.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:07.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:07.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:07.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:09.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:09.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:09.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:09.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:10.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:10.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:10.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:10.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:11.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:11.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:11.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:11.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:12.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:12.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:12.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:12.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:12.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:12.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:12.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:12.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:14.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:14.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:14.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:14.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:14.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:14.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:14.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:14.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:15.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:15.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:15.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:15.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:16.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:16.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:16.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:16.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:17.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:17.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:17.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:17.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:18.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:18.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:18.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:18.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:19.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:19.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:19.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:19.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:20.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:20.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:20.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:20.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:21.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:21.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:21.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:21.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:22.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:22.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:22.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:22.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:23.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:23.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:23.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:23.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:24.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:24.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:24.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:24.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:25.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:25.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:25.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:25.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:26.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:26.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:26.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:26.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:27.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:27.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:27.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:27.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:28.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:28.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:28.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:28.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:29.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:29.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:29.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:29.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:30.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:30.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:30.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:30.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:31.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:31.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:31.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:31.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:32.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:32.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:32.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:32.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:33.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:33.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:33.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:33.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:34.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:34.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:34.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:34.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:35.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:35.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:35.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:35.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:36.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:36.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:36.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:36.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:37.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:37.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:37.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:37.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:38.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:38.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:38.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:38.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:39.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:39.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:39.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:39.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:40.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:40.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:40.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:40.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:41.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:41.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:41.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:41.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:42.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:42.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:42.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:42.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:43.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:43.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:43.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:43.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:44.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:44.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:44.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:44.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:45.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:45.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:46.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:46.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:46.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:46.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:47.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:47.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:48.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:48.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:48.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:48.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:49.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:49.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:49.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:49.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:50.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:50.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:50.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:50.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:51.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:51.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:51.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:51.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:52.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:52.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:52.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:52.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:53.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:53.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:53.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:53.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:54.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:54.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:54.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:54.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:55.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:55.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:55.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:55.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:56.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:56.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:56.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:56.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:57.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:57.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:57.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:57.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:58.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:58.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:58.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:58.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:02:59.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:59.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:02:59.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:02:59.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:00.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:00.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:00.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:00.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:01.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:01.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:01.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:01.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:02.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:02.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:02.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:02.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:03.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:03.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:03.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:03.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:04.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:04.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:04.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:04.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:05.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:05.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:05.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:05.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:06.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:06.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:06.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:06.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:07.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:07.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:07.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:07.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:08.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:08.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:08.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:08.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:09.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:09.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:09.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:09.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:10.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:10.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:10.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:10.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:11.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:11.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:11.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:11.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:12.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:12.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:12.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:12.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:13.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:13.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:13.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:13.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:14.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:14.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:14.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:14.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:15.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:15.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:15.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:15.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:16.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:16.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:16.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:16.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:18.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:18.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:18.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:18.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:19.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:19.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:19.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:19.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:19.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:19.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:19.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:19.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:20.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:20.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:21.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:20.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:22.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:22.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:22.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:22.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:22.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:22.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:22.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:22.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:23.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:23.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:23.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:23.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:24.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:24.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:24.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:24.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:25.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:25.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:25.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:25.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:26.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:26.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:26.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:26.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:27.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:27.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:27.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:27.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:28.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:28.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:28.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:28.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:29.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:29.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:29.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:29.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:30.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:30.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:30.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:30.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:31.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:31.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:31.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:31.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:32.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:32.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:32.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:32.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:33.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:33.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:33.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:33.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:34.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:34.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:34.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:34.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:35.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:35.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:35.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:35.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:36.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:36.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:36.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:36.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:37.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:37.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:37.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:37.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:38.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:38.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:38.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:38.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:39.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:39.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:39.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:39.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:40.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:40.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:40.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:40.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:41.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:41.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:41.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:41.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:42.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:42.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:42.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:42.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:43.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:43.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:43.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:43.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:44.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:44.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:44.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:44.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:45.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:45.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:45.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:45.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:46.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:46.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:46.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:46.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:47.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:47.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:47.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:47.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:48.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:48.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:48.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:48.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:49.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:49.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:49.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:49.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:50.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:50.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:50.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:50.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:51.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:51.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:51.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:51.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:52.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:52.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:52.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:52.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:53.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:53.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:53.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:53.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:54.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:54.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:54.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:54.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:55.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:55.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:55.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:55.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:56.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:56.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:56.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:56.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:57.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:57.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:57.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:57.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:58.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:58.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:58.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:58.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:03:59.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:59.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:03:59.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:03:59.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:00.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:00.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:00.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:00.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:01.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:01.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:01.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:01.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:02.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:02.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:02.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:02.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:03.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:03.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:03.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:03.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:04.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:04.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:04.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:04.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:05.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:05.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:05.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:05.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:06.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:06.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:06.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:06.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:07.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:07.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:07.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:07.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:08.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:08.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:08.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:08.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:09.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:09.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:09.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:09.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:10.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:10.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:10.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:10.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:11.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:11.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:11.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:11.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:12.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:12.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:12.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:12.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:13.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:13.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:13.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:13.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:14.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:14.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:14.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:14.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:15.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:15.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:15.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:15.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:16.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:16.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:16.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:16.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:17.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:17.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:17.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:17.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:18.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:18.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:18.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:18.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:19.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:19.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:19.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:19.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:20.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:20.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:20.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:20.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:21.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:21.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:21.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:21.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:22.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:22.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:22.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:22.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:23.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:23.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:23.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:23.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:24.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:24.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:24.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:24.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:25.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:25.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:25.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:25.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:26.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:26.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:26.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:26.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:27.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:27.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:27.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:27.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:28.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:28.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:28.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:28.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:29.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:29.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:29.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:29.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:30.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:30.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:30.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:30.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:31.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:31.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:31.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:31.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:32.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:32.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:32.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:32.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:33.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:33.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:33.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:33.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:34.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:34.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:34.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:34.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:35.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:35.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:35.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:35.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:36.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:36.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:36.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:36.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:37.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:37.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:37.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:37.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:38.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:38.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:38.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:38.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:39.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:39.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:39.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:39.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:40.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:40.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:40.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:40.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:41.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:41.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:41.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:41.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:42.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:42.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:42.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:42.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:43.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:43.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:43.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:43.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:44.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:44.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:44.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:44.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:45.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:45.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:45.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:45.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:46.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:46.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:46.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:46.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:47.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:47.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:47.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:47.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:48.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:48.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:48.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:48.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:49.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:49.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:49.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:49.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:50.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:50.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:50.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:50.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:51.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:51.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:51.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:51.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:52.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:52.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:52.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:52.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:53.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:53.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:53.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:53.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:54.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:54.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:54.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:54.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:55.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:55.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:55.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:55.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:56.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:56.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:56.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:56.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:57.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:57.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:57.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:57.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:58.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:58.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:58.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:58.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:04:59.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:59.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:04:59.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:04:59.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:00.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:00.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:00.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:00.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:01.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:01.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:01.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:01.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:02.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:02.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:02.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:02.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:03.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:03.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:03.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:03.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:04.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:04.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:04.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:04.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:05.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:05.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:05.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:05.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:06.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:06.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:06.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:06.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:07.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:07.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:07.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:07.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:08.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:08.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:08.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:08.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:09.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:09.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:09.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:09.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:10.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:10.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:10.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:10.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:11.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:11.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:11.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:11.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:12.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:12.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:12.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:12.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:13.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:13.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:13.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:13.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:14.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:14.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:14.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:14.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:15.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:15.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:15.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:15.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:16.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:16.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:16.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:16.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:17.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:17.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:17.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:17.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:18.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:18.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:18.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:18.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:19.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:19.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:19.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:19.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:20.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:20.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:20.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:20.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:21.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:21.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:21.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:21.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:22.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:22.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:22.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:22.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:23.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:23.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:23.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:23.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:24.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:24.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:24.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:24.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:25.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:25.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:25.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:25.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:26.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:26.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:26.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:26.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:27.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:27.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:27.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:27.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:28.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:28.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:28.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:28.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:29.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:29.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:29.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:29.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:30.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:30.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:30.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:30.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:31.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:31.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:31.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:31.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:32.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:32.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:32.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:32.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:33.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:33.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:33.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:33.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:34.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:34.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:34.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:34.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:35.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:35.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:35.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:35.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:36.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:36.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:36.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:36.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:37.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:37.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:37.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:37.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:38.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:38.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:38.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:38.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:39.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:39.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:39.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:39.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:40.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:40.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:40.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:40.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:41.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:41.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:41.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:41.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:42.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:42.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:42.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:42.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:43.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:43.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:43.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:43.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:44.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:44.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:44.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:44.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:45.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:45.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:45.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:45.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:46.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:46.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:46.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:46.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:47.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:47.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:47.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:47.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:48.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:48.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:48.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:48.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:49.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:49.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:50.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:50.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:50.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:50.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:51.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:51.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:51.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:51.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:52.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:52.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:52.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:52.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:53.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:53.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:53.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:53.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:54.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:54.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:54.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:54.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:55.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:55.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:55.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:55.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:56.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:56.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:56.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:56.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:57.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:57.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:57.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:57.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:58.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:58.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:58.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:58.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:05:59.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:59.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:05:59.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:05:59.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:00.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:00.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:00.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:00.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:01.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:01.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:01.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:01.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:02.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:02.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:02.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:02.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:03.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:03.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:03.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:03.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:04.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:04.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:04.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:04.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:05.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:05.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:05.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:05.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:06.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:06.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:06.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:06.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:07.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:07.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:07.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:07.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:08.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:08.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:08.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:08.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:09.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:09.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:09.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:09.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:10.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:10.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:10.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:10.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:11.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:11.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:11.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:11.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:12.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:12.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:12.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:12.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:13.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:13.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:13.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:13.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:14.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:14.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:14.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:14.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:15.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:15.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:15.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:15.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:16.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:16.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:16.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:16.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:17.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:17.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:17.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:17.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:18.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:18.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:18.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:18.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:19.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:19.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:19.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:19.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:20.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:20.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:20.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:20.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:21.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:21.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:21.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:21.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:22.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:22.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:22.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:22.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:23.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:23.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:23.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:23.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:24.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:24.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:24.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:24.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:25.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:25.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:25.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:25.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:26.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:26.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:26.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:26.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:27.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:27.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:27.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:27.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:28.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:28.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:28.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:28.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:29.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:29.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:29.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:29.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:30.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:30.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:30.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:30.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:31.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:31.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:31.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:31.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:32.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:32.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:32.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:32.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:33.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:33.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:33.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:33.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:34.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:34.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:34.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:34.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:35.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:35.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:35.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:35.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:36.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:36.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:36.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:36.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:37.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:37.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:37.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:37.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:38.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:38.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:38.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:38.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:39.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:39.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:39.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:39.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:40.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:40.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:40.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:40.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:41.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:41.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:41.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:41.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:42.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:42.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:42.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:42.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:43.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:43.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:43.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:43.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:44.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:44.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:44.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:44.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:45.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:45.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:45.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:45.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:46.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:46.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:46.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:46.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:47.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:47.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:47.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:47.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:48.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:48.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:48.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:48.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:49.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:49.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:49.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:49.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:50.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:50.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:50.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:50.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:51.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:51.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:51.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:51.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:52.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:52.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:52.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:52.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:53.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:53.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:53.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:53.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:54.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:54.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:54.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:54.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:55.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:55.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:55.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:55.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:56.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:56.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:56.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:56.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:57.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:57.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:57.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:57.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:58.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:58.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:58.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:58.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:06:59.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:59.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:06:59.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:06:59.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:00.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:00.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:00.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:00.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:01.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:01.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:01.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:01.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:02.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:02.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:02.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:02.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:03.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:03.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:03.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:03.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:04.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:04.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:04.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:04.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:05.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:05.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:05.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:05.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:06.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:06.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:06.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:06.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:07.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:07.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:07.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:07.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:08.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:08.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:08.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:08.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:09.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:09.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:09.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:09.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:10.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:10.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:10.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:10.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:11.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:11.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:11.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:11.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:12.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:12.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:12.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:12.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:13.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:13.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:13.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:13.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:14.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:14.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:14.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:14.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:15.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:15.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:15.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:15.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:16.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:16.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:16.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:16.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:17.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:17.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:17.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:17.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:18.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:18.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:18.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:18.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:19.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:19.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:19.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:19.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:20.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:20.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:20.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:20.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:21.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:21.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:21.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:21.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:22.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:22.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:22.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:22.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:23.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:23.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:23.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:23.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:24.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:24.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:24.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:24.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:25.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:25.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:25.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:25.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:26.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:26.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:26.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:26.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:27.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:27.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:27.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:27.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:28.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:28.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:28.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:28.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:29.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:29.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:29.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:29.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:30.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:30.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:30.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:30.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:31.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:31.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:31.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:31.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:32.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:32.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:32.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:32.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:33.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:33.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:33.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:33.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:34.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:34.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:34.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:34.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:35.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:35.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:35.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:35.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:36.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:36.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:36.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:36.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:37.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:37.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:37.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:37.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:39.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:39.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:39.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:39.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:40.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:40.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:40.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:40.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:41.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:41.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:41.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:41.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:42.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:42.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:42.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:42.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:43.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:43.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:43.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:43.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:44.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:44.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:44.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:44.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:45.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:45.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:45.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:45.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:46.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:46.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:46.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:46.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:47.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:47.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:47.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:47.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:48.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:48.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:48.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:48.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:49.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:49.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:49.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:49.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:50.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:50.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:50.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:50.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:51.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:51.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:51.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:51.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:52.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:52.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:52.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:52.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:53.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:53.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:53.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:53.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:54.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:54.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:54.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:54.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:55.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:55.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:55.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:55.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:56.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:56.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:56.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:56.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:57.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:57.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:57.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:57.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:58.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:58.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:58.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:58.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:07:59.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:59.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:07:59.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:07:59.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:00.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:00.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:00.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:00.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:01.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:01.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:01.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:01.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:01.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:01.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:01.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:01.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:02.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:02.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:02.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:02.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:04.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:03.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:04.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:03.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:05.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:05.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:05.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:05.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:05.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:05.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:05.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:05.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:06.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:06.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:06.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:06.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:08.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:07.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:08.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:07.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:09.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:09.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:09.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:09.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:10.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:10.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:10.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:10.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:11.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:11.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:11.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:11.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:11.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:11.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:11.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:11.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:12.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:12.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:12.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:12.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:13.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:13.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:13.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:13.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:14.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:14.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:14.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:14.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:15.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:15.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:15.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:15.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:16.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:16.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:16.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:16.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:17.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:17.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:17.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:17.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:18.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:18.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:18.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:18.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:19.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:19.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:19.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:19.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:20.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:20.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:20.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:20.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:21.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:21.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:21.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:21.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:22.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:22.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:22.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:22.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:23.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:23.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:23.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:23.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:24.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:24.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:24.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:24.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:25.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:25.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:25.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:25.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:26.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:26.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:26.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:26.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:27.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:27.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:27.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:27.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:28.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:28.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:28.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:28.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:29.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:29.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:29.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:29.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:30.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:30.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:30.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:30.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:31.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:31.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:31.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:31.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:32.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:32.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:32.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:32.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:33.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:33.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:33.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:33.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:34.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:34.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:34.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:34.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:35.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:35.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:35.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:35.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:36.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:36.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:36.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:36.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:37.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:37.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:37.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:37.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:38.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:38.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:38.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:38.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:39.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:39.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:39.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:39.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:40.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:40.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:40.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:40.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:41.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:41.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:41.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:41.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:42.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:42.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:42.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:42.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:43.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:43.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:43.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:43.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:44.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:44.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:44.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:44.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:45.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:45.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:45.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:45.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:46.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:46.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:46.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:46.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:47.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:47.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:47.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:47.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:48.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:48.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:48.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:48.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:49.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:49.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:49.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:49.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:50.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:50.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:50.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:50.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:51.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:51.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:51.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:51.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:52.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:52.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:52.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:52.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:53.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:53.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:53.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:53.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:54.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:54.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:54.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:54.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:55.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:55.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:55.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:55.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:56.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:56.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:56.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:56.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:57.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:57.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:57.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:57.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:08:58.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:58.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:08:58.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:08:58.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:00.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:00.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:00.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:00.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:01.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:01.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:01.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:01.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:01.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:01.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:01.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:01.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:02.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:02.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:02.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:02.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:03.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:03.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:03.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:03.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:04.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:04.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:04.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:04.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:05.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:05.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:05.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:05.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:06.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:06.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:06.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:06.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:07.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:07.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:07.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:07.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:08.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:08.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:08.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:08.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:09.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:09.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:09.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:09.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:10.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:10.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:10.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:10.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:11.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:11.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:11.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:11.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:12.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:12.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:12.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:12.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:13.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:13.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:13.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:13.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:14.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:14.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:14.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:14.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:15.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:15.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:15.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:15.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:16.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:16.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:16.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:16.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:17.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:17.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:17.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:17.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:18.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:18.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:18.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:18.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:19.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:19.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:19.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:19.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:20.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:20.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:20.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:20.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:21.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:21.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:21.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:21.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:22.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:22.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:22.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:22.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:23.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:23.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:23.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:23.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:24.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:24.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:24.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:24.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:25.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:25.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:25.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:25.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:26.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:26.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:26.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:26.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:28.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:28.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:28.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:28.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:29.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:29.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:29.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:29.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:29.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:29.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:29.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:29.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:30.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:30.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:30.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:30.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:31.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:31.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:31.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:31.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:32.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:32.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:32.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:32.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:34.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:34.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:34.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:34.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:34.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:34.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:34.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:34.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:36.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:36.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:36.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:36.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:36.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:36.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:36.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:36.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:38.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:38.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:38.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:38.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:39.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:39.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:39.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:39.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:40.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:40.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:40.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:40.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:41.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:41.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:41.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:41.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:42.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:42.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:42.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:42.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:43.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:43.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:43.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:44.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:44.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:44.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:44.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:45.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:45.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:45.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:45.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:46.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:46.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:46.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:46.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:47.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:47.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:47.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:47.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:48.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:48.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:48.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:48.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:49.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:49.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:49.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:49.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:50.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:50.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:50.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:50.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:51.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:51.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:51.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:51.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:52.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:52.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:52.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:52.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:53.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:53.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:53.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:53.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:54.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:54.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:54.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:54.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:55.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:55.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:55.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:55.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:56.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:56.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:56.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:56.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:57.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:57.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:57.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:57.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:58.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:58.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:58.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:58.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:09:59.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:59.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:09:59.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:09:59.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:00.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:00.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:00.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:00.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:01.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:01.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:01.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:01.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:02.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:02.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:02.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:02.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:03.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:03.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:03.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:03.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:04.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:04.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:04.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:04.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:05.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:05.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:05.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:05.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:06.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:06.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:06.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:06.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:07.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:07.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:07.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:07.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:08.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:08.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:08.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:09.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:09.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:09.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:09.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:10.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:10.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:10.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:10.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:11.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:11.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:11.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:11.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:12.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:12.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:12.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:12.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:13.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:13.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:13.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:13.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:14.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:14.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:14.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:14.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:15.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:15.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:15.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:15.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:16.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:16.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:16.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:16.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:17.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:17.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:17.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:17.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:18.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:18.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:18.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:18.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:18.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:18.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:18.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:18.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:19.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:19.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:19.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:19.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:20.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:20.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:20.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:20.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:21.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:21.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:21.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:21.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:22.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:22.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:22.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:22.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:23.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:23.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:23.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:23.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:24.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:24.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:24.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:24.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:25.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:25.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:25.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:25.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:26.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:26.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:26.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:26.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:27.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:27.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:27.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:27.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:28.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:28.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:29.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:29.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:29.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:29.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:30.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:30.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:30.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:30.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:31.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:31.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:31.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:31.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:32.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:32.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:32.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:32.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:33.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:33.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:33.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:33.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:34.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:34.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:34.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:34.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:35.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:35.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:35.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:35.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:36.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:36.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:36.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:36.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:37.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:37.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:37.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:37.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:38.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:38.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:38.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:38.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:39.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:39.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:39.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:39.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:40.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:40.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:40.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:40.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:41.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:41.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:41.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:41.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:42.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:42.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:42.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:42.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:43.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:43.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:43.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:43.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:44.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:44.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:44.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:44.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:45.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:45.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:45.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:45.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:46.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:46.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:46.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:46.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:47.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:47.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:47.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:47.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:48.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:48.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:48.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:48.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:49.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:49.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:49.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:49.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:50.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:50.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:50.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:50.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:51.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:51.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:51.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:51.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:52.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:52.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:52.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:52.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:53.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:53.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:53.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:53.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:54.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:54.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:54.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:54.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:55.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:55.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:55.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:55.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:56.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:56.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:56.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:56.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:57.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:57.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:57.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:57.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:58.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:58.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:58.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:58.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:10:59.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:59.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:10:59.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:10:59.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:00.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:00.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:00.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:00.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:01.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:01.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:01.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:01.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:02.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:02.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:02.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:02.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:03.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:03.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:03.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:03.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:04.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:04.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:04.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:04.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:05.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:05.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:05.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:05.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:06.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:06.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:06.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:06.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:07.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:07.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:07.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:07.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:08.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:08.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:08.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:08.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:09.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:09.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:09.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:09.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:10.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:10.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:10.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:10.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:11.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:11.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:11.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:11.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:12.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:12.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:00:39.011743+0000 (oldest deadline 2019-10-23T09:00:59.011743+0000) 2019-10-23T09:11:12.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:12.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:13.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:13.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:14.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:14.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:15.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:15.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:16.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:16.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:17.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:17.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:18.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:18.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:19.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:19.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:20.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:20.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:21.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:21.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:22.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:22.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:23.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:23.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:24.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:24.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:25.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:25.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:26.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:26.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:27.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:27.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:28.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:28.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:29.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:29.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:30.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:30.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:31.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:31.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:32.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:32.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:33.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:33.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:34.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:34.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:34.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:34.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:35.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:35.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:35.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:35.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:36.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:36.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:36.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:36.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:37.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:37.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:37.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:37.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:38.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:38.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:38.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:38.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:39.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:39.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:39.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:39.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:40.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:40.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:40.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:40.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:41.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:41.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:41.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:41.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:42.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:42.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:42.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:42.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:43.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:43.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:43.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:43.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:44.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:44.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:44.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:44.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:45.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:45.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:45.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:45.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:46.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:46.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:46.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:46.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:48.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:48.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:48.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:48.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:48.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:48.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:48.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:48.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:49.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:49.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:49.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:49.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:50.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:50.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:51.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:50.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:51.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:51.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:51.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:51.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:53.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:53.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:53.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:53.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:54.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:54.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:54.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:54.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:55.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:55.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:55.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:55.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:56.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:56.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:56.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:56.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:57.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:57.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:57.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:57.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:58.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:58.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:58.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:58.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:11:59.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:59.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:11:59.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:11:59.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:00.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:00.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:00.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:00.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:01.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:01.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:01.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:01.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:02.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:02.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:02.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:02.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:03.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:03.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:03.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:03.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:04.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:04.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:04.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:04.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:05.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:05.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:05.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:05.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:06.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:06.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:06.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:06.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:07.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:07.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:07.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:07.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:07.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:07.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:07.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:07.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:08.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:08.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:09.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:08.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:09.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:09.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:09.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:09.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:10.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:10.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:10.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:10.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:12.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:12.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:12.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:12.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:13.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:13.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:13.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:13.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:14.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:14.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:14.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:14.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:14.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:14.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:14.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:14.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:15.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:15.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:15.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:15.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:16.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:16.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:16.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:16.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:17.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:17.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:17.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:17.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:18.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:18.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:18.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:18.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:19.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:19.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:19.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:19.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:21.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:21.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:21.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:21.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:21.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:21.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:21.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:21.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:23.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:23.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:23.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:23.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:24.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:24.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:24.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:24.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:25.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:25.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:25.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:25.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:26.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:26.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:26.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:26.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:27.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:27.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:27.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:27.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:28.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:28.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:28.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:28.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:29.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:29.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:29.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:29.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:30.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:30.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:30.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:30.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:31.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:31.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:31.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:31.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:32.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:32.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:32.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:32.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:33.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:33.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:33.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:33.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:34.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:34.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:34.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:34.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:35.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:35.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:35.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:35.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:36.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:36.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:36.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:36.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:37.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:37.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:37.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:37.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:38.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:38.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:38.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:38.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:39.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:39.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:39.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:39.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:40.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:40.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:40.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:40.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:41.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:41.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:41.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:41.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:42.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:42.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:42.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:42.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:43.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:43.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:43.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:43.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:44.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:44.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:44.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:44.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:45.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:45.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:45.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:45.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:46.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:46.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:46.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:46.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:47.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:47.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:47.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:47.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:48.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:48.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:48.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:48.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:49.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:49.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:49.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:49.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:50.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:50.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:50.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:50.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:51.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:51.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:51.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:51.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:52.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:52.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:52.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:52.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:53.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:53.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:53.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:53.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:54.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:54.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:54.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:54.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:55.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:55.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:55.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:55.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:56.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:56.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:56.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:56.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:57.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:57.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:57.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:57.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:58.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:58.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:58.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:58.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:12:59.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:59.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:12:59.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:12:59.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:00.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:00.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:00.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:00.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:01.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:01.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:01.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:01.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:02.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:02.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:02.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:02.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:03.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:03.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:03.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:03.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:04.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:04.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:04.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:04.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:05.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:05.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:05.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:05.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:06.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:06.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:06.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:06.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:07.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:07.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:07.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:07.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:08.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:08.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:08.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:08.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:09.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:09.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:09.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:09.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:10.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:10.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:10.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:10.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:11.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:11.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:11.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:11.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:12.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:12.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:12.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:12.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:13.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:13.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:13.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:13.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:14.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:14.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:14.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:14.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:15.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:15.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:15.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:15.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:16.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:16.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:16.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:16.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:17.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:17.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:17.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:17.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:18.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:18.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:18.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:18.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:19.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:19.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:19.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:19.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:20.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:20.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:20.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:20.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:21.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:21.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:21.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:21.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:22.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:22.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:22.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:22.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:23.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:23.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:23.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:23.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:24.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:24.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:24.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:24.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:25.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:25.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:25.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:25.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:26.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:26.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:26.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:26.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:27.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:27.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:27.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:27.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:28.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:28.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:28.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:28.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:29.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:29.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:29.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:29.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:30.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:30.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:30.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:30.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:31.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:31.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:31.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:31.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:32.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:32.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:32.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:32.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:33.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:33.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:33.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:33.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:34.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:34.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:34.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:34.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:35.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:35.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:35.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:35.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:36.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:36.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:36.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:36.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:37.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:37.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:37.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:37.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:38.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:38.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:38.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:38.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:39.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:39.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:39.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:39.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:40.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:40.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:40.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:40.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:41.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:41.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:41.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:41.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:42.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:42.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:42.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:42.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:43.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:43.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:43.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:43.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:44.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:44.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:44.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:44.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:45.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:45.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:45.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:45.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:46.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:46.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:46.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:46.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:47.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:47.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:47.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:47.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:48.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:48.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:48.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:48.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:49.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:49.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:49.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:49.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:50.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:50.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:50.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:50.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:51.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:51.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:51.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:51.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:52.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:52.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:52.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:52.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:53.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:53.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:53.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:53.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:54.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:54.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:54.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:54.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:55.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:55.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:55.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:55.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:56.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:56.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:56.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:56.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:57.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:57.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:57.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:57.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:58.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:58.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:58.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:58.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:13:59.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:59.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:13:59.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:13:59.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:00.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:00.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:00.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:00.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:01.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:01.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:01.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:01.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:02.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:02.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:02.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:02.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:03.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:03.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:03.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:03.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:04.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:04.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:04.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:04.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:05.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:05.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:05.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:05.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:06.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:06.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:06.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:06.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:07.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:07.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:07.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:07.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:08.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:08.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:08.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:08.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:09.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:09.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:09.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:09.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:10.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:10.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:10.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:10.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:11.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:11.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:11.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:11.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:12.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:12.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:12.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:12.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:13.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:13.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:13.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:13.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:14.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:14.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:14.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:14.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:15.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:15.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:15.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:15.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:16.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:16.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:16.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:16.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:17.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:17.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:17.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:17.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:18.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:18.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:18.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:18.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:19.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:19.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:19.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:19.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:20.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:20.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:20.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:20.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:21.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:21.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:21.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:21.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:22.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:22.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:22.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:22.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:23.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:23.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:23.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:23.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:24.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:24.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:24.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:24.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:25.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:25.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:25.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:25.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:26.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:26.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:26.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:26.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:27.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:27.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:27.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:27.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:28.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:28.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:28.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:28.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:29.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:29.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:29.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:29.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:30.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:30.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:30.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:30.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:31.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:31.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:31.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:31.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:32.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:32.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:32.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:32.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:33.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:33.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:33.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:33.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:34.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:34.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:34.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:34.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:35.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:35.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:35.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:35.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:36.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:36.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:36.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:36.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:37.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:37.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:37.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:37.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:38.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:38.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:38.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:38.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:39.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:39.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:39.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:39.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:40.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:40.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:40.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:40.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:41.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:41.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:41.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:41.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:42.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:42.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:42.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:42.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:43.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:43.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:43.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:43.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:44.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:44.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:44.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:44.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:45.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:45.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:45.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:45.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:46.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:46.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:46.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:46.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:47.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:47.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:47.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:47.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:48.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:48.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:48.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:48.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:49.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:49.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:49.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:49.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:50.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:50.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:50.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:50.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:51.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:51.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:51.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:51.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:52.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:52.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:52.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:52.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:53.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:53.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:53.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:53.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:54.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:54.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:54.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:54.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:55.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:55.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:55.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:55.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:56.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:56.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:56.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:56.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:57.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:57.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:57.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:57.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:58.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:58.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:58.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:58.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:14:59.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:59.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:14:59.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:14:59.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:00.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:00.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:00.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:00.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:01.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:01.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:01.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:01.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:02.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:02.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:02.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:02.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:03.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:03.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:03.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:03.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:04.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:04.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:04.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:04.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:05.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:05.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:05.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:05.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:06.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:06.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:06.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:06.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:07.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:07.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:07.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:07.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:08.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:08.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:08.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:08.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:09.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:09.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:09.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:09.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:10.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:10.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:10.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:10.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:11.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:11.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:11.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:11.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:12.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:12.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:12.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:12.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:13.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:13.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:13.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:13.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:14.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:14.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:14.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:14.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:15.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:15.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:15.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:15.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:16.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:16.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:16.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:16.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:17.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:17.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:17.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:17.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:18.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:18.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:18.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:18.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:19.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:19.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:19.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:19.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:20.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:20.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:20.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:20.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:21.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:21.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:21.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:21.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:22.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:22.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:22.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:22.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:23.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:23.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:23.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:23.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:24.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:24.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:24.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:24.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:25.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:25.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:25.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:25.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:26.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:26.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:26.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:26.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:27.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:27.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:27.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:27.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:28.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:28.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:28.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:28.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:29.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:29.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:29.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:29.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:30.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:30.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:30.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:30.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:31.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:31.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:31.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:31.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:32.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:32.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:32.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:32.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:33.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:33.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:33.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:33.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:34.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:34.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:34.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:34.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:35.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:35.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:35.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:35.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:36.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:36.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:36.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:36.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:37.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:37.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:37.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:37.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:38.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:38.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:38.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:38.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:39.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:39.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:39.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:39.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:40.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:40.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:40.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:40.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:41.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:41.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:41.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:41.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:42.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:42.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:42.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:42.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:43.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:43.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:43.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:43.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:44.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:44.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:44.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:44.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:45.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:45.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:45.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:45.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:46.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:46.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:46.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:46.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:47.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:47.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:47.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:47.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:48.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:48.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:48.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:48.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:49.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:49.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:49.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:49.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:50.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:50.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:50.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:50.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:51.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:51.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:51.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:51.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:52.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:52.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:52.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:52.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:53.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:53.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:53.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:53.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:54.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:54.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:54.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:54.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:55.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:55.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:55.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:55.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:56.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:56.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:56.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:56.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:57.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:57.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:57.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:57.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:58.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:58.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:58.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:58.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:15:59.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:59.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:15:59.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:15:59.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:00.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:00.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:00.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:00.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:01.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:01.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:01.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:01.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:02.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:02.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:02.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:02.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:03.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:03.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:03.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:03.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:04.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:04.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:04.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:04.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:05.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:05.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:05.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:05.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:06.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:06.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:06.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:06.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:07.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:07.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:07.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:07.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:08.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:08.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:08.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:08.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:09.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:09.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:09.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:09.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:10.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:10.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:10.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:10.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:11.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:11.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:11.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:11.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:12.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:12.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:12.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:12.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:13.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:13.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:13.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:13.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:14.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:14.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:14.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:14.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:15.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:15.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:15.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:15.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:16.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:16.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:16.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:16.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:17.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:17.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:17.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:17.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:18.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:18.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:18.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:18.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:19.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:19.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:19.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:19.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:20.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:20.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:20.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:20.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:21.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:21.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:21.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:21.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:22.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:22.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:22.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:22.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:23.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:23.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:23.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:23.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:24.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:24.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:24.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:24.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:25.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:25.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:25.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:25.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:26.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:26.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:26.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:26.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:27.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:27.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:27.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:27.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:28.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:28.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:28.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:28.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:29.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:29.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:29.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:29.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:30.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:30.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:30.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:30.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:31.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:31.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:31.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:31.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:32.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:32.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:32.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:32.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:33.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:33.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:33.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:33.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:34.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:34.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:34.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:34.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:35.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:35.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:35.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:35.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:36.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:36.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:36.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:36.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:37.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:37.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:37.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:37.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:38.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:38.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:38.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:38.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:39.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:39.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:39.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:39.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:40.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:40.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:40.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:40.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:41.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:41.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:41.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:41.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:42.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:42.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:42.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:42.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:43.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:43.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:43.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:43.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:44.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:44.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:44.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:44.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:45.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:45.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:45.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:45.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:46.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:46.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:46.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:46.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:47.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:47.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:47.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:47.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:48.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:48.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:48.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:48.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:49.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:49.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:49.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:49.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:50.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:50.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:50.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:50.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:51.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:51.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:51.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:51.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:52.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:52.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:52.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:52.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:53.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:53.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:53.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:53.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:54.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:54.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:54.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:54.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:55.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:55.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:55.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:55.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:56.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:56.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:56.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:56.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:57.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:57.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:57.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:57.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:58.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:58.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:58.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:58.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:16:59.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:59.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:16:59.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:16:59.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:00.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:00.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:00.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:00.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:01.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:01.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:01.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:01.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:02.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:02.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:02.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:02.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:03.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:03.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:03.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:03.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:04.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:04.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:04.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:04.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:05.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:05.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:05.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:05.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:06.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:06.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:06.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:06.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:07.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:07.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:07.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:07.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:08.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:08.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:08.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:08.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:09.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:09.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:09.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:09.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:10.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:10.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:10.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:10.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:11.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:11.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:11.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:11.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:12.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:12.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:12.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:12.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:13.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:13.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:13.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:13.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:14.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:14.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:14.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:14.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:15.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:15.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:15.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:15.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:16.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:16.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:16.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:16.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:17.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:17.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:17.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:17.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:18.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:18.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:18.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:18.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:19.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:19.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:19.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:19.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:20.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:20.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:20.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:20.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:21.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:21.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:21.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:21.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:22.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:22.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:22.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:22.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:23.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:23.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:23.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:23.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:24.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:24.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:24.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:24.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:25.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:25.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:25.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:25.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:26.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:26.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:26.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:26.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:27.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:27.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:27.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:27.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:28.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:28.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:28.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:28.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:29.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:29.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:29.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:29.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:30.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:30.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:30.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:30.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:31.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:31.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:31.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:31.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:32.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:32.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:32.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:32.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:33.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:33.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:33.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:33.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:34.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:34.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:34.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:34.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:35.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:35.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:35.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:35.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:36.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:36.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:36.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:36.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:37.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:37.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:37.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:37.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:38.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:38.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:38.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:38.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:39.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:39.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:39.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:39.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:40.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:40.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:40.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:40.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:41.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:41.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:41.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:41.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:42.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:42.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:42.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:42.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:43.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:43.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:43.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:43.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:44.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:44.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:44.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:44.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:45.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:45.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:45.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:45.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:46.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:46.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:46.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:46.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:47.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:47.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:47.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:47.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:48.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:48.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:48.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:48.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:49.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:49.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:49.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:49.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:50.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:50.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:50.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:50.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:51.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:51.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:51.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:51.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:52.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:52.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:52.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:52.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:53.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:53.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:53.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:53.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:54.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:54.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:54.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:54.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:55.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:55.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:55.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:55.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:56.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:56.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:56.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:56.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:57.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:57.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:57.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:57.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:58.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:58.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:58.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:58.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:17:59.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:59.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:17:59.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:17:59.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:00.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:00.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:00.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:00.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:01.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:01.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:01.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:01.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:02.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:02.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:02.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:02.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:03.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:03.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:03.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:03.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:04.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:04.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:04.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:04.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:05.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:05.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:05.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:05.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:06.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:06.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:06.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:06.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:07.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:07.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:07.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:07.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:08.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:08.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:08.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:08.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:09.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:09.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:09.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:09.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:10.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:10.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:10.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:10.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:11.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:11.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:11.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:11.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:12.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:12.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:12.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:12.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:13.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:13.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:13.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:13.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:14.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:14.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:14.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:14.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:15.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:15.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:15.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:15.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:16.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:16.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:16.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:16.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:17.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:17.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:17.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:17.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:18.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:18.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:18.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:18.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:19.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:19.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:19.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:19.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:20.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:20.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:20.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:20.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:21.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:21.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:21.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:21.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:22.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:22.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:22.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:22.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:23.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:23.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:23.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:23.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:24.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:24.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:24.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:24.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:25.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:25.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:25.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:25.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:26.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:26.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:26.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:26.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:27.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:27.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:27.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:27.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:28.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:28.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:28.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:28.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:29.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:29.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:29.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:29.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:30.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:30.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:30.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:30.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:31.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:31.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:31.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:31.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:32.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:32.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:32.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:32.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:33.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:33.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:33.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:33.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:34.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:34.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:34.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:34.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:35.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:35.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:35.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:35.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:36.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:36.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:36.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:36.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:37.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:37.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:37.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:37.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:38.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:38.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:38.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:38.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:39.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:39.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:39.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:39.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:40.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:40.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:40.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:41.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:41.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:41.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:41.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:42.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:42.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:42.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:42.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:43.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:43.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:43.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:43.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:44.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:44.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:44.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:44.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:45.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:45.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:45.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:45.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:46.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:46.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:46.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:46.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:47.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:47.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:47.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:47.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:48.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:48.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:48.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:48.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:49.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:49.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:49.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:49.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:50.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:50.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:50.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:50.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:51.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:51.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:51.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:51.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:52.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:52.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:52.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:52.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:53.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:53.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:53.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:53.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:54.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:54.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:54.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:54.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:55.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:55.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:55.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:55.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:56.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:56.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:56.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:56.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:57.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:57.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:57.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:57.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:58.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:58.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:58.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:58.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:18:59.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:59.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:18:59.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:18:59.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:00.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:00.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:00.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:00.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:01.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:01.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:01.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:01.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:02.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:02.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:02.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:02.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:03.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:03.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:03.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:03.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:04.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:04.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:04.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:04.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:05.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:05.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:05.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:05.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:06.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:06.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:06.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:06.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:07.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:07.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:07.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:07.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:08.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:08.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:08.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:08.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:09.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:09.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:09.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:09.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:10.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:10.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:10.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:10.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:11.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:11.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:11.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:11.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:12.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:12.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:12.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:12.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:13.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:13.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:13.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:13.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:14.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:14.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:14.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:14.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:15.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:15.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:15.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:15.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:16.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:16.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:16.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:16.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:17.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:17.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:17.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:17.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:18.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:18.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:18.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:18.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:19.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:19.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:19.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:19.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:20.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:20.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:20.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:20.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:21.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:21.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:21.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:21.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:22.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:22.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:22.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:22.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:23.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:23.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:23.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:23.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:24.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:24.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:24.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:24.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:25.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:25.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:25.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:25.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:26.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:26.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:26.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:26.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:27.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:27.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:27.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:27.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:28.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:28.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:28.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:28.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:29.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:29.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:29.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:29.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:30.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:30.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:30.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:30.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:31.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:31.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:31.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:31.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:32.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:32.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:32.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:32.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:33.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:33.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:33.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:33.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:34.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:34.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:34.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:34.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:35.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:35.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:35.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:35.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:36.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:36.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:36.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:36.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:37.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:37.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:37.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:37.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:38.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:38.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:38.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:38.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:39.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:39.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:39.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:39.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:40.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:40.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:40.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:40.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:41.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:41.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:41.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:41.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:42.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:42.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:42.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:42.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:43.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:43.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:43.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:43.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:44.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:44.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:44.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:44.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:45.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:45.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:45.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:45.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:46.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:46.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:46.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:46.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:47.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:47.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:47.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:47.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:48.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:48.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:48.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:48.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:49.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:49.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:49.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:49.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:50.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:50.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:50.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:50.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:51.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:51.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:51.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:51.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:52.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:52.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:52.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:52.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:53.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:53.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:53.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:53.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:54.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:54.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:54.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:54.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:55.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:55.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:55.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:55.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:56.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:56.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:56.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:56.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:57.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:57.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:57.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:57.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:58.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:58.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:58.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:58.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:19:59.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:59.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:19:59.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:19:59.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:00.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:00.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:00.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:00.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:01.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:01.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:01.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:01.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:02.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:02.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:02.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:02.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:03.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:03.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:03.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:03.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:04.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:04.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:04.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:04.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:05.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:05.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:05.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:05.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:06.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:06.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:06.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:06.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:07.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:07.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:07.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:07.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:08.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:08.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:08.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:08.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:09.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:09.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:09.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:09.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:10.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:10.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:10.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:10.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:11.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:11.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:11.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:11.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:12.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:12.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:12.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:12.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:13.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:13.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:13.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:13.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:14.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:14.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:14.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:14.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:15.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:15.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:15.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:15.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:16.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:16.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:16.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:16.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:17.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:17.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:17.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:17.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:18.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:18.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:18.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:18.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:19.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:19.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:19.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:19.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:20.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:20.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:20.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:20.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:21.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:21.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:21.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:21.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:22.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:22.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:22.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:22.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:23.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:23.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:23.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:23.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:24.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:24.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:24.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:24.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:25.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:25.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:25.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:25.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:26.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:26.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:26.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:26.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:27.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:27.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:27.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:27.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:28.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:28.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:28.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:28.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:29.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:29.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:29.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:29.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:30.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:30.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:30.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:30.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:31.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:31.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:31.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:31.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:32.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:32.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:32.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:32.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:33.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:33.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:33.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:33.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:34.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:34.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:34.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:34.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:35.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:35.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:35.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:35.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:36.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:36.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:36.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:36.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:37.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:37.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:37.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:37.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:38.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:38.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:38.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:38.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:39.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:39.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:39.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:39.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:40.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:40.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:40.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:40.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:41.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:41.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:41.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:41.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:42.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:42.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:42.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:42.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:43.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:43.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:43.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:43.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:44.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:44.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:44.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:44.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:45.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:45.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:45.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:45.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:46.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:46.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:46.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:46.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:47.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:47.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:47.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:47.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:48.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:48.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:48.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:48.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:49.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:49.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:49.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:49.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:50.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:50.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:50.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:50.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:51.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:51.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:51.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:51.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:52.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:52.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:52.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:52.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:53.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:53.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:53.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:53.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:54.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:54.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:54.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:54.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:55.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:55.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:55.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:55.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:56.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:56.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:56.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:56.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:57.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:57.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:57.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:57.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:58.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:58.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:58.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:58.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:20:59.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:59.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:20:59.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:20:59.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:00.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:00.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:00.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:00.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:01.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:01.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:01.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:01.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:02.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:02.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:02.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:02.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:03.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:03.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:03.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:03.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:04.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:04.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:04.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:04.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:05.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:05.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:05.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:05.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:06.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:06.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:06.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:06.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:07.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:07.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:07.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:07.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:08.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:08.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:08.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:08.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:09.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:09.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:09.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:09.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:10.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:10.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:10.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:10.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:11.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:11.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:11.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:11.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:12.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:12.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:12.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:12.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:13.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:13.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:13.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:13.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:14.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:14.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:14.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:14.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:15.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:15.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:15.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:15.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:16.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:16.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:16.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:16.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:17.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:17.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:17.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:17.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:18.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:18.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:18.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:18.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:19.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:19.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:19.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:19.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:20.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:20.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:20.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:20.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:21.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:21.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:21.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:21.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:22.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:22.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:22.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:22.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:23.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:23.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:23.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:23.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:24.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:24.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:24.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:24.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:25.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:25.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:25.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:25.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:26.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:26.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:26.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:26.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:27.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:27.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:27.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:27.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:28.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:28.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:28.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:28.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:29.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:29.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:29.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:29.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:30.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:30.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:30.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:30.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:31.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:31.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:31.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:31.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:32.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:32.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:32.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:32.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:33.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:33.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:33.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:33.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:34.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:34.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:34.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:34.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:35.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:35.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:35.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:35.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:36.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:36.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:36.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:36.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:37.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:37.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:37.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:37.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:38.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:38.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:38.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:38.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:39.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:39.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:39.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:39.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:40.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:40.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:40.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:40.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:41.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:41.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:41.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:41.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:42.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:42.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:42.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:42.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:43.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:43.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:43.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:43.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:44.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:44.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:11:13.937469+0000 (oldest deadline 2019-10-23T09:11:33.937469+0000) 2019-10-23T09:21:44.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:44.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:45.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:45.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:46.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:46.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:47.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:47.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:48.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:48.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:49.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:49.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:50.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:50.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:51.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:51.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:52.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:52.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:53.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:53.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:54.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:54.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:55.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:55.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:56.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:56.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:57.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:57.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:58.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:58.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:21:59.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:21:59.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:00.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:00.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:01.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:01.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:02.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:02.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:03.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:03.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:04.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:04.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:05.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:05.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:06.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:06.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:07.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:07.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:08.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:08.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:09.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:09.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:10.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:10.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:10.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:10.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:11.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:11.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:11.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:11.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:12.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:12.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:12.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:12.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:13.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:13.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:13.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:13.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:14.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:14.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:14.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:14.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:15.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:15.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:15.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:15.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:16.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:16.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:16.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:16.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:17.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:17.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:17.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:17.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:18.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:18.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:18.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:18.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 36 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:19.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:19.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:19.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:19.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:20.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:20.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:20.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:20.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:21.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:21.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:21.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:21.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:22.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:22.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:22.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:22.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:23.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:23.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:23.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:23.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:24.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:24.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:24.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:24.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:25.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:25.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:25.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:25.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:26.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:26.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:26.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:26.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:27.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:27.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:27.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:27.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:28.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:28.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:28.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:28.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:29.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:29.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:29.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:29.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:30.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:30.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:30.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:30.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:31.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:31.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:31.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:31.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:32.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:32.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:32.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:32.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:33.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:33.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:33.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:33.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:34.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:34.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:34.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:34.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:35.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:35.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:35.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:35.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:36.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:36.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:36.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:36.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:37.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:37.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:37.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:37.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:38.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:38.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:38.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:38.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:39.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:39.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:39.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:39.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:40.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:40.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:40.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:40.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:41.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:41.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:41.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:41.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:42.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:42.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:42.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:42.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:43.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:43.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:43.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:43.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:44.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:44.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:44.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:44.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:45.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:45.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:45.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:45.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:46.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:46.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:46.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:46.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:47.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:47.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:47.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:47.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:48.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:48.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:48.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:48.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:49.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:49.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:49.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:49.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:50.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:50.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:50.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:50.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:51.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:51.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:51.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:51.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:52.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:52.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:52.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:52.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:53.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:53.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:53.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:53.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:54.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:54.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:54.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:54.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:55.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:55.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:55.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:55.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:56.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:56.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:56.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:56.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:57.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:57.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:57.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:57.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:58.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:58.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:58.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:58.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:22:59.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:59.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:22:59.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:22:59.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:00.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:00.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:00.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:00.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:01.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:01.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:01.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:01.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:02.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:02.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:02.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:02.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:03.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:03.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:03.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:03.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:04.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:04.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:04.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:04.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:05.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:05.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:05.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:05.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:06.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:06.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:06.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:06.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:07.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:07.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:07.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:07.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:08.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:08.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:08.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:08.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:09.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:09.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:09.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:09.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:10.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:10.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:10.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:10.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:11.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:11.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:11.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:11.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:12.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:12.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:12.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:12.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:13.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:13.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:13.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:13.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:14.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:14.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:14.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:14.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:15.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:15.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:15.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:15.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:16.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:16.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:16.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:16.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:17.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:17.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:17.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:17.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:18.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:18.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:18.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:18.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:19.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:19.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:19.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:19.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:20.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:20.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:20.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:20.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:21.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:21.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:21.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:21.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:22.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:22.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:22.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:22.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:23.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:23.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:23.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:23.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:24.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:24.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:24.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:24.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:25.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:25.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:25.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:25.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:26.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:26.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:26.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:26.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:27.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:27.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:27.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:27.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:28.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:28.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:28.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:28.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:29.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:29.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:29.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:29.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:30.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:30.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:30.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:30.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:31.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:31.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:31.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:31.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:32.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:32.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:32.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:32.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:33.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:33.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:33.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:33.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:34.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:34.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:34.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:34.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:35.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:35.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:35.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:35.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:36.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:36.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:36.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:36.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:37.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:37.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:37.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:37.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:38.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:38.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:38.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:38.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:39.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:39.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:39.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:39.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:40.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:40.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:40.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:40.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:41.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:41.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:41.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:41.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:42.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:42.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:42.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:42.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:43.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:43.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:43.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:43.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:44.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:44.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:44.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:44.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:45.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:45.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:45.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:45.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:46.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:46.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:46.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:46.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:47.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:47.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:47.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:47.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:48.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:48.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:48.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:48.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:49.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:49.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:49.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:49.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:50.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:50.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:50.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:50.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:51.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:51.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:51.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:51.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:52.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:52.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:52.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:52.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:53.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:53.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:53.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:53.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:54.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:54.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:54.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:54.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:55.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:55.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:55.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:55.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:56.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:56.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:56.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:56.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:57.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:57.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:57.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:57.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:58.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:58.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:58.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:58.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:23:59.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:59.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:23:59.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:23:59.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:00.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:00.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:00.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:00.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:01.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:01.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:01.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:01.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:02.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:02.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:02.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:02.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:03.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:03.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:03.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:03.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:04.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:04.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:04.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:04.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:05.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:05.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:05.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:05.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:06.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:06.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:06.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:06.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:07.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:07.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:07.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:07.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:08.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:08.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:08.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:08.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:09.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:09.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:09.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:09.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:10.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:10.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:10.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:10.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:11.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:11.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:11.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:11.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:12.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:12.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:12.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:12.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:13.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:13.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:13.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:13.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:14.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:14.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:14.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:14.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:15.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:15.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:15.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:15.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:16.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:16.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:16.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:16.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:17.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:17.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:17.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:17.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:18.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:18.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:18.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:18.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:19.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:19.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:19.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:19.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:20.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:20.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:20.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:20.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:21.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:21.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:21.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:21.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:22.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:22.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:22.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:22.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:23.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:23.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:23.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:23.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:24.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:24.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:24.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:24.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:25.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:25.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:25.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:25.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:26.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:26.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:26.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:26.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:27.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:27.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:27.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:27.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:28.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:28.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:28.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:28.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:29.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:29.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:29.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:29.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:30.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:30.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:30.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:30.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:31.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:31.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:31.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:31.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:32.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:32.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:32.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:32.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:33.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:33.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:33.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:33.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:34.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:34.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:34.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:34.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:35.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:35.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:35.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:35.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:36.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:36.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:36.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:36.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:37.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:37.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:37.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:37.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:38.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:38.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:38.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:38.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:39.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:39.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:39.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:39.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:40.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:40.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:40.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:40.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:41.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:41.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:41.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:41.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:42.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:42.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:42.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:42.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:43.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:43.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:43.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:43.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:44.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:44.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:44.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:44.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:45.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:45.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:45.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:45.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:46.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:46.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:46.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:46.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:47.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:47.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:47.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:47.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:48.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:48.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:48.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:48.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:49.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:49.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:49.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:49.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:50.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:50.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:50.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:50.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:51.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:51.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:51.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:51.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:52.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:52.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:52.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:52.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:53.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:53.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:53.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:53.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:54.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:54.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:54.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:54.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:55.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:55.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:55.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:55.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:56.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:56.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:56.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:56.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:57.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:57.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:57.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:57.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:58.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:58.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:58.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:58.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:24:59.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:59.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:24:59.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:24:59.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:00.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:00.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:00.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:00.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:01.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:01.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:01.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:01.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:02.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:02.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:02.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:02.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:03.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:03.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:03.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:03.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:04.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:04.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:04.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:04.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:05.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:05.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:05.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:05.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:06.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:06.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:06.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:06.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:07.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:07.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:07.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:07.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:08.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:08.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:08.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:08.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:09.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:09.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:09.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:09.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:10.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:10.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:10.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:10.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:11.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:11.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:11.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:11.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:12.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:12.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:12.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:12.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:13.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:13.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:13.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:13.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:14.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:14.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:14.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:14.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:15.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:15.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:15.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:15.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:16.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:16.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:16.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:16.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:17.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:17.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:17.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:17.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:18.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:18.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:18.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:18.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:19.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:19.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:19.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:19.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:20.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:20.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:20.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:20.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:21.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:21.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:21.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:21.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:22.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:22.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:22.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:22.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:23.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:23.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:23.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:23.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:24.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:24.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:24.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:24.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:26.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:26.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:26.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:26.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:27.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:27.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:27.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:27.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:28.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:28.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:28.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:28.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:29.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:29.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:29.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:29.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:30.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:30.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:30.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:30.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:31.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:31.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:31.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:31.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:32.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:32.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:32.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:32.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:33.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:33.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:33.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:33.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:34.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:34.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:34.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:34.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:35.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:35.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:35.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:35.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:36.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:36.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:36.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:36.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:37.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:37.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:37.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:37.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:38.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:38.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:38.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:38.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:39.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:39.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:39.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:39.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:40.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:40.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:40.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:40.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:41.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:41.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:41.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:41.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:42.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:42.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:42.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:42.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:43.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:43.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:43.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:43.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:44.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:44.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:44.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:44.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:45.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:45.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:45.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:45.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:46.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:46.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:46.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:46.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:47.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:47.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:47.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:47.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:48.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:48.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:48.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:48.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:49.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:49.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:49.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:49.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:50.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:50.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:50.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:50.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:51.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:51.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:51.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:51.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:52.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:52.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:52.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:52.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:53.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:53.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:53.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:53.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:54.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:54.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:54.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:54.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:55.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:55.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:55.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:55.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:56.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:56.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:56.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:56.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:57.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:57.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:57.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:57.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:58.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:58.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:58.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:58.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:25:59.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:59.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:25:59.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:25:59.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:00.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:00.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:00.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:00.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:01.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:01.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:01.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:01.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:01.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:01.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:01.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:01.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:02.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:02.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:03.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:02.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:04.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:04.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:04.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:04.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:05.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:04.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:05.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:04.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:05.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:05.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:05.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:05.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:06.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:06.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:06.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:06.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:07.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:07.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:07.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:07.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:08.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:08.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:08.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:08.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:09.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:09.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:09.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:09.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:10.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:10.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:10.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:10.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:11.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:11.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:11.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:11.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:12.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:12.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:12.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:12.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:14.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:13.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:14.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:13.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:15.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:15.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:15.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:15.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:16.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:16.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:16.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:16.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:17.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:17.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:17.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:17.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:18.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:18.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:18.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:18.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:19.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:19.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:19.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:19.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:20.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:20.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:20.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:20.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:21.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:21.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:21.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:21.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:22.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:22.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:22.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:22.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:23.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:23.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:23.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:23.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:24.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:24.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:24.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:24.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:25.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:25.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:25.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:25.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:26.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:26.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:26.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:26.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:27.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:27.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:27.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:27.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:28.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:28.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:28.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:28.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:29.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:29.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:29.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:29.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:30.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:30.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:30.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:30.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:31.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:31.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:31.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:31.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:32.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:32.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:32.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:32.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:33.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:33.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:33.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:33.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:34.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:34.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:34.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:34.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:35.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:35.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:35.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:35.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:36.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:36.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:36.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:36.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:37.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:37.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:37.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:37.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:38.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:38.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:38.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:38.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:39.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:39.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:39.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:39.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:40.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:40.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:40.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:40.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:41.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:40.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:41.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:41.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:42.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:42.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:42.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:42.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:43.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:43.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:43.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:43.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:44.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:44.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:44.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:44.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:45.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:45.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:45.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:45.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:46.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:46.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:46.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:46.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:47.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:47.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:47.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:47.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:48.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:48.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:48.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:48.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:49.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:49.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:49.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:49.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:50.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:50.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:50.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:50.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:51.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:51.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:51.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:51.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:52.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:52.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:52.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:52.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:53.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:53.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:53.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:53.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:54.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:54.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:54.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:54.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:55.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:55.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:55.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:55.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:56.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:56.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:56.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:56.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:57.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:57.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:57.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:57.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:58.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:58.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:58.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:58.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:26:59.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:59.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:26:59.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:26:59.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:00.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:00.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:00.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:00.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:01.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:01.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:01.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:01.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:02.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:02.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:02.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:02.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:03.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:03.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:03.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:03.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:04.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:04.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:04.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:04.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:05.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:05.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:05.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:05.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:06.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:06.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:06.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:06.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:07.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:07.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:07.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:07.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:08.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:08.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:08.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:08.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:09.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:09.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:09.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:09.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:10.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:10.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:10.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:10.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:11.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:11.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:11.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:11.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:12.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:12.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:12.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:12.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:13.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:13.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:13.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:13.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:14.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:14.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:14.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:14.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:15.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:15.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:15.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:15.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:16.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:16.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:16.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:16.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:17.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:17.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:17.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:17.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:18.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:18.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:18.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:18.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:19.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:19.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:19.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:19.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:20.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:20.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:20.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:20.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:21.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:21.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:21.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:21.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:22.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:22.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:22.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:22.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:23.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:23.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:23.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:23.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:24.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:24.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:24.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:24.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:25.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:25.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:25.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:25.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:26.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:26.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:26.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:26.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:27.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:27.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:27.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:27.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:28.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:28.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:28.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:28.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:29.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:29.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:29.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:29.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:30.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:30.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:30.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:30.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:31.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:31.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:31.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:31.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:32.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:32.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:32.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:32.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:33.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:33.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:33.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:33.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:34.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:34.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:34.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:34.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:35.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:35.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:35.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:35.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:36.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:36.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:36.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:36.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:37.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:37.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:37.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:37.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:38.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:38.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:38.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:38.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:39.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:39.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:39.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:39.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:40.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:40.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:40.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:40.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:41.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:41.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:41.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:41.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:42.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:42.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:42.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:42.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:43.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:43.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:43.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:43.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:44.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:44.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:44.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:44.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:45.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:45.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:45.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:45.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:46.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:46.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:46.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:46.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:47.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:47.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:47.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:47.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:48.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:48.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:48.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:48.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:49.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:49.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:49.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:49.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:50.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:50.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:50.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:50.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:51.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:51.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:51.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:51.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:52.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:52.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:52.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:52.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:53.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:53.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:53.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:53.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:54.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:54.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:54.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:54.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:55.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:55.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:55.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:55.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:56.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:56.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:56.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:56.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:57.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:57.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:57.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:57.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:58.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:58.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:58.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:58.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:27:59.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:59.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:27:59.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:27:59.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:00.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:00.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:00.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:00.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:01.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:01.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:01.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:01.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:02.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:02.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:02.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:02.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:03.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:03.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:03.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:03.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:04.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:04.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:04.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:04.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:05.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:05.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:05.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:05.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:06.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:06.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:06.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:06.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:07.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:07.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:07.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:07.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:08.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:08.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:08.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:08.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:09.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:09.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:09.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:09.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:10.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:10.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:10.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:10.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:11.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:11.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:11.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:11.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:12.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:12.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:12.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:12.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:13.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:13.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:13.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:13.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:14.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:14.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:14.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:14.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:15.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:15.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:15.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:15.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:16.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:16.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:16.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:16.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:17.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:17.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:17.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:17.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:18.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:18.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:18.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:18.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:19.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:19.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:19.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:19.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:20.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:20.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:20.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:20.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:21.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:21.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:21.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:21.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:22.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:22.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:22.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:22.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:23.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:23.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:23.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:23.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:24.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:24.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:24.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:24.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:25.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:25.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:25.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:25.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:26.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:26.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:26.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:26.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:27.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:27.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:27.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:27.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:28.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:28.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:28.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:28.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:29.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:29.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:29.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:29.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:30.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:30.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:30.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:30.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:31.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:31.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:31.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:31.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:32.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:32.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:32.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:32.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:33.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:33.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:33.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:33.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:34.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:34.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:34.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:34.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:35.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:35.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:35.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:35.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:36.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:36.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:36.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:36.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:37.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:37.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:37.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:37.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:38.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:38.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:38.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:38.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:39.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:39.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:39.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:39.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:40.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:40.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:40.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:40.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:41.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:41.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:41.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:41.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:42.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:42.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:42.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:42.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:43.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:43.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:43.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:43.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:44.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:44.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:44.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:44.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:45.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:45.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:45.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:45.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:46.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:46.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:46.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:46.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:47.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:47.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:47.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:47.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:48.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:48.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:48.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:48.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:49.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:49.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:49.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:49.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:50.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:50.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:50.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:50.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:51.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:51.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:51.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:51.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:52.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:52.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:52.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:52.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:53.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:53.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:53.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:53.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:54.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:54.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:54.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:54.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:54.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:54.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:55.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:54.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:55.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:55.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:55.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:55.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:57.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:57.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:57.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:57.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:58.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:58.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:58.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:58.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:59.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:58.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:59.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:58.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:28:59.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:59.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:28:59.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:28:59.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:00.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:00.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:00.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:00.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:01.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:01.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:01.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:01.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:02.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:02.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:02.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:02.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:03.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:03.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:03.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:03.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:04.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:04.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:04.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:04.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:05.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:05.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:05.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:05.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:06.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:06.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:06.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:06.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:07.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:07.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:07.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:07.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:08.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:08.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:08.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:08.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:09.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:09.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:09.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:09.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:10.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:10.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:10.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:10.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:11.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:11.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:11.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:11.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:12.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:12.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:12.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:12.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:13.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:13.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:13.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:13.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:14.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:14.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:14.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:14.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:15.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:15.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:15.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:15.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:16.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:16.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:16.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:16.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:17.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:17.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:17.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:17.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:18.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:18.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:18.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:18.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:19.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:19.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:19.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:19.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:20.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:20.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:20.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:20.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:21.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:21.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:21.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:21.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:22.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:22.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:22.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:22.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:23.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:23.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:23.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:23.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:24.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:24.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:24.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:24.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:25.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:25.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:25.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:25.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:26.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:26.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:26.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:26.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:27.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:27.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:27.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:27.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:28.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:28.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:28.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:28.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:29.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:29.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:29.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:29.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:30.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:30.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:30.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:30.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:31.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:31.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:31.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:31.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:32.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:32.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:32.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:32.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:34.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:33.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:34.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:33.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:35.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:34.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:35.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:34.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:36.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:36.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:36.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:36.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:37.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:37.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:37.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:37.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:38.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:38.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:38.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:38.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:39.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:39.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:39.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:39.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:40.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:40.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:40.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:40.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:41.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:41.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:41.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:41.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:42.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:42.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:42.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:42.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:43.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:43.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:43.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:43.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:44.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:44.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:44.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:44.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:45.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:45.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:45.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:45.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:46.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:46.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:46.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:46.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:47.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:47.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:47.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:47.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:48.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:48.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:48.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:48.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:49.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:49.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:49.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:49.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:50.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:50.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:50.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:50.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:51.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:51.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:51.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:51.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:51.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:51.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:51.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:51.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:52.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:52.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:52.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:52.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:54.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:53.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:54.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:53.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:55.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:55.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:55.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:55.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:56.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:56.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:56.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:56.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:56.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:56.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:56.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:56.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:57.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:57.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:57.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:57.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:58.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:58.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:58.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:58.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:29:59.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:59.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:29:59.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:29:59.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:00.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:00.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:00.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:00.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:01.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:01.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:01.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:01.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:02.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:02.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:02.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:02.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:03.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:03.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:03.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:03.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:04.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:04.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:04.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:04.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:05.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:05.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:05.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:05.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:06.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:06.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:06.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:06.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:07.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:07.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:07.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:07.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:08.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:08.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:08.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:08.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:09.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:09.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:09.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:09.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:10.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:10.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:10.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:10.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:11.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:11.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:11.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:11.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:12.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:12.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:12.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:12.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:14.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:14.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:14.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:14.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:14.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:14.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:14.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:14.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:15.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:15.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:15.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:15.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:17.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:17.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:17.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:17.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:17.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:17.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:17.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:17.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:18.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:18.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:18.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:18.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:20.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:20.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:20.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:20.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:21.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:21.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:21.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:21.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:22.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:22.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:22.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:22.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:23.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:23.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:23.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:23.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:24.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:24.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:24.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:24.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:25.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:25.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:25.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:25.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:26.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:26.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:26.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:26.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:27.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:27.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:27.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:27.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:28.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:28.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:28.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:28.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:29.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:29.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:29.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:29.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:30.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:30.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:30.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:30.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:31.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:31.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:31.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:31.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:31.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:31.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:31.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:31.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:32.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:32.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:32.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:32.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:34.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:34.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:34.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:34.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:35.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:35.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:35.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:35.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:36.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:36.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:36.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:36.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:37.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:37.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:37.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:37.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:38.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:38.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:38.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:38.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:39.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:39.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:39.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:39.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:40.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:40.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:40.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:40.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:41.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:41.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:41.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:41.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:42.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:42.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:42.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:42.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:43.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:43.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:43.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:43.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:44.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:44.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:44.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:44.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:45.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:45.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:45.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:45.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:46.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:46.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:46.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:46.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:47.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:47.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:47.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:47.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:48.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:48.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:48.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:48.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:49.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:49.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:49.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:49.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:50.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:50.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:50.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:50.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:51.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:51.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:51.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:51.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:52.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:52.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:52.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:52.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:53.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:53.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:53.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:53.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:54.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:54.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:54.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:54.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:55.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:55.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:55.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:55.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:56.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:56.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:56.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:56.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:57.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:57.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:57.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:57.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:58.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:58.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:58.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:58.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:30:59.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:59.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:30:59.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:30:59.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:00.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:00.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:00.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:00.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:01.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:01.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:01.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:01.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:02.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:02.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:02.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:02.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:03.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:03.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:03.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:03.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:04.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:04.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:04.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:04.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:05.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:05.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:05.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:05.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:06.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:06.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:06.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:06.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:07.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:07.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:07.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:07.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:08.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:08.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:08.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:08.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:09.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:09.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:09.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:09.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:10.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:10.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:10.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:10.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:11.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:11.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:11.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:11.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:12.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:12.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:12.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:12.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:13.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:13.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:13.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:13.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:13.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:13.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:13.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:13.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:14.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:14.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:14.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:14.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:16.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:16.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:16.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:16.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:17.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:17.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:17.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:17.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:18.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:18.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:18.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:18.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:19.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:19.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:19.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:19.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:20.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:20.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:20.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:20.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:21.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:21.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:21.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:21.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:22.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:22.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:22.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:22.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:23.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:23.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:23.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:23.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:24.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:24.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:24.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:24.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:24.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:24.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:24.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:24.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:25.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:25.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:25.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:25.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:26.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:26.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:26.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:26.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:27.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:27.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:27.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:27.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:28.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:28.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:28.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:28.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:29.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:29.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:29.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:29.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:30.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:30.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:30.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:30.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:31.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:31.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:31.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:31.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:33.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:33.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:33.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:33.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:34.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:34.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:34.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:34.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:35.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:35.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:35.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:35.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:36.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:36.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:36.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:36.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:37.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:37.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:37.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:37.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:38.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:38.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:38.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:38.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:39.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:39.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:39.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:39.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:40.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:40.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:40.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:40.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:41.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:41.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:41.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:41.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:42.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:41.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:42.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:41.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:43.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:43.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:43.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:43.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:44.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:44.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:44.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:44.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:45.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:45.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:45.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:45.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:46.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:46.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:46.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:46.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:47.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:47.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:47.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:47.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:48.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:48.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:48.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:48.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:49.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:49.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:49.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:49.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:49.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:49.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:49.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:49.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:50.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:50.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:50.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:50.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:52.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:52.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:52.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:52.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:52.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:52.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:52.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:52.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:54.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:54.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:54.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:54.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:55.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:55.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:55.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:55.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:56.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:55.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:56.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:55.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:57.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:57.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:57.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:57.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:58.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:58.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:58.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:58.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:31:59.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:59.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:31:59.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:31:59.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:00.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:00.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:00.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:00.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:01.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:01.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:01.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:01.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:02.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:02.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:02.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:02.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:03.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:03.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:03.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:03.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:04.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:04.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:04.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:04.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:05.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:05.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:05.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:05.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:05.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:05.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:05.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:05.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:06.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:06.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:06.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:06.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:07.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:07.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:07.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:07.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:09.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:09.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:09.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:09.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:09.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:09.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:09.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:09.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:11.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:11.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:11.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:11.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:12.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:12.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:12.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:12.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:12.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:12.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:14.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:14.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:14.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:14.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:15.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:15.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:15.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:15.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:16.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:16.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:16.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:16.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:17.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:17.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:17.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:17.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:18.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:18.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:18.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:18.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:19.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:19.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:19.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:19.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:20.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:20.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:21:50.061842+0000 (oldest deadline 2019-10-23T09:22:10.061842+0000) 2019-10-23T09:32:20.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:20.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:21.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:21.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:22.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:22.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:23.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:23.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:24.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:24.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:25.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:25.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:26.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:26.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:27.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:27.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:28.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:28.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:29.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:29.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:30.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:30.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:31.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:31.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:32.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:32.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:32.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:32.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:33.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:33.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:34.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:34.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:35.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:35.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:36.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:36.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:38.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:38.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:39.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:39.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:40.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:39.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:41.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:41.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:42.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:42.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:43.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:43.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:43.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:43.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:44.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:44.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:44.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:44.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:45.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:45.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:45.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:45.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:46.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:46.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:46.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:46.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:47.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:47.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:47.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:47.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:48.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:48.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:48.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:48.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:49.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:49.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:49.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:49.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:50.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:50.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:50.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:50.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:51.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:51.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:51.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:51.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:52.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:52.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:52.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:52.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:53.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:53.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:53.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:53.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:54.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:54.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:54.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:54.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:55.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:55.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:55.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:55.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:56.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:56.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:56.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:56.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:57.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:57.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:57.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:57.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:58.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:58.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:58.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:58.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:32:59.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:59.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:32:59.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:32:59.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:00.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:00.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:00.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:00.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:01.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:01.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:01.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:01.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:02.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:02.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:02.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:02.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:03.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:03.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:03.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:03.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:04.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:04.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:04.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:04.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:05.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:05.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:05.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:05.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:06.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:06.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:06.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:06.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:07.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:07.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:07.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:07.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:08.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:08.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:08.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:08.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:09.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:09.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:09.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:09.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:10.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:10.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:10.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:10.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:11.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:11.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:11.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:11.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:12.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:12.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:12.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:13.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:13.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:13.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:13.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:14.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:14.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:14.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:14.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:15.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:15.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:15.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:15.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:16.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:16.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:16.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:16.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:16.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:16.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:16.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:16.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:17.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:17.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:17.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:17.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:18.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:18.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:18.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:18.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:19.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:19.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:19.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:19.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:20.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:20.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:20.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:20.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:21.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:21.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:21.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:21.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:22.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:22.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:22.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:22.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:23.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:23.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:23.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:23.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:24.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:24.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:24.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:24.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:25.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:25.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:25.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:25.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:26.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:26.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:26.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:26.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:27.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:27.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:27.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:27.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:28.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:28.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:28.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:28.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:29.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:29.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:29.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:29.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:30.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:30.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:30.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:30.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:31.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:31.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:31.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:31.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:32.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:32.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:32.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:32.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:33.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:33.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:33.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:33.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:34.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:34.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:34.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:34.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:35.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:35.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:35.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:35.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:36.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:36.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:36.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:36.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:37.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:37.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:37.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:37.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:38.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:38.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:38.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:38.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:39.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:39.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:39.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:39.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:40.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:40.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:40.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:40.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:41.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:41.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:41.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:41.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:42.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:42.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:42.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:42.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:43.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:43.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:43.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:43.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:44.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:44.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:44.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:44.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:45.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:45.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:45.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:45.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:47.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:47.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:47.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:47.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:48.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:48.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:48.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:48.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:49.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:49.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:49.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:49.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:50.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:50.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:50.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:50.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:50.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:50.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:50.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:50.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:52.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:52.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:52.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:52.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:53.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:53.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:53.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:53.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:53.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:53.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:53.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:53.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:55.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:55.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:55.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:55.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:56.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:56.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:56.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:56.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:57.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:57.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:57.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:57.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:58.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:58.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:58.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:58.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:33:59.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:58.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:33:59.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:33:58.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:00.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:00.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:00.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:00.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:01.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:01.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:01.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:01.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:02.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:02.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:02.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:02.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:03.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:03.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:03.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:03.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:04.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:04.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:04.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:04.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:05.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:05.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:05.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:05.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:06.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:06.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:06.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:06.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:07.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:07.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:07.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:07.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:08.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:08.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:08.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:08.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:09.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:09.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:09.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:09.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:10.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:10.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:10.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:10.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:11.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:11.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:11.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:11.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:12.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:12.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:12.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:12.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:13.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:13.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:13.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:13.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:14.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:14.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:14.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:14.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:15.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:15.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:15.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:15.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:16.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:16.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:16.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:16.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:17.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:17.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:17.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:17.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:18.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:18.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:18.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:18.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:19.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:19.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:19.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:19.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:20.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:20.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:20.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:20.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:21.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:21.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:21.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:21.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:22.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:22.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:22.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:22.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:23.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:23.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:23.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:23.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:24.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:24.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:24.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:24.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:25.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:25.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:25.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:25.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:26.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:26.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:26.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:26.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:27.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:27.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:27.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:27.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:28.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:28.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:28.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:28.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:29.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:29.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:29.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:29.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:30.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:30.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:30.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:30.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:31.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:31.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:31.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:31.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:32.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:32.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:32.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:32.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:33.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:33.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:33.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:33.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:34.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:34.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:34.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:34.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:35.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:35.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:35.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:35.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:36.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:36.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:36.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:36.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:37.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:37.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:37.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:37.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:38.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:38.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:38.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:38.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:39.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:39.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:39.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:39.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:40.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:40.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:40.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:40.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:41.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:41.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:41.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:41.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:42.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:42.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:42.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:42.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:43.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:43.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:43.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:43.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:44.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:44.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:44.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:44.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:45.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:45.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:45.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:45.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:46.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:46.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:46.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:46.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:47.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:47.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:47.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:47.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:48.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:48.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:48.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:48.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:49.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:49.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:49.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:49.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:50.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:50.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:50.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:50.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:51.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:51.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:51.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:51.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:52.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:52.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:52.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:52.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:53.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:53.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:53.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:53.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:54.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:54.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:54.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:54.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:55.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:55.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:55.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:55.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:56.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:56.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:56.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:56.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:57.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:57.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:57.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:57.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:58.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:58.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:58.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:58.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:34:59.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:59.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:34:59.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:34:59.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:00.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:00.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:00.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:00.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:01.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:01.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:01.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:01.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:02.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:02.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:02.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:02.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:03.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:03.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:03.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:03.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:04.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:04.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:04.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:04.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:05.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:05.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:05.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:05.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:06.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:06.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:06.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:06.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:07.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:07.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:07.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:07.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:08.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:08.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:08.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:08.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:09.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:09.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:09.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:09.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:10.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:10.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:10.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:10.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:11.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:11.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:11.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:11.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:12.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:12.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:12.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:12.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:13.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:13.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:13.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:13.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:14.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:14.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:14.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:14.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:15.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:15.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:15.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:15.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:16.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:16.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:16.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:16.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:17.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:17.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:17.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:17.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:18.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:18.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:18.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:18.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:19.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:19.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:19.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:19.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:20.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:20.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:20.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:20.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:21.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:21.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:21.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:21.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:22.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:22.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:22.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:22.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:23.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:23.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:23.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:23.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:24.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:24.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:24.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:24.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:25.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:25.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:25.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:25.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:26.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:26.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:26.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:26.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:27.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:27.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:27.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:27.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:28.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:28.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:28.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:28.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:29.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:29.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:29.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:29.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:30.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:30.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:30.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:30.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:31.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:31.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:31.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:31.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:32.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:32.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:32.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:32.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:33.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:33.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:33.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:33.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:34.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:34.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:34.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:34.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:35.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:35.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:35.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:35.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:36.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:36.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:36.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:36.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:37.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:37.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:37.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:37.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:38.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:38.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:38.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:38.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:39.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:39.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:39.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:39.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:40.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:40.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:40.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:40.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:41.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:41.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:41.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:41.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:42.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:42.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:42.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:42.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:43.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:43.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:43.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:43.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:44.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:44.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:44.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:44.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:45.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:45.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:45.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:45.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:46.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:46.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:46.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:46.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:47.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:47.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:47.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:47.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:48.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:48.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:48.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:48.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:49.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:49.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:49.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:49.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:50.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:50.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:50.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:50.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:51.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:51.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:51.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:51.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:52.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:52.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:52.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:52.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:53.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:53.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:53.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:53.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:54.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:54.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:54.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:54.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:55.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:55.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:55.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:55.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:56.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:56.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:56.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:56.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:57.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:57.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:57.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:57.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:58.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:58.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:58.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:58.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:35:59.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:59.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:35:59.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:35:59.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:00.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:00.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:00.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:00.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:01.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:01.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:01.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:01.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:02.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:02.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:02.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:02.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:03.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:03.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:03.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:03.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:04.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:04.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:04.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:04.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:05.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:05.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:05.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:05.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:06.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:06.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:06.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:06.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:07.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:07.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:07.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:07.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:08.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:08.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:08.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:08.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:09.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:09.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:09.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:09.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:10.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:10.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:10.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:10.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:11.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:11.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:11.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:11.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:12.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:12.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:12.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:12.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:13.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:13.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:13.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:13.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:14.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:14.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:14.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:14.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:15.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:15.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:15.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:15.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:16.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:16.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:16.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:16.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:17.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:17.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:17.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:17.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:18.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:18.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:18.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:18.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:19.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:19.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:19.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:19.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:20.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:20.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:20.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:20.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:21.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:21.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:21.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:21.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:22.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:22.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:22.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:22.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:23.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:23.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:23.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:23.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:24.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:24.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:24.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:24.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:25.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:25.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:25.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:25.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:26.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:26.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:26.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:26.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:27.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:27.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:27.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:27.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:28.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:28.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:28.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:28.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:29.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:29.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:29.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:29.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:30.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:30.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:30.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:30.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:31.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:31.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:31.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:31.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:32.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:32.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:32.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:32.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:33.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:33.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:33.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:33.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:34.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:34.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:34.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:34.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:35.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:35.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:35.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:35.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:36.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:36.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:36.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:36.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:37.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:37.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:37.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:37.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:38.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:38.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:38.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:38.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:39.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:39.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:39.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:39.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:40.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:40.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:40.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:40.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:41.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:41.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:41.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:41.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:42.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:42.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:42.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:42.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:43.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:43.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:43.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:43.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:44.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:44.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:44.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:44.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:45.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:45.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:45.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:45.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:46.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:46.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:46.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:46.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:47.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:47.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:47.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:47.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:48.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:48.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:48.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:48.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:49.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:49.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:49.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:49.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:50.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:50.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:50.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:50.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:51.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:51.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:51.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:51.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:52.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:52.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:52.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:52.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:53.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:53.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:53.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:53.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:54.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:54.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:54.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:54.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:55.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:55.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:55.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:55.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:56.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:56.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:56.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:56.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:57.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:57.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:57.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:57.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:58.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:58.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:58.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:58.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:36:59.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:59.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:36:59.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:36:59.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:00.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:00.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:00.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:00.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:01.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:01.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:01.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:01.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:02.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:02.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:02.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:02.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:03.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:03.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:03.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:03.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:04.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:04.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:04.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:04.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:05.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:05.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:05.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:05.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:06.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:06.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:06.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:06.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:07.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:07.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:07.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:07.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:08.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:08.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:08.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:08.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:09.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:09.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:09.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:09.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:10.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:10.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:10.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:10.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:11.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:11.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:11.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:11.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:12.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:12.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:12.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:12.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:13.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:13.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:13.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:13.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:14.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:14.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:14.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:14.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:15.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:15.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:15.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:15.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:16.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:16.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:16.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:16.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:17.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:17.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:17.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:17.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:18.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:18.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:18.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:18.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:19.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:19.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:19.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:19.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:19.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:19.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:19.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:19.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:20.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:20.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:21.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:20.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:22.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:22.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:22.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:22.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:23.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:23.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:23.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:23.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:23.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:23.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:23.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:23.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:24.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:24.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:24.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:24.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:25.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:25.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:25.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:25.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:27.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:27.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:27.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:27.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:27.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:27.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:27.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:27.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:28.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:28.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:28.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:28.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:30.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:30.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:30.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:30.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:31.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:31.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:31.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:31.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:32.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:32.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:32.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:32.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:33.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:33.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:34.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:34.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:34.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:34.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:35.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:35.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:35.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:35.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:36.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:36.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:36.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:36.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:37.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:37.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:37.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:37.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:37.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:37.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:38.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:38.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:38.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:38.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:39.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:39.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:39.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:39.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:40.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:40.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:40.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:40.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:41.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:41.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:41.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:41.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:42.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:42.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:42.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:42.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:43.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:43.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:43.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:43.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:44.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:44.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:44.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:44.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:45.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:45.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:45.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:45.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:46.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:46.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:46.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:46.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:47.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:47.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:47.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:47.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:48.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:48.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:48.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:48.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:49.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:49.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:50.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:50.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:50.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:50.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:51.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:51.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:51.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:51.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:52.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:52.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:52.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:52.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:53.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:53.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:53.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:53.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:54.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:54.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:54.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:54.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:55.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:55.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:55.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:55.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:56.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:56.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:56.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:56.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:57.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:57.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:57.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:57.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:58.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:58.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:58.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:58.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:37:59.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:59.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:37:59.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:37:59.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:00.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:00.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:00.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:00.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:01.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:01.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:01.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:01.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:02.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:02.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:02.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:02.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:03.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:03.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:03.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:03.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:04.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:04.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:04.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:04.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:05.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:05.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:05.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:05.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:06.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:06.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:06.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:06.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:07.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:07.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:07.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:07.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:08.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:08.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:08.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:08.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:09.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:09.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:09.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:09.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:10.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:10.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:10.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:10.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:11.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:11.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:11.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:11.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:12.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:12.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:12.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:12.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:13.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:13.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:13.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:13.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:14.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:14.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:14.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:14.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:15.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:15.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:15.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:15.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:16.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:16.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:16.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:16.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:17.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:17.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:17.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:17.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:18.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:18.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:18.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:18.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:19.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:19.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:19.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:19.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:20.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:20.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:20.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:20.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:21.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:21.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:21.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:21.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:22.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:22.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:22.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:22.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:23.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:23.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:23.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:23.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:24.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:24.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:24.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:24.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:25.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:25.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:25.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:25.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:26.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:26.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:26.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:26.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:27.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:27.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:27.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:27.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:28.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:28.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:28.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:28.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:29.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:29.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:29.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:29.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:30.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:30.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:30.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:30.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:31.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:31.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:31.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:31.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:32.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:32.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:32.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:32.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:33.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:33.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:33.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:33.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:34.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:34.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:34.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:34.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:35.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:35.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:35.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:35.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:36.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:36.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:36.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:36.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:37.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:37.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:37.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:37.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:38.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:38.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:38.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:38.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:39.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:39.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:39.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:39.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:40.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:40.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:40.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:40.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:41.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:41.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:41.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:41.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:42.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:42.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:42.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:42.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:43.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:43.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:43.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:43.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:44.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:44.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:44.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:44.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:45.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:45.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:45.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:45.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:46.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:46.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:46.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:46.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:47.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:47.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:47.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:47.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:48.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:48.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:48.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:48.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:49.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:49.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:49.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:49.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:50.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:50.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:50.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:50.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:51.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:51.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:51.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:51.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:52.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:52.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:52.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:52.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:53.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:53.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:53.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:53.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:54.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:54.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:54.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:54.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:55.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:55.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:55.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:55.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:56.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:56.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:56.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:56.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:57.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:57.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:57.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:57.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:58.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:58.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:58.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:58.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:38:59.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:59.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:38:59.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:38:59.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:00.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:00.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:00.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:00.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:01.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:01.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:01.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:01.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:02.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:02.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:02.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:02.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:03.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:03.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:03.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:03.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:04.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:04.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:04.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:04.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:05.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:05.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:05.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:05.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:06.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:06.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:06.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:06.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:07.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:07.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:07.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:07.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:08.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:08.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:08.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:08.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:09.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:09.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:09.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:09.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:10.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:10.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:10.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:10.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:11.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:11.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:11.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:11.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:12.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:12.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:12.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:12.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:13.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:13.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:13.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:13.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:14.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:14.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:14.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:14.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:15.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:15.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:15.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:15.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:16.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:16.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:16.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:16.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:17.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:17.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:17.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:17.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:18.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:18.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:18.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:18.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:19.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:19.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:19.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:19.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:20.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:20.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:20.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:20.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:21.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:21.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:21.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:21.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:22.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:22.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:22.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:22.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:23.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:23.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:23.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:23.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:24.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:24.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:24.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:24.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:25.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:25.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:25.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:25.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:26.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:26.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:26.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:26.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:27.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:27.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:27.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:27.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:28.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:28.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:28.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:28.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:29.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:29.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:29.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:29.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:30.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:30.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:30.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:30.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:31.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:31.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:31.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:31.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:32.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:32.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:32.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:32.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:33.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:33.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:33.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:33.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:34.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:34.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:34.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:34.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:35.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:35.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:35.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:35.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:36.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:36.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:36.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:36.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:37.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:37.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:37.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:37.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:38.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:38.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:38.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:38.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:39.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:39.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:39.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:39.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:40.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:40.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:40.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:40.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:41.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:41.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:41.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:41.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:42.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:42.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:42.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:42.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:43.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:43.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:43.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:43.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:44.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:44.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:44.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:44.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:45.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:45.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:45.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:45.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:46.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:46.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:46.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:46.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:47.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:47.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:47.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:47.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:48.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:48.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:48.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:48.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:49.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:49.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:49.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:49.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:51.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:50.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:51.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:50.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:51.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:51.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:51.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:51.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:52.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:52.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:52.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:52.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:53.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:53.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:53.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:53.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:54.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:54.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:54.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:54.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:55.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:55.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:55.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:55.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:56.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:56.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:56.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:56.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:58.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:57.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:58.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:57.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:58.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:58.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:58.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:58.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:39:59.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:59.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:39:59.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:39:59.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:00.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:00.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:00.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:00.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:01.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:01.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:01.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:01.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:02.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:02.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:03.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:03.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:03.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:03.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:04.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:04.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:04.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:04.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:05.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:05.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:05.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:05.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:06.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:06.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:06.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:06.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:08.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:08.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:08.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:08.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:09.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:09.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:09.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:09.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:10.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:10.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:10.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:10.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:11.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:11.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:11.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:11.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:12.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:12.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:12.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:12.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:13.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:13.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:13.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:13.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:14.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:14.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:14.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:14.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:14.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:14.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:14.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:14.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:16.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:16.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:16.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:16.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:16.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:16.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:16.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:16.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:18.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:18.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:18.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:18.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:19.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:19.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:19.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:19.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:19.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:19.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:19.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:19.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:21.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:20.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:21.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:20.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:21.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:21.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:21.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:21.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:23.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:23.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:23.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:23.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:23.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:23.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:23.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:23.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:24.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:24.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:24.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:24.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:25.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:25.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:25.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:25.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:26.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:26.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:26.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:26.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:27.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:27.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:27.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:27.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:29.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:28.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:29.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:28.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:30.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:30.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:30.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:30.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:31.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:31.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:31.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:31.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:31.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:31.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:31.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:31.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:33.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:33.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:34.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:34.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:34.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:34.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:34.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:34.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:34.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:34.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:35.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:35.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:35.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:35.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:36.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:36.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:36.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:36.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:37.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:37.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:37.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:37.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:38.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:38.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:38.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:38.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:39.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:39.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:39.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:39.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:40.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:40.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:40.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:40.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:41.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:41.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:41.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:41.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:42.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:42.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:42.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:42.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:43.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:43.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:43.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:43.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:44.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:44.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:44.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:44.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:45.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:45.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:45.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:45.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:46.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:46.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:46.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:46.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:47.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:47.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:47.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:47.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:48.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:48.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:48.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:48.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:49.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:49.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:49.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:49.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:50.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:50.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:50.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:50.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:51.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:51.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:51.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:51.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:52.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:52.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:52.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:52.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:53.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:53.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:53.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:53.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:54.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:54.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:54.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:54.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:55.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:55.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:55.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:55.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:56.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:56.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:56.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:56.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:57.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:57.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:57.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:57.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:58.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:58.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:58.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:58.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:40:59.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:59.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:40:59.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:40:59.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:00.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:00.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:00.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:00.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:01.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:01.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:01.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:01.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:02.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:02.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:02.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:02.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:03.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:03.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:03.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:03.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:04.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:04.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:04.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:04.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:05.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:05.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:05.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:05.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:06.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:06.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:06.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:06.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:07.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:07.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:07.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:07.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:08.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:08.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:08.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:08.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:09.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:09.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:09.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:09.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:10.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:10.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:10.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:10.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:11.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:11.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:11.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:11.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:12.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:12.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:12.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:12.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:13.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:13.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:13.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:13.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:14.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:14.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:14.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:14.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:15.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:15.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:15.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:15.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:16.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:16.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:16.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:16.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:17.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:17.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:17.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:17.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:18.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:18.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:19.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:19.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:19.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:19.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:20.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:20.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:20.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:20.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:21.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:21.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:21.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:21.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:22.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:22.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:22.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:22.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:23.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:23.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:23.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:23.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:24.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:24.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:24.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:24.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:25.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:25.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:25.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:25.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:26.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:26.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:26.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:26.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:27.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:27.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:27.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:27.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:28.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:28.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:28.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:28.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:29.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:29.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:29.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:29.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:30.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:30.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:30.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:30.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:31.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:31.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:31.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:31.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:32.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:32.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:32.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:32.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:33.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:33.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:33.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:33.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:34.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:34.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:34.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:34.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:35.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:35.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:35.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:35.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:36.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:36.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:36.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:36.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:37.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:37.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:37.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:37.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:38.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:38.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:38.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:38.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:39.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:39.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:39.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:39.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:40.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:40.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:40.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:40.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:42.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:41.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:42.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:41.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:42.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:42.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:42.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:42.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:43.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:43.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:43.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:43.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:44.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:44.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:44.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:44.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:45.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:45.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:45.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:45.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:46.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:46.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:46.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:46.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:47.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:47.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:47.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:47.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:48.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:48.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:48.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:48.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:49.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:49.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:49.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:49.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:50.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:50.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:50.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:50.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:51.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:51.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:51.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:51.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:52.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:52.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:52.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:52.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:53.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:53.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:53.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:53.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:54.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:54.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:54.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:54.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:55.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:55.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:55.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:55.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:56.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:56.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:56.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:56.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:57.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:57.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:57.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:57.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:58.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:58.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:58.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:58.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:41:59.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:59.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:41:59.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:41:59.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:01.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:00.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:01.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:00.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:01.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:01.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:01.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:01.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:02.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:02.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:03.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:03.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:03.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:03.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:04.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:04.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:04.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:04.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:05.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:05.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:05.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:05.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:06.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:06.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:06.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:06.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:07.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:07.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:07.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:07.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:08.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:08.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:08.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:08.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:09.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:09.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:09.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:09.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:10.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:10.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:10.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:10.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:11.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:11.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:11.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:11.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:12.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:12.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:12.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:12.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:13.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:13.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:13.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:13.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:14.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:14.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:14.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:14.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:15.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:15.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:15.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:15.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:16.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:16.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:16.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:16.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:17.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:17.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:17.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:17.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:18.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:18.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:18.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:18.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:19.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:19.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:19.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:19.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:21.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:21.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:22.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:22.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:22.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:22.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:23.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:23.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:23.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:23.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:24.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:24.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:24.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:24.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:25.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:25.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:25.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:25.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:26.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:26.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:26.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:26.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:27.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:26.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:27.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:26.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:28.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:28.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:28.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:28.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:28.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:28.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:28.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:28.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:29.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:29.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:29.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:29.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:30.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:30.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:30.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:30.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:31.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:31.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:31.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:31.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:32.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:32.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:32.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:32.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:33.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:33.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:33.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:33.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:35.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:35.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:35.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:35.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:36.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:36.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:36.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:36.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:36.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:36.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:36.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:36.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:38.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:37.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:38.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:37.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:39.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:39.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:39.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:39.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:40.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:40.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:40.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:40.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:41.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:41.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:41.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:41.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:41.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:41.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:41.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:41.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:43.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:43.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:43.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:43.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:44.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:44.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:44.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:44.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:45.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:45.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:45.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:45.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:46.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:46.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:46.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:46.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:47.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:47.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:47.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:47.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:48.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:48.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:48.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:48.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:49.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:49.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:49.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:49.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:50.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:50.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:50.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:50.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:51.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:51.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:51.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:51.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:52.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:52.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:52.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:52.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:53.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:53.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:32:22.188014+0000 (oldest deadline 2019-10-23T09:32:42.188014+0000) 2019-10-23T09:42:53.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:53.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:54.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:54.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:55.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:55.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:56.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:56.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:57.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:57.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:58.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:58.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:59.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:59.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:42:59.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:42:59.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:01.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:01.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:02.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:01.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:03.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:03.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:04.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:04.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:05.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:05.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:06.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:06.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:07.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:07.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:07.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:07.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:08.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:08.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:09.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:09.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:10.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:10.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:11.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:11.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:13.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:13.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:13.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:13.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:14.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:14.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:14.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:14.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:15.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:15.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:15.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:15.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:17.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:16.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:17.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:16.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:18.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:18.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:18.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:18.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:19.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:19.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:19.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:19.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:20.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:20.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:20.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:20.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:21.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:21.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:21.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:21.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:22.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:22.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:22.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:22.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:23.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:23.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:23.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:23.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:24.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:24.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:24.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:24.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:24.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:24.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:24.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:24.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:26.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:25.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:26.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:25.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:26.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:26.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:26.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:26.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:27.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:27.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:27.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:27.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:28.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:28.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:28.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:28.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:29.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:29.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:29.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:29.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:30.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:30.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:30.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:30.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:31.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:31.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:31.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:31.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:32.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:32.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:32.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:32.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:33.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:33.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:33.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:33.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:34.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:34.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:34.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:34.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:35.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:35.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:35.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:35.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:36.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:36.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:36.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:36.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:37.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:37.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:37.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:37.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:38.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:38.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:38.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:38.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:39.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:39.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:39.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:39.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:40.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:40.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:40.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:40.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:41.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:41.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:41.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:41.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:42.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:42.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:42.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:42.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:43.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:43.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:43.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:43.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:44.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:44.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:44.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:44.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:45.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:45.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:45.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:45.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:46.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:46.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:46.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:46.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:47.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:47.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:48.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:48.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:48.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:48.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:49.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:49.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:50.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:50.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:50.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:50.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:51.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:51.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:51.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:51.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:52.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:52.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:52.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:52.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:53.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:53.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:53.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:53.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:54.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:54.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:54.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:54.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:55.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:55.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:55.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:55.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:56.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:56.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:56.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:56.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:57.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:57.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:57.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:57.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:58.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:58.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:58.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:58.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:43:59.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:59.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:43:59.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:43:59.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:00.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:00.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:00.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:00.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:01.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:01.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:01.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:01.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:02.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:02.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:02.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:02.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:03.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:03.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:03.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:03.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:04.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:04.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:04.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:04.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:05.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:05.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:05.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:05.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:06.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:06.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:06.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:06.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:07.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:07.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:07.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:07.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:08.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:08.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:08.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:08.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:09.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:09.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:09.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:09.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:10.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:10.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:10.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:10.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:11.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:11.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:11.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:11.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:12.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:12.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:12.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:12.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:13.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:13.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:13.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:13.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:14.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:14.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:14.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:14.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:15.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:15.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:15.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:15.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:16.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:16.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:16.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:16.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:17.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:17.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:17.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:17.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:18.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:18.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:18.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:18.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:19.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:19.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:19.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:19.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:20.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:20.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:20.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:20.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:21.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:21.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:21.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:21.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:22.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:22.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:22.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:22.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:23.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:23.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:24.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:24.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:24.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:25.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:25.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:25.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:25.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:26.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:26.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:26.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:26.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:27.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:27.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:27.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:27.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:28.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:28.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:28.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:28.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:29.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:29.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:29.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:29.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:30.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:30.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:30.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:30.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:31.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:31.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:31.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:31.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:32.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:32.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:32.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:32.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:33.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:33.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:33.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:33.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:34.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:34.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:34.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:34.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:35.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:35.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:35.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:35.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:36.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:36.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:36.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:36.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:37.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:37.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:37.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:37.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:38.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:38.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:38.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:38.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:39.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:39.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:39.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:39.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:40.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:40.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:40.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:40.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:41.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:41.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:41.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:41.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:42.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:42.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:42.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:42.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:43.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:43.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:43.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:43.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:44.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:44.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:44.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:44.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:45.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:45.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:45.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:45.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:46.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:46.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:46.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:46.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:47.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:47.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:47.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:47.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:48.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:48.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:48.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:48.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:49.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:49.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:49.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:49.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:50.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:50.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:50.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:50.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:51.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:51.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:51.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:51.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:52.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:52.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:52.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:52.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:53.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:53.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:53.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:53.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:54.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:54.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:54.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:54.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:55.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:55.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:55.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:55.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:56.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:56.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:56.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:56.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:57.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:57.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:57.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:57.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:58.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:58.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:58.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:58.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:44:59.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:59.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:44:59.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:44:59.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:00.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:00.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:00.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:00.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:01.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:01.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:01.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:01.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:02.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:02.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:02.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:02.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:03.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:03.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:03.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:03.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:04.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:04.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:04.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:04.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:05.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:05.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:05.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:05.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:06.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:06.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:06.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:06.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:07.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:07.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:07.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:07.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:08.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:08.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:08.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:08.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:09.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:09.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:09.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:09.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:10.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:10.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:10.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:10.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:11.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:11.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:11.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:11.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:12.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:12.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:12.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:12.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:13.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:13.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:13.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:13.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:14.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:14.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:14.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:14.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:15.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:15.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:15.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:15.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:16.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:16.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:16.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:16.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:17.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:17.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:17.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:17.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:18.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:18.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:18.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:18.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:19.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:19.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:19.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:19.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:20.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:20.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:20.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:20.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:21.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:21.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:21.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:21.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:22.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:22.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:22.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:22.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:23.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:23.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:23.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:23.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:24.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:24.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:24.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:24.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:25.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:25.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:25.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:25.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:26.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:26.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:26.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:26.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:27.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:27.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:27.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:27.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:28.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:28.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:28.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:28.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:29.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:29.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:29.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:29.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:30.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:30.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:30.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:30.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:31.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:31.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:31.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:31.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:32.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:32.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:32.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:32.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:33.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:33.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:33.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:33.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:34.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:34.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:34.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:34.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:35.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:35.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:35.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:35.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:36.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:36.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:36.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:36.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:37.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:37.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:37.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:37.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:38.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:38.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:38.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:38.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:39.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:39.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:39.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:39.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:40.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:40.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:40.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:40.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:41.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:41.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:41.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:41.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:42.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:42.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:42.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:42.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:43.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:43.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:43.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:43.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:44.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:44.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:44.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:44.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:45.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:45.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:45.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:45.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:46.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:46.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:46.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:46.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:47.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:47.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:47.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:47.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:48.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:48.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:48.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:48.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:49.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:49.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:49.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:49.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:50.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:50.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:50.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:50.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:51.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:51.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:51.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:51.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:52.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:52.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:52.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:52.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:53.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:53.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:53.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:53.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:54.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:54.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:54.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:54.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:55.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:55.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:55.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:55.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:56.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:56.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:56.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:56.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:57.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:57.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:57.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:57.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:58.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:58.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:58.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:58.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:45:59.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:59.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:45:59.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:45:59.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:00.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:00.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:00.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:00.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:01.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:01.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:01.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:01.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:02.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:02.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:02.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:02.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:03.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:03.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:03.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:03.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:04.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:04.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:04.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:04.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:05.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:05.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:05.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:05.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:06.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:06.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:06.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:06.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:07.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:07.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:07.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:07.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:08.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:08.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:08.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:08.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:09.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:09.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:09.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:09.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:10.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:10.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:10.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:10.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:11.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:11.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:11.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:11.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:12.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:12.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:12.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:12.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:13.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:13.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:13.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:13.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:14.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:14.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:14.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:14.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:15.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:15.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:15.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:15.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:16.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:16.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:16.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:16.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:17.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:17.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:17.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:17.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:18.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:18.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:18.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:18.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:19.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:19.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:19.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:19.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:20.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:20.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:20.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:20.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:21.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:21.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:21.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:21.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:22.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:22.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:22.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:22.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:23.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:23.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:23.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:23.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:24.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:24.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:25.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:25.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:25.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:25.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:26.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:26.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:26.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:26.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:27.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:27.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:27.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:27.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:28.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:28.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:28.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:28.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:29.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:29.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:29.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:29.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:30.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:30.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:30.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:30.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:31.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:31.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:31.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:31.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:32.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:32.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:32.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:32.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:33.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:33.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:33.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:33.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:34.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:34.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:34.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:34.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:35.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:35.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:35.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:35.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:36.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:36.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:36.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:36.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:37.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:37.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:37.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:37.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:38.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:38.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:38.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:38.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:39.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:39.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:39.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:39.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:40.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:40.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:40.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:40.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:41.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:41.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:41.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:41.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:42.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:42.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:42.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:42.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:43.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:43.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:43.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:43.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:44.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:44.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:44.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:44.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:45.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:45.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:45.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:45.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:46.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:46.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:46.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:46.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:47.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:47.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:47.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:47.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:48.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:48.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:48.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:48.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:49.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:49.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:49.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:49.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:50.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:50.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:50.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:50.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:51.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:51.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:51.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:51.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:52.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:52.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:52.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:52.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:53.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:53.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:53.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:53.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:54.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:54.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:55.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:55.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:55.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:55.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:56.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:56.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:56.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:56.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:57.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:57.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:57.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:57.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:58.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:58.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:58.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:58.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:46:59.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:59.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:46:59.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:46:59.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:00.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:00.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:00.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:00.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:01.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:01.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:01.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:01.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:02.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:02.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:02.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:02.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:03.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:03.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:03.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:03.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:04.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:04.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:04.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:04.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:05.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:05.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:05.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:05.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:06.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:06.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:06.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:06.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:07.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:07.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:07.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:07.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:08.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:08.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:08.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:08.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:10.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:09.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:10.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:09.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:10.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:10.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:10.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:10.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:11.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:11.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:11.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:11.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:12.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:12.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:12.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:12.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:13.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:13.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:13.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:13.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:14.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:14.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:14.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:14.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:15.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:15.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:15.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:15.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:16.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:16.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:16.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:16.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:17.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:17.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:17.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:17.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:18.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:18.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:18.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:19.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:19.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:19.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:19.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:20.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:20.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:20.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:20.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:21.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:21.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:21.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:21.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:22.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:22.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:22.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:22.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:23.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:23.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:23.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:23.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:24.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:24.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:24.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:24.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:25.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:25.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:25.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:25.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:26.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:26.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:26.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:26.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:27.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:27.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:27.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:27.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:28.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:28.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:28.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:28.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:29.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:29.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:29.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:29.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:30.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:30.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:30.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:30.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:31.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:31.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:31.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:31.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:32.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:32.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:32.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:32.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:33.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:33.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:33.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:33.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:34.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:34.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:34.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:34.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:35.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:35.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:36.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:36.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:36.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:36.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:37.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:37.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:37.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:37.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:38.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:38.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:38.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:38.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:39.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:39.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:39.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:39.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:40.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:40.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:40.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:40.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:41.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:41.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:41.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:41.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:42.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:42.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:42.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:42.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:43.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:43.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:43.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:43.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:44.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:44.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:44.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:44.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:45.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:45.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:45.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:45.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:46.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:46.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:46.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:46.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:47.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:47.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:47.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:47.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:48.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:48.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:48.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:48.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:49.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:49.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:50.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:49.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:50.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:50.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:50.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:50.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:51.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:51.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:51.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:51.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:52.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:52.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:52.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:52.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:53.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:53.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:53.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:53.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:54.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:54.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:55.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:55.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:55.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:55.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:56.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:56.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:56.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:56.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:57.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:57.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:57.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:57.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:58.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:58.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:58.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:58.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:47:59.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:59.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:47:59.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:47:59.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:00.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:00.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:00.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:00.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:01.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:01.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:01.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:01.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:02.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:02.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:02.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:02.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:03.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:03.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:03.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:03.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:04.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:04.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:04.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:04.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:05.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:05.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:05.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:05.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:06.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:06.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:06.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:06.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:07.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:07.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:07.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:07.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:08.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:08.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:08.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:08.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:09.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:09.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:09.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:09.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:10.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:10.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:10.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:10.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:11.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:11.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:11.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:11.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:12.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:12.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:12.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:12.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:13.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:13.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:13.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:13.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:14.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:14.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:14.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:14.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:15.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:15.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:15.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:15.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:16.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:16.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:16.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:16.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:17.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:17.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:17.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:17.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:18.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:18.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:18.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:18.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:19.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:19.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:19.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:19.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:20.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:20.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:20.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:20.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:21.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:21.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:21.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:21.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:22.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:22.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:22.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:22.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:23.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:23.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:23.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:23.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:24.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:24.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:24.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:24.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:25.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:25.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:25.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:25.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:27.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:27.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:27.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:27.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:28.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:28.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:28.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:28.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:29.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:29.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:29.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:29.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:30.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:30.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:30.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:30.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:31.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:31.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:31.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:31.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:32.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:32.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:32.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:32.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:33.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:33.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:33.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:33.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:34.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:34.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:34.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:34.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:35.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:35.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:35.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:35.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:36.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:36.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:36.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:36.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:37.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:37.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:37.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:37.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:38.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:38.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:38.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:38.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:39.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:39.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:39.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:39.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:40.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:40.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:40.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:40.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:41.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:41.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:41.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:41.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:42.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:42.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:42.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:42.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:42.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:42.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:42.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:42.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:43.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:43.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:43.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:43.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:44.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:44.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:44.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:44.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:45.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:45.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:45.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:45.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:46.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:46.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:46.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:46.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:47.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:47.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:48.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:48.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:48.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:48.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:49.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:49.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:49.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:49.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:50.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:50.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:50.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:50.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:51.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:51.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:52.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:51.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:52.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:52.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:52.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:52.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:53.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:53.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:53.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:53.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:54.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:54.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:54.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:54.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:55.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:55.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:55.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:55.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:56.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:56.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:56.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:56.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:57.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:57.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:57.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:57.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:58.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:58.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:58.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:58.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:48:59.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:59.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:48:59.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:48:59.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:00.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:00.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:00.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:00.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:01.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:01.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:01.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:01.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:02.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:02.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:02.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:02.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:03.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:03.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:04.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:04.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:04.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:04.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:05.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:05.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:05.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:05.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:06.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:06.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:06.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:06.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:07.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:07.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:07.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:07.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:08.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:08.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:08.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:08.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:09.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:09.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:09.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:09.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:10.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:10.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:10.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:10.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:11.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:11.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:11.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:11.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:12.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:12.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:12.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:12.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:13.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:13.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:13.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:13.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:14.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:14.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:14.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:14.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:15.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:15.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:15.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:15.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:16.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:16.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:16.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:16.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:17.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:17.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:17.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:17.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:18.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:18.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:18.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:18.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:19.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:19.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:19.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:19.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:20.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:20.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:20.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:20.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:21.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:21.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:21.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:21.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:22.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:22.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:22.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:22.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:23.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:23.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:23.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:23.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:24.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:24.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:24.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:24.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:25.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:25.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:25.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:25.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:26.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:26.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:26.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:26.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:27.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:27.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:27.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:27.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:28.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:28.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:28.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:28.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:29.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:29.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:29.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:29.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:30.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:30.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:30.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:30.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:31.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:31.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:31.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:31.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:32.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:32.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:32.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:32.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:33.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:33.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:33.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:33.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:34.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:34.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:34.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:34.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:35.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:35.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:35.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:35.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:36.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:36.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:36.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:36.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:37.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:37.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:37.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:37.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:38.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:38.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:38.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:38.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:40.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:40.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:40.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:40.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:41.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:41.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:41.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:41.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:42.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:41.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:42.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:41.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:43.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:42.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:43.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:42.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:43.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:43.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:43.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:43.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:44.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:44.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:44.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:44.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:45.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:45.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:45.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:45.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:46.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:46.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:46.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:46.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:47.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:47.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:47.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:47.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:48.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:48.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:48.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:48.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:49.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:49.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:49.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:49.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:50.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:50.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:50.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:50.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:52.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:52.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:52.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:52.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:53.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:53.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:53.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:53.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:54.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:54.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:54.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:54.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:54.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:54.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:54.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:54.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:56.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:56.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:56.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:56.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:57.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:57.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:57.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:57.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:58.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:58.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:58.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:58.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:49:59.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:59.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:49:59.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:49:59.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:00.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:00.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:00.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:00.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:01.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:01.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:01.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:01.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:02.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:02.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:02.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:02.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:03.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:03.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:03.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:03.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:04.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:04.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:04.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:04.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:04.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:04.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:04.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:04.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:05.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:05.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:05.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:05.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:06.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:06.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:06.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:06.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:08.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:08.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:08.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:08.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:09.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:09.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:09.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:09.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:10.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:10.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:10.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:10.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:11.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:11.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:11.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:11.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:12.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:12.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:12.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:12.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:13.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:13.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:13.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:13.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:14.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:14.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:14.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:14.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:15.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:15.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:15.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:15.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:16.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:16.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:16.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:16.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:17.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:17.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:17.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:17.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:18.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:18.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:18.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:18.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:19.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:19.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:19.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:19.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:20.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:20.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:20.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:20.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:21.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:21.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:21.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:21.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:22.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:22.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:22.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:22.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:23.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:23.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:23.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:23.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:24.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:24.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:24.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:24.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:25.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:25.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:25.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:25.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:26.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:26.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:26.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:26.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:27.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:27.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:27.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:27.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:28.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:28.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:28.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:28.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:29.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:29.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:29.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:29.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:30.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:30.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:30.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:30.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:31.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:31.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:31.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:31.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:32.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:32.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:32.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:32.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:33.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:33.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:33.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:33.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:34.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:34.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:34.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:34.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:35.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:35.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:35.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:35.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:36.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:36.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:36.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:36.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:37.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:37.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:37.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:37.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:38.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:38.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:38.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:38.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:39.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:39.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:39.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:39.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:40.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:40.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:40.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:40.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:41.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:41.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:41.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:41.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:42.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:42.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:42.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:42.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:43.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:43.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:43.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:43.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:44.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:44.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:44.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:44.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:45.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:45.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:45.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:45.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:46.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:46.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:46.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:46.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:47.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:47.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:47.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:47.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:48.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:48.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:48.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:48.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:49.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:49.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:49.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:49.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:50.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:50.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:50.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:50.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:51.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:51.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:51.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:51.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:52.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:52.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:52.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:52.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:53.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:53.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:53.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:53.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:54.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:54.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:54.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:54.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:55.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:55.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:55.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:55.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:56.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:56.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:56.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:56.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:57.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:57.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:57.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:57.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:58.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:58.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:58.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:58.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:50:59.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:59.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:50:59.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:50:59.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:00.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:00.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:00.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:00.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:01.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:01.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:01.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:01.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:02.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:02.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:02.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:02.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:03.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:03.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:03.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:03.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:04.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:04.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:04.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:04.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:05.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:05.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:05.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:05.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:06.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:06.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:06.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:06.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:07.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:07.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:07.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:07.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:08.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:08.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:08.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:08.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:09.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:09.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:09.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:09.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:10.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:10.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:10.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:10.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:11.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:11.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:11.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:11.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:12.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:12.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:12.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:12.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:13.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:13.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:13.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:13.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:14.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:14.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:14.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:14.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:15.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:15.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:15.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:15.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:16.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:16.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:16.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:16.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:17.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:17.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:17.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:17.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:18.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:18.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:18.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:18.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:19.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:19.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:19.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:19.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:20.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:20.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:20.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:20.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:21.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:21.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:21.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:21.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:22.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:22.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:22.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:22.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:23.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:23.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:23.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:23.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:24.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:24.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:24.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:24.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:25.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:25.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:25.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:25.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:26.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:26.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:26.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:26.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:27.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:27.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:27.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:27.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:28.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:28.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:28.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:28.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:29.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:29.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:29.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:29.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:30.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:30.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:30.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:30.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:31.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:31.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:31.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:31.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:32.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:32.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:32.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:32.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:33.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:33.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:33.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:33.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:34.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:34.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:34.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:34.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:35.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:35.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:35.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:35.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:36.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:36.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:36.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:36.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:37.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:37.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:37.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:37.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:38.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:38.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:38.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:38.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:39.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:39.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:39.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:39.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:40.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:40.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:40.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:40.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:41.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:41.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:41.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:41.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:42.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:42.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:42.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:42.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:43.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:43.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:43.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:43.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:44.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:44.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:44.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:44.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:45.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:45.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:45.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:45.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:46.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:46.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:46.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:46.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:47.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:47.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:47.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:47.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:48.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:48.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:48.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:48.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:49.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:49.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:49.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:49.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:50.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:50.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:50.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:50.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:51.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:51.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:51.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:51.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:52.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:52.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:52.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:52.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:53.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:53.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:53.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:53.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:54.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:54.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:54.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:54.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:55.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:55.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:55.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:55.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:56.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:56.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:56.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:56.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:56.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:56.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:56.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:56.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:57.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:57.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:57.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:57.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:58.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:58.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:58.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:58.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:51:59.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:59.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:51:59.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:51:59.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:00.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:00.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:00.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:00.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:01.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:01.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:01.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:01.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:02.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:02.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:02.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:02.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:03.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:03.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:03.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:03.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:04.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:04.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:04.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:04.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:05.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:05.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:05.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:05.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:06.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:06.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:06.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:06.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:07.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:07.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:07.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:07.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:08.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:08.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:08.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:08.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:09.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:09.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:09.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:09.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:10.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:10.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:10.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:10.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:12.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:12.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:12.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:12.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:12.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:12.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:14.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:13.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:14.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:13.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:15.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:15.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:15.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:15.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:16.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:15.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:16.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:15.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:17.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:17.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:17.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:17.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:18.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:17.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:18.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:17.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 48 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:19.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:19.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:19.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:19.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:20.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:20.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:20.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:20.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:21.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:21.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:21.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:21.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:22.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:22.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:22.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:22.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:23.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:23.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:23.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:23.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:24.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:24.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:24.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:24.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:25.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:25.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:25.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:25.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:26.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:26.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:26.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:26.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:27.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:27.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:27.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:27.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:28.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:28.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:28.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:28.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:29.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:29.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:29.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:29.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:30.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:30.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:30.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:30.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:31.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:31.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:31.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:31.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:32.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:32.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:32.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:32.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:33.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:33.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:33.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:33.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:34.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:34.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:34.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:34.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:35.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:35.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:35.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:35.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:36.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:36.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:36.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:36.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:37.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:37.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:37.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:37.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:37.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:37.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:38.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:38.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:38.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:38.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:39.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:39.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:39.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:39.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:40.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:40.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:40.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:40.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:41.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:41.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:41.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:41.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:42.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:42.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:42.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:42.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:43.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:43.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:43.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:43.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:44.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:44.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:44.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:44.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:45.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:45.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:45.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:45.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:46.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:46.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:46.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:46.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:47.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:47.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:47.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:47.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:48.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:48.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:48.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:48.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:49.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:49.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:49.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:49.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:50.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:50.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:50.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:50.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:51.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:51.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:51.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:51.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:52.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:52.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:52.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:52.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:53.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:53.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:53.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:53.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:54.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:54.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:54.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:54.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:55.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:55.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:55.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:55.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:56.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:56.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:56.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:56.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:57.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:57.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:57.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:57.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:58.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:58.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:58.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:58.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:52:59.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:59.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:52:59.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:52:59.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:00.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:00.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:00.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:00.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:01.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:01.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:01.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:01.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:02.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:02.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:02.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:02.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:03.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:03.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:03.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:03.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:04.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:04.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:04.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:04.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:05.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:05.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:05.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:05.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:06.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:06.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:06.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:06.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:07.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:07.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:07.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:07.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:08.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:08.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:08.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:08.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:09.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:09.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:09.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:09.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:10.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:10.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:10.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:10.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:11.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:11.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:11.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:11.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:12.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:12.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:12.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:12.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:13.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:13.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:13.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:13.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:14.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:14.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:14.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:14.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:15.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:15.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:15.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:15.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:16.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:16.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:16.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:16.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:17.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:17.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:17.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:17.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:18.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:18.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:18.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:18.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:19.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:19.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:19.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:19.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:20.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:20.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:20.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:20.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:21.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:21.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:21.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:21.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:22.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:22.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:22.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:22.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:23.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:23.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:23.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:23.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:24.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:24.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:24.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:24.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:25.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:25.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:42:54.815905+0000 (oldest deadline 2019-10-23T09:43:14.815905+0000) 2019-10-23T09:53:25.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:25.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:26.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:26.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:27.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:27.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:28.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:28.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:29.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:29.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:30.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:30.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:31.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:31.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:32.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:32.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:33.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:33.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:34.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:34.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:35.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:35.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:36.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:36.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:37.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:37.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:38.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:38.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:39.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:39.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:40.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:40.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:41.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:41.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:42.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:42.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:43.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:43.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:44.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:44.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:45.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:45.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:46.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:46.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:47.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:47.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:48.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:48.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:48.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:48.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:49.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:49.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:49.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:49.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:50.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:50.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:50.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:50.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:51.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:51.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:51.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:51.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:52.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:52.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:52.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:52.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:53.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:53.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:53.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:53.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:54.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:54.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:54.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:54.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:55.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:55.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:55.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:55.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:56.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:56.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:56.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:56.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:57.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:57.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:57.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:57.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:58.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:58.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:58.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:58.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:53:59.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:59.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:53:59.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:53:59.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:00.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:00.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:00.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:00.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:01.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:01.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:01.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:01.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:02.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:02.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:02.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:02.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:03.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:03.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:03.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:03.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:04.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:04.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:04.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:04.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:05.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:05.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:05.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:05.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:06.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:06.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:06.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:06.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:07.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:07.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:07.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:07.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:08.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:08.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:08.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:08.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:09.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:09.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:09.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:09.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:10.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:10.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:10.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:10.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:11.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:11.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:11.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:11.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:12.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:12.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:12.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:12.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:13.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:13.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:13.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:13.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:14.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:14.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:14.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:14.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:15.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:15.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:15.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:15.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:16.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:16.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:16.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:16.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:17.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:17.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:17.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:17.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:18.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:18.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:18.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:18.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:19.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:19.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:19.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:19.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:20.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:20.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:20.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:20.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:21.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:21.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:21.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:21.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:22.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:22.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:22.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:22.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:23.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:23.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:23.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:23.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:24.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:24.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:24.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:24.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:25.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:25.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:25.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:25.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:26.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:26.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:26.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:26.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:27.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:27.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:27.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:27.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:28.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:28.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:28.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:28.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:29.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:29.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:29.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:29.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:30.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:30.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:30.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:30.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:31.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:31.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:31.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:31.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:32.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:32.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:32.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:32.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:33.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:33.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:33.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:33.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:34.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:34.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:34.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:34.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:35.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:35.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:35.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:35.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:36.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:36.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:36.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:36.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:37.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:37.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:37.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:37.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:38.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:38.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:38.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:38.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:39.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:39.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:39.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:39.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:40.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:40.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:40.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:40.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:41.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:41.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:41.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:41.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:42.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:42.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:42.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:42.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:43.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:43.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:43.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:43.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:44.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:44.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:44.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:44.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:45.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:45.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:45.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:45.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:46.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:46.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:46.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:46.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:47.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:47.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:48.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:48.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:48.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:48.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:49.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:49.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:49.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:49.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:50.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:50.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:50.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:50.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:51.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:51.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:51.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:51.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:52.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:52.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:52.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:52.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:53.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:53.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:53.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:53.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:54.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:54.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:54.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:54.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:55.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:55.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:55.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:55.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:56.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:56.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:56.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:56.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:57.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:57.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:57.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:57.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:58.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:58.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:58.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:58.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:54:59.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:59.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:54:59.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:54:59.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:01.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:01.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:01.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:01.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:01.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:01.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:01.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:01.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:03.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:03.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:03.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:03.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:03.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:03.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:03.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:03.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:04.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:04.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:04.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:04.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:05.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:05.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:05.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:05.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:06.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:06.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:06.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:06.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:07.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:07.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:07.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:07.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:08.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:08.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:08.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:08.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:09.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:09.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:09.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:09.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:10.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:10.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:10.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:10.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:11.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:11.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:11.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:11.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:12.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:12.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:12.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:12.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:13.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:13.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:13.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:13.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:14.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:14.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:14.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:14.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:15.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:15.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:15.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:15.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:16.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:16.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:16.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:16.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:17.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:17.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:17.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:17.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:18.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:18.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:18.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:18.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:19.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:19.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:19.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:19.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:21.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:21.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:21.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:21.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:22.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:22.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:22.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:22.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:23.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:23.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:23.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:23.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:24.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:24.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:24.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:24.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:25.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:25.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:25.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:25.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:26.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:26.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:26.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:26.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:27.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:27.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:27.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:27.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:28.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:28.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:28.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:28.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:29.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:29.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:29.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:29.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:30.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:30.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:30.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:30.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:31.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:31.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:31.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:31.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:32.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:32.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:32.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:32.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:33.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:33.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:33.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:33.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:34.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:34.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:34.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:34.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:35.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:35.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:35.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:35.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:36.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:36.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:36.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:36.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:37.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:37.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:37.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:37.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:38.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:38.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:38.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:38.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:39.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:39.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:39.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:39.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:40.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:40.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:40.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:40.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:41.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:41.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:41.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:41.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:42.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:42.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:42.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:42.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:43.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:43.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:43.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:43.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:44.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:44.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:44.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:44.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:45.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:45.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:45.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:45.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:46.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:46.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:46.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:46.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:47.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:47.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:47.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:47.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:48.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:48.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:48.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:48.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:49.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:49.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:49.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:49.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:50.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:50.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:50.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:50.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:51.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:51.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:51.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:51.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:52.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:52.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:52.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:52.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:53.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:53.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:53.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:53.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:54.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:54.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:54.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:54.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:55.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:55.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:55.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:55.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:56.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:56.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:56.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:56.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:57.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:57.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:57.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:57.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:58.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:58.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:58.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:58.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:55:59.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:59.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:55:59.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:55:59.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:00.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:00.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:00.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:00.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:01.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:01.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:01.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:01.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:02.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:02.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:02.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:02.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:03.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:03.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:03.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:03.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:04.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:04.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:04.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:04.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:05.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:05.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:05.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:05.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:06.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:06.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:06.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:06.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:07.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:07.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:07.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:07.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:08.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:08.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:08.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:08.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:09.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:09.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:09.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:09.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:10.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:10.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:10.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:10.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:11.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:11.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:11.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:11.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:12.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:12.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:12.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:12.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:13.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:13.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:13.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:13.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:14.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:14.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:14.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:14.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:15.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:15.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:15.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:15.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:16.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:16.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:16.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:16.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:17.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:17.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:17.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:17.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:18.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:18.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:18.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:18.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:19.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:19.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:19.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:19.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:20.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:20.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:20.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:20.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:21.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:21.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:21.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:21.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:22.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:22.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:22.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:22.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:23.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:23.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:23.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:23.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:24.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:24.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:24.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:24.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:25.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:25.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:25.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:25.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:26.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:26.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:26.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:26.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:27.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:26.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:27.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:26.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:27.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:27.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:27.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:27.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:28.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:28.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:28.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:28.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:29.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:29.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:29.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:29.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:30.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:30.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:30.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:30.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:31.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:31.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:31.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:31.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:32.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:32.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:32.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:32.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:33.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:33.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:33.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:33.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:34.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:34.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:34.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:34.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:35.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:35.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:35.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:35.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:36.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:36.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:36.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:36.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:38.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:38.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:38.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:38.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:39.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:39.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:39.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:39.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:40.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:40.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:40.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:40.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:41.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:41.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:41.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:41.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:42.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:42.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:42.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:42.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:43.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:43.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:43.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:43.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:44.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:44.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:44.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:44.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:45.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:45.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:45.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:45.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:46.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:46.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:46.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:46.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:47.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:47.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:47.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:47.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:48.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:48.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:48.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:48.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:49.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:49.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:49.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:49.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:50.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:50.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:50.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:50.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:51.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:51.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:51.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:51.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:52.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:52.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:52.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:52.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:53.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:53.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:53.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:53.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:54.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:54.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:54.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:54.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:55.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:55.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:55.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:55.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:56.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:56.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:56.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:56.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:57.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:57.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:57.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:57.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:58.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:58.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:58.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:58.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:56:59.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:59.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:56:59.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:56:59.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:00.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:00.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:00.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:00.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:01.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:01.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:01.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:01.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:02.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:02.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:02.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:02.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:03.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:03.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:03.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:03.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:04.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:04.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:04.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:04.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:05.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:05.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:05.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:05.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:06.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:06.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:06.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:06.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:07.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:07.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:07.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:07.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:08.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:08.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:08.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:08.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:09.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:09.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:09.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:09.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:10.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:10.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:10.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:10.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:11.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:11.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:11.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:11.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:12.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:12.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:12.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:12.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:13.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:13.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:13.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:13.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:13.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:13.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:13.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:13.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:14.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:14.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:14.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:14.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:15.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:15.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:15.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:15.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:16.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:16.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:16.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:16.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:17.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:17.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:17.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:17.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:18.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:18.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:18.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:18.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:19.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:19.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:19.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:19.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:20.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:20.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:20.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:20.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:21.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:21.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:21.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:21.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:22.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:22.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:22.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:22.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:23.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:23.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:23.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:23.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:24.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:24.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:24.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:24.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:26.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:26.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:26.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:26.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:27.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:27.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:27.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:27.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:28.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:28.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:28.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:28.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:29.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:29.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:29.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:29.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:30.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:30.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:30.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:30.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:31.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:30.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:31.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:30.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:31.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:31.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:31.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:31.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:33.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:32.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:33.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:32.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:34.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:33.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:34.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:33.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:34.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:34.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:34.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:34.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:35.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:35.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:35.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:35.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:36.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:36.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:36.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:36.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:37.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:37.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:37.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:37.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:38.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:38.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:38.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:38.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:39.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:39.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:39.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:39.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:40.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:40.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:40.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:40.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:41.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:41.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:41.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:41.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:42.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:42.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:42.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:42.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:43.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:43.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:43.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:43.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:44.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:44.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:44.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:44.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:45.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:45.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:46.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:46.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:46.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:46.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:47.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:47.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:47.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:47.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:48.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:48.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:48.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:48.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:49.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:49.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:49.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:49.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:50.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:50.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:50.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:50.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:51.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:51.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:51.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:51.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:52.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:52.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:52.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:52.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:53.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:53.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:53.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:53.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:54.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:54.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:54.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:54.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:55.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:55.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:55.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:55.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:56.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:56.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:56.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:56.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:57.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:57.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:57.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:57.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:58.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:58.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:58.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:58.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:57:59.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:59.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:57:59.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:57:59.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:00.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:00.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:00.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:00.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:01.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:01.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:01.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:01.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:02.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:02.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:02.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:02.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:03.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:03.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:03.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:03.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:04.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:04.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:04.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:04.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:05.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:05.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:05.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:05.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:06.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:06.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:06.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:06.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:07.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:07.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:07.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:07.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:08.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:08.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:08.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:08.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:09.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:09.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:09.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:09.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:10.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:10.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:10.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:10.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:11.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:11.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:11.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:11.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:12.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:12.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:12.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:12.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:13.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:13.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:13.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:13.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:14.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:14.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:14.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:14.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:15.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:15.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:15.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:15.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:16.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:16.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:16.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:16.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:17.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:17.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:17.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:17.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:18.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:18.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:18.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:18.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:19.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:19.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:19.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:19.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:20.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:20.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:20.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:20.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:21.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:21.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:21.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:21.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:22.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:22.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:22.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:22.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:23.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:23.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:23.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:23.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:24.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:24.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:24.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:24.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:25.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:25.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:25.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:25.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:26.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:26.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:26.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:26.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:27.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:27.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:27.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:27.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:28.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:28.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:28.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:28.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:29.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:29.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:29.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:29.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:30.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:30.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:30.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:30.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:31.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:31.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:31.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:31.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:32.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:32.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:32.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:32.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:33.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:33.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:33.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:33.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:34.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:34.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:34.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:34.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:35.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:35.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:35.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:35.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:36.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:36.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:36.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:36.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:37.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:37.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:37.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:37.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:38.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:38.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:38.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:38.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:39.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:39.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:39.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:39.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:40.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:40.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:40.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:40.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:41.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:41.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:41.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:41.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:42.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:42.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:42.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:42.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:43.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:43.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:43.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:43.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:44.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:44.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:44.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:44.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:45.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:45.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:45.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:45.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:46.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:46.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:46.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:46.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:47.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:47.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:47.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:47.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:48.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:48.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:48.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:48.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:49.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:49.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:49.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:49.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:50.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:50.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:50.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:50.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:51.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:51.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:51.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:51.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:52.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:52.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:52.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:52.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:53.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:53.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:53.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:53.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:54.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:54.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:54.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:54.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:55.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:55.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:55.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:55.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:56.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:56.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:56.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:56.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:57.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:57.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:57.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:57.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:58.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:58.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:58.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:58.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:58:59.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:59.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:58:59.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:58:59.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:00.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:00.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:00.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:00.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:01.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:01.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:01.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:01.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:02.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:02.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:02.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:02.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:03.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:03.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:03.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:03.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:04.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:04.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:04.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:04.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:05.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:05.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:05.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:05.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:06.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:06.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:06.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:06.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:07.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:07.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:07.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:07.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:08.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:08.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:08.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:08.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:09.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:09.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:09.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:09.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:10.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:10.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:10.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:10.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:11.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:11.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:11.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:11.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:12.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:12.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:12.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:12.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:13.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:13.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:13.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:13.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:14.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:14.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:14.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:14.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:15.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:15.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:15.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:15.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:16.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:16.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:16.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:16.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:17.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:17.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:17.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:17.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:18.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:18.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:18.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:18.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:19.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:19.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:19.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:19.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:20.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:20.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:20.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:20.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:21.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:21.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:21.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:21.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:22.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:22.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:22.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:22.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:23.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:23.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:23.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:23.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:24.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:24.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:24.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:24.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:25.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:25.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:25.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:25.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:26.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:26.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:26.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:26.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:27.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:27.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:27.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:27.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:28.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:28.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:28.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:28.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:29.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:29.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:29.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:29.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:30.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:30.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:30.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:30.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:31.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:31.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:31.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:31.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:32.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:32.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:32.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:32.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:33.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:33.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:33.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:33.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:34.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:34.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:34.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:34.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:35.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:35.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:35.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:35.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:36.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:36.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:36.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:36.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:37.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:37.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:37.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:37.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:38.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:38.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:38.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:38.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:39.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:39.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:39.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:39.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:40.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:40.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:40.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:40.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:41.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:41.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:41.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:41.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:42.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:42.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:42.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:42.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:43.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:43.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:43.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:43.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:44.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:44.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:44.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:44.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:45.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:45.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:45.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:45.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:46.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:46.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:46.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:46.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:47.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:47.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:47.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:47.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:48.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:48.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:48.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:48.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:49.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:49.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:49.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:49.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:50.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:50.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:50.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:50.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:51.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:51.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:51.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:51.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:52.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:52.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:52.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:52.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:53.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:53.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:53.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:53.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:54.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:54.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:54.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:54.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:55.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:55.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:55.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:55.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:56.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:56.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:56.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:56.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:57.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:57.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:57.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:57.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:58.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:58.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:58.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:58.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T09:59:59.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:59.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T09:59:59.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T09:59:59.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:00.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:00.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:00.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:00.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:01.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:01.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:01.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:01.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:02.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:02.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:02.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:02.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:03.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:03.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:03.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:03.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:04.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:04.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:04.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:04.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:05.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:05.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:05.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:05.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:06.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:06.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:06.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:06.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:07.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:07.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:07.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:07.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:08.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:08.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:08.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:08.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:09.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:09.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:09.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:09.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:10.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:10.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:10.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:10.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:11.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:11.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:11.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:11.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:12.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:12.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:12.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:12.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:13.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:13.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:13.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:13.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:14.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:14.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:14.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:14.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:15.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:15.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:15.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:15.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:16.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:16.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:16.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:16.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:17.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:17.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:17.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:17.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:18.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:18.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:18.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:18.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:19.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:19.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:19.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:19.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:20.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:20.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:20.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:20.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:21.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:21.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:21.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:21.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:22.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:22.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:23.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:23.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:23.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:23.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:24.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:24.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:24.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:24.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:25.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:25.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:25.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:25.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:26.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:26.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:26.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:26.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:27.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:27.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:27.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:27.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:28.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:28.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:28.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:28.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:29.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:29.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:29.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:29.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:30.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:30.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:30.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:31.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:31.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:31.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:31.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:32.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:32.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:32.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:32.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:33.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:33.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:33.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:33.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:34.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:34.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:34.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:34.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:35.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:35.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:35.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:35.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:36.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:36.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:36.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:36.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:37.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:37.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:37.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:37.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:38.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:38.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:38.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:38.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:39.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:39.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:39.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:39.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:40.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:40.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:40.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:40.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:41.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:41.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:41.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:41.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:42.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:42.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:42.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:42.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:43.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:43.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:43.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:43.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:44.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:44.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:44.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:44.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:45.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:45.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:45.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:45.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:47.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:47.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:47.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:47.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:48.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:48.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:48.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:48.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:49.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:49.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:49.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:49.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:50.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:50.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:50.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:50.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:51.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:51.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:51.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:51.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:52.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:52.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:52.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:52.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:53.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:53.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:53.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:53.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:54.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:54.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:54.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:54.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:55.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:55.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:55.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:55.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:56.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:56.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:56.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:56.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:57.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:57.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:57.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:57.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:58.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:58.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:58.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:58.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:00:59.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:59.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:00:59.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:00:59.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:00.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:00.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:00.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:00.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:01.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:01.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:01.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:01.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:02.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:02.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:02.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:02.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:03.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:03.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:03.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:03.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:04.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:04.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:04.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:04.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:05.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:05.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:05.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:05.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:06.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:06.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:06.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:06.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:07.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:07.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:07.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:07.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:08.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:08.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:08.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:08.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:09.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:09.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:09.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:09.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:10.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:10.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:10.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:10.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:11.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:11.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:11.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:11.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:12.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:12.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:12.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:12.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:13.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:13.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:13.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:13.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:14.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:14.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:14.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:14.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:15.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:15.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:15.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:15.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:16.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:16.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:16.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:16.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:17.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:17.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:17.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:17.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:18.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:18.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:18.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:18.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:19.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:19.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:19.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:19.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:20.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:20.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:20.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:20.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:21.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:21.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:21.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:21.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:22.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:22.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:22.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:22.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:23.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:23.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:23.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:23.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:24.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:24.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:24.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:24.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:25.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:25.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:25.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:25.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:26.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:26.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:26.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:26.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:27.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:27.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:27.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:27.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:28.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:28.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:28.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:28.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:29.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:29.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:29.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:29.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:30.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:30.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:30.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:30.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:31.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:31.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:31.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:31.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:32.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:32.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:32.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:32.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:33.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:33.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:33.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:33.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:34.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:34.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:34.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:34.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:35.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:35.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:35.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:35.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:36.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:36.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:36.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:36.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:37.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:37.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:37.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:37.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:38.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:38.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:38.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:38.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:39.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:39.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:39.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:39.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:40.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:40.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:40.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:40.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:41.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:41.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:41.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:41.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:42.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:42.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:42.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:42.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:43.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:43.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:43.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:43.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:44.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:44.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:44.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:44.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:45.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:45.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:45.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:45.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:46.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:46.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:46.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:46.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:47.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:47.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:47.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:47.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:48.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:48.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:48.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:48.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:49.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:49.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:49.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:49.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:50.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:50.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:50.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:50.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:51.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:51.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:51.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:51.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:52.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:52.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:52.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:52.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:53.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:53.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:53.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:53.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:54.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:54.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:54.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:54.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:55.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:55.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:55.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:55.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:56.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:56.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:56.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:56.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:57.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:57.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:57.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:57.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:58.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:58.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:58.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:58.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:01:59.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:59.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:01:59.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:01:59.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:00.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:00.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:00.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:00.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:01.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:01.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:01.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:01.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:02.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:02.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:02.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:02.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:03.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:03.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:03.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:03.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:04.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:04.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:04.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:04.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:05.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:05.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:05.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:05.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:06.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:06.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:06.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:06.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:07.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:07.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:07.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:07.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:08.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:08.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:08.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:08.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:09.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:09.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:09.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:09.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:10.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:10.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:10.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:10.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:11.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:11.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:11.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:11.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:12.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:12.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:12.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:12.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:13.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:13.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:13.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:13.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:14.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:14.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:14.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:14.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:14.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:14.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:14.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:14.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:15.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:15.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:15.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:15.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:16.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:16.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:16.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:16.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:17.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:17.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:17.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:17.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:18.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:18.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:18.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:18.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:19.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:19.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:19.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:19.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:20.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:20.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:20.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:20.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:21.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:21.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:21.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:21.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:22.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:22.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:22.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:22.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:23.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:23.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:23.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:23.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:24.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:24.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:24.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:24.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:25.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:25.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:25.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:25.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:26.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:26.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:26.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:26.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:27.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:27.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:27.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:27.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:28.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:28.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:28.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:28.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:29.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:29.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:29.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:29.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:30.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:30.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:30.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:30.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:31.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:31.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:31.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:31.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:32.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:32.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:32.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:32.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:33.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:33.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:33.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:33.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:34.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:34.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:34.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:34.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:35.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:35.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:35.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:35.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:36.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:36.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:36.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:36.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:37.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:37.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:37.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:37.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:38.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:38.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:38.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:38.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:39.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:39.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:39.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:39.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:40.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:40.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:40.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:40.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:41.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:41.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:41.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:41.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:42.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:42.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:42.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:42.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:43.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:43.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:43.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:43.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:44.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:44.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:44.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:44.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:45.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:45.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:45.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:45.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:46.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:46.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:46.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:46.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:47.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:47.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:47.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:47.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:48.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:48.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:48.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:48.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:49.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:49.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:49.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:49.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:50.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:50.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:50.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:50.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:51.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:51.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:51.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:51.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:52.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:52.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:52.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:52.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:53.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:53.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:53.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:53.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:54.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:54.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:54.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:54.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:55.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:55.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:55.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:55.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:56.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:56.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:56.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:56.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:57.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:57.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:58.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:58.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:58.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:58.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:02:59.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:59.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:02:59.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:02:59.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:00.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:00.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:00.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:00.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:01.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:01.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:01.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:01.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:02.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:02.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:02.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:02.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:03.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:03.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:03.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:03.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:04.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:04.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:04.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:04.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:05.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:05.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:05.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:05.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:06.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:06.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:06.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:06.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:07.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:07.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:07.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:07.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:08.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:08.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:08.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:08.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:09.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:09.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:09.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:09.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:10.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:10.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:10.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:10.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:11.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:11.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:11.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:11.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:12.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:12.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:12.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:12.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:13.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:13.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:13.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:13.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:14.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:14.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:14.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:14.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:15.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:15.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:15.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:15.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:16.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:16.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:16.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:16.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:17.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:17.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:17.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:17.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:18.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:18.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:18.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:18.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:19.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:19.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:19.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:19.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:20.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:20.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:20.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:20.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:21.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:21.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:21.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:21.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:22.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:22.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:22.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:22.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:23.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:23.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:23.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:23.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:24.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:24.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:24.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:24.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:25.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:25.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:25.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:25.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:26.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:26.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:26.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:26.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:27.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:27.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:27.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:27.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:28.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:28.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:28.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:28.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:29.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:29.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:29.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:29.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:30.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:30.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:30.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:30.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:31.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:31.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:31.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:31.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:32.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:32.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:32.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:32.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:33.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:33.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:33.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:33.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:34.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:34.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:34.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:34.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:35.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:35.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:35.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:35.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:36.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:36.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:36.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:36.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:37.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:37.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:37.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:37.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:38.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:38.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:38.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:38.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:39.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:39.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:39.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:39.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:40.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:40.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:40.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:40.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:41.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:41.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:41.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:41.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:42.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:42.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:42.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:42.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:43.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:43.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:43.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:43.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:44.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:44.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:44.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:44.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:45.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:45.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:45.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:45.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:46.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:46.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:46.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:46.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:47.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:47.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:47.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:47.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:48.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:48.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:48.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:48.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:49.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:49.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:49.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:49.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:50.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:50.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:50.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:50.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:51.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:51.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:51.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:51.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:52.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:52.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:52.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:52.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:53.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:53.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:53.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:53.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:54.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:54.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:54.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:54.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:55.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:55.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:55.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:55.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:56.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:56.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:56.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:56.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:57.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:57.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:57.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:57.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:58.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:58.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:58.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:58.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:03:59.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:59.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T09:53:28.342563+0000 (oldest deadline 2019-10-23T09:53:48.342563+0000) 2019-10-23T10:03:59.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:03:59.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:00.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:00.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:01.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:01.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:02.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:02.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:03.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:03.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:04.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:04.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:05.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:05.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:06.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:06.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:07.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:07.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:08.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:08.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:09.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:09.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:10.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:10.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:11.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:11.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:12.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:12.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:13.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:13.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:14.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:14.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:15.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:15.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:16.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:16.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:17.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:17.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:18.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:18.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:19.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:19.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:20.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:20.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:21.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:21.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:22.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:22.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:23.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:23.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:23.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:23.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:24.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:24.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:24.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:24.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:25.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:25.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:25.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:25.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:26.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:26.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:26.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:26.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:27.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:27.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:27.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:27.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:28.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:28.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:28.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:28.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:29.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:29.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:29.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:29.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:30.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:30.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:30.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:30.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:31.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:31.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:31.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:31.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:32.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:32.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:32.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:32.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:33.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:33.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:33.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:33.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:34.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:34.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:34.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:34.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:35.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:35.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:35.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:35.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:36.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:36.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:36.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:36.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:37.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:37.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:37.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:37.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:38.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:38.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:38.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:38.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:39.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:39.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:39.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:39.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:40.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:40.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:40.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:40.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:41.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:41.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:41.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:41.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:42.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:42.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:42.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:42.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:43.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:43.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:43.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:43.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:44.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:44.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:44.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:44.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:45.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:45.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:45.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:45.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:46.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:46.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:46.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:46.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:47.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:47.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:47.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:47.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:48.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:48.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:48.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:48.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:49.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:49.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:49.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:49.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:50.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:50.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:50.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:50.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:51.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:51.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:51.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:51.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:52.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:52.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:52.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:52.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:53.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:53.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:53.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:53.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:54.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:54.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:54.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:54.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:55.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:55.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:55.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:55.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:56.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:56.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:56.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:56.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:57.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:57.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:57.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:57.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:58.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:58.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:58.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:58.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:04:59.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:59.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:04:59.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:04:59.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:00.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:00.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:00.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:00.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:01.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:01.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:01.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:01.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:02.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:02.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:02.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:02.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:03.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:03.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:03.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:03.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:04.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:04.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:04.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:04.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:05.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:05.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:05.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:05.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:06.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:06.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:06.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:06.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:07.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:07.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:07.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:07.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:08.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:08.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:08.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:08.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:09.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:09.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:09.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:09.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:10.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:10.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:11.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:11.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:11.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:11.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:12.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:12.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:12.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:12.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:13.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:13.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:13.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:13.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:14.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:14.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:14.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:14.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:15.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:15.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:15.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:15.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:16.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:16.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:16.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:16.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:17.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:17.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:17.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:17.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:18.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:18.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:18.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:18.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:19.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:19.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:19.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:19.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:20.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:20.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:20.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:20.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:21.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:21.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:21.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:21.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:22.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:22.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:22.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:22.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:23.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:23.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:23.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:24.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:24.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:24.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:24.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:25.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:25.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:25.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:25.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:26.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:26.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:26.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:26.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:27.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:27.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:27.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:27.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:28.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:28.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:28.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:28.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:29.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:29.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:29.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:29.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:30.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:30.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:30.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:30.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:31.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:31.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:31.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:31.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:32.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:32.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:32.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:32.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:33.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:33.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:33.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:33.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:34.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:34.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:34.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:34.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:35.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:35.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:35.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:35.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:36.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:36.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:36.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:36.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:37.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:37.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:37.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:37.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:38.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:38.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:38.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:38.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:39.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:39.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:39.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:39.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:40.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:40.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:40.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:40.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:41.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:41.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:41.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:41.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:42.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:42.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:42.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:42.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:43.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:43.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:43.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:43.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:44.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:44.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:44.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:44.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:45.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:45.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:45.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:45.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:46.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:46.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:46.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:46.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:47.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:47.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:47.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:47.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:48.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:48.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:48.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:48.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:49.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:49.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:49.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:49.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:50.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:50.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:50.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:50.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:51.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:51.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:51.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:51.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:52.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:52.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:52.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:52.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:53.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:53.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:53.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:53.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:54.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:54.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:54.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:54.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:55.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:55.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:55.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:55.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:56.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:56.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:56.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:56.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:57.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:57.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:57.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:57.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:58.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:58.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:58.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:58.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:05:59.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:59.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:05:59.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:05:59.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:00.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:00.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:00.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:00.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:01.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:01.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:01.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:01.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:02.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:02.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:02.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:02.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:03.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:03.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:03.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:03.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:04.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:04.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:04.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:04.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:05.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:05.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:05.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:05.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:06.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:06.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:06.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:06.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:07.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:07.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:07.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:07.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:08.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:08.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:08.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:08.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:09.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:09.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:09.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:09.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:10.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:10.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:10.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:10.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:11.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:11.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:11.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:11.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:12.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:12.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:12.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:12.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:13.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:13.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:13.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:13.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:14.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:14.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:14.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:14.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:15.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:15.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:15.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:15.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:16.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:16.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:16.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:16.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:17.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:17.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:17.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:17.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:18.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:18.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:18.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:18.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:19.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:19.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:19.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:19.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:20.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:20.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:20.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:20.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:21.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:21.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:21.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:21.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:22.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:22.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:22.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:22.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:23.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:23.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:23.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:23.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:24.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:24.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:24.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:24.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:25.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:25.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:25.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:25.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:26.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:26.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:26.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:26.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:27.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:27.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:27.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:27.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:28.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:28.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:28.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:28.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:29.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:29.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:29.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:29.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:30.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:30.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:30.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:30.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:31.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:31.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:31.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:31.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:32.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:32.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:32.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:32.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:33.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:33.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:33.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:33.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:34.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:34.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:34.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:34.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:35.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:35.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:35.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:35.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:36.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:36.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:36.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:36.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:37.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:37.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:37.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:37.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:38.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:38.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:38.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:38.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:39.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:39.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:39.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:39.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:40.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:40.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:40.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:40.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:41.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:41.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:41.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:41.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:42.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:42.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:42.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:42.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:43.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:43.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:43.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:43.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:44.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:44.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:44.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:44.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:45.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:45.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:45.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:45.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:46.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:46.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:46.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:46.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:47.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:47.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:47.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:47.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:48.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:48.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:48.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:48.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:49.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:49.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:49.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:49.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:50.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:50.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:50.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:50.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:51.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:51.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:51.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:51.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:52.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:52.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:52.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:52.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:53.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:53.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:53.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:53.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:54.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:54.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:54.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:54.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:55.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:55.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:55.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:55.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:56.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:56.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:56.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:56.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:57.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:57.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:57.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:57.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:58.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:58.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:58.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:58.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:06:59.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:59.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:06:59.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:06:59.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:00.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:00.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:00.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:00.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:01.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:01.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:01.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:01.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:02.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:02.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:02.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:02.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:03.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:03.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:03.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:03.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:04.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:04.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:04.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:04.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:05.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:05.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:05.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:05.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:06.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:06.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:06.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:06.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:07.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:07.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:07.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:07.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:08.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:08.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:08.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:08.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:09.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:09.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:09.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:09.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:10.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:10.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:10.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:10.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:11.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:11.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:11.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:11.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:12.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:12.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:12.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:12.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:13.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:13.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:13.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:13.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:14.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:14.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:14.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:14.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:15.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:15.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:15.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:15.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:16.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:16.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:16.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:16.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:17.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:17.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:17.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:17.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 60 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:18.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:18.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:18.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:18.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:19.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:19.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:19.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:19.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:20.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:20.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:20.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:20.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:21.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:21.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:21.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:21.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:22.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:22.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:22.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:22.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:23.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:23.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:23.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:23.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:24.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:24.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:24.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:24.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:25.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:25.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:25.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:25.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:26.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:26.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:26.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:26.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:27.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:27.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:27.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:27.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:28.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:28.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:28.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:28.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:29.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:29.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:29.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:29.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:30.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:30.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:30.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:30.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:31.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:31.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:31.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:31.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:32.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:32.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:32.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:32.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:33.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:33.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:33.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:33.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:34.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:34.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:34.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:34.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:35.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:35.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:35.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:35.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:36.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:36.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:36.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:36.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:37.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:37.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:37.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:37.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:38.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:38.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:38.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:38.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:39.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:39.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:39.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:39.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:40.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:40.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:40.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:40.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:41.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:41.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:41.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:42.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:42.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:42.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:42.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:43.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:43.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:43.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:43.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:44.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:44.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:44.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:44.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:45.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:45.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:45.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:45.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:46.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:46.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:46.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:46.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:47.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:47.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:47.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:47.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:48.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:48.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:48.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:48.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:49.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:49.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:49.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:49.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:50.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:50.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:50.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:50.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:51.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:51.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:51.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:51.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:52.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:52.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:52.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:52.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:53.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:53.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:53.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:53.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:54.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:54.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:54.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:54.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:55.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:55.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:55.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:55.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:56.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:56.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:56.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:56.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:57.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:57.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:57.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:57.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:58.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:58.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:58.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:58.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:07:59.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:59.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:07:59.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:07:59.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:00.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:00.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:00.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:00.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:01.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:01.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:01.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:01.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:02.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:02.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:02.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:02.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:03.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:03.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:03.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:03.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:04.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:04.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:04.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:04.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:05.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:05.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:05.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:05.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:06.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:06.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:06.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:06.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:07.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:07.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:07.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:07.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:08.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:08.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:08.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:08.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:09.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:09.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:09.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:09.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:10.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:10.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:10.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:10.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:11.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:11.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:11.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:11.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:12.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:12.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:12.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:12.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:13.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:13.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:13.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:13.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:14.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:14.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:14.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:14.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:15.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:15.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:15.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:15.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:16.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:16.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:16.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:16.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:17.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:17.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:17.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:17.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:18.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:18.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:18.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:18.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:19.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:19.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:19.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:19.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:20.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:20.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:20.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:20.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:21.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:21.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:21.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:21.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:22.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:22.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:22.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:22.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:23.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:23.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:23.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:23.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:24.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:24.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:24.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:24.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:25.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:25.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:25.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:25.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:26.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:26.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:26.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:26.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:27.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:27.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:27.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:27.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:28.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:28.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:28.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:28.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:29.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:29.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:29.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:29.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:30.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:30.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:30.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:30.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:31.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:31.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:31.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:31.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:32.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:32.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:32.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:32.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:33.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:33.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:33.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:33.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:34.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:34.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:34.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:34.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:35.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:35.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:35.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:35.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:36.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:36.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:36.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:36.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:37.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:37.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:37.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:37.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:38.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:38.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:38.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:38.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:39.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:39.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:39.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:39.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:40.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:40.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:40.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:40.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:42.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:41.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:42.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:41.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:42.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:42.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:42.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:42.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:43.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:43.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:43.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:43.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:44.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:44.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:44.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:44.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:45.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:45.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:45.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:45.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:46.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:46.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:46.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:46.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:47.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:47.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:47.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:47.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:48.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:48.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:48.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:48.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:49.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:49.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:49.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:49.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:50.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:50.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:50.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:50.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:51.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:51.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:51.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:51.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:52.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:52.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:52.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:52.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:53.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:53.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:53.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:53.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:54.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:54.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:54.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:54.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:55.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:55.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:55.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:55.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:56.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:56.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:56.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:56.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:57.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:57.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:57.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:57.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:58.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:58.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:58.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:58.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:08:59.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:59.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:08:59.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:08:59.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:00.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:00.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:00.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:00.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:01.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:01.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:01.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:01.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:02.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:02.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:02.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:02.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:03.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:03.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:03.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:03.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:04.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:04.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:04.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:04.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:05.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:05.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:05.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:05.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:06.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:06.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:06.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:06.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:07.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:07.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:07.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:07.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:08.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:08.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:08.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:08.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:09.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:09.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:09.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:09.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:10.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:10.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:10.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:10.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:11.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:11.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:11.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:11.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:12.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:12.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:12.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:12.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:13.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:13.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:13.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:13.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:14.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:14.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:14.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:14.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:15.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:15.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:15.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:15.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:16.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:16.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:16.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:16.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:17.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:17.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:17.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:17.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:18.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:18.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:18.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:18.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:19.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:19.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:19.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:19.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:20.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:20.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:20.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:20.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:21.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:21.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:22.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:22.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:22.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:22.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:23.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:23.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:23.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:23.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:24.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:24.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:24.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:24.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:25.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:25.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:25.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:25.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:26.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:26.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:26.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:26.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:27.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:27.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:27.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:27.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:28.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:28.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:28.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:28.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:29.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:29.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:29.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:29.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:30.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:30.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:30.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:30.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:31.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:31.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:31.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:31.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:32.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:32.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:32.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:32.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:33.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:33.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:33.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:33.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:34.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:34.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:34.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:34.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:35.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:35.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:35.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:35.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:36.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:36.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:36.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:36.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:37.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:37.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:37.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:37.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:38.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:38.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:38.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:38.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:39.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:39.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:39.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:39.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:40.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:40.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:40.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:40.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:41.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:41.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:41.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:41.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:42.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:42.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:42.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:42.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:43.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:43.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:43.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:43.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:44.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:44.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:44.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:45.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:45.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:45.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:45.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:46.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:46.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:46.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:46.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:47.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:47.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:47.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:47.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:48.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:48.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:48.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:48.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:49.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:49.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:49.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:49.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:50.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:50.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:50.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:50.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:51.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:51.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:51.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:51.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:52.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:52.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:52.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:52.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:53.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:53.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:53.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:53.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:54.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:54.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:54.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:54.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:55.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:55.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:55.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:55.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:56.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:56.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:56.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:56.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:57.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:57.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:57.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:57.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:58.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:58.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:58.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:58.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:09:59.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:59.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:09:59.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:09:59.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:00.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:00.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:00.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:00.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:01.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:01.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:01.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:01.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:02.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:02.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:02.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:02.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:03.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:03.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:03.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:03.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:04.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:04.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:04.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:04.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:05.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:05.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:05.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:05.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:06.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:06.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:06.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:06.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:07.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:07.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:07.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:07.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:08.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:08.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:08.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:08.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:09.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:09.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:09.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:09.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:10.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:10.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:10.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:10.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:11.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:11.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:11.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:11.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:12.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:12.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:12.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:12.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:13.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:13.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:13.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:13.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:14.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:14.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:14.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:14.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:15.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:15.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:15.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:15.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:16.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:16.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:16.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:16.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:17.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:17.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:17.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:17.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:18.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:18.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:18.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:18.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:19.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:19.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:19.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:19.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:20.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:20.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:20.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:20.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:21.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:21.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:21.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:21.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:22.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:22.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:22.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:22.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:23.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:23.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:23.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:23.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:24.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:24.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:24.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:24.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:25.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:25.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:25.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:25.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:26.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:26.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:26.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:26.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:27.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:27.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:27.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:27.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:28.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:28.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:28.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:28.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:29.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:29.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:29.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:29.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:30.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:30.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:31.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:31.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:31.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:31.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:32.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:32.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:32.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:32.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:33.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:33.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:33.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:33.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:34.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:34.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:34.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:34.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:35.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:35.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:35.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:35.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:36.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:36.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:36.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:36.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:38.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:38.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:38.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:38.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:39.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:39.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:39.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:39.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:40.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:40.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:41.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:41.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:41.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:41.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:42.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:42.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:42.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:42.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:43.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:43.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:43.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:43.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:44.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:44.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:44.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:44.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:45.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:45.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:45.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:45.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:45.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:45.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:45.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:45.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:46.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:46.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:46.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:46.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:48.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:47.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:48.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:47.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:49.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:49.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:49.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:49.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:50.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:50.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:50.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:50.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:50.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:50.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:50.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:50.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:51.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:51.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:51.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:51.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:53.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:52.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:53.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:52.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:54.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:54.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:54.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:54.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:54.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:54.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:54.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:54.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:55.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:55.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:55.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:55.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:56.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:56.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:56.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:56.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:57.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:57.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:57.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:57.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:10:59.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:59.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:10:59.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:10:59.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:00.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:00.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:00.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:00.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:01.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:01.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:01.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:01.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:02.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:02.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:02.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:02.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:03.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:03.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:03.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:03.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:04.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:04.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:04.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:04.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:05.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:05.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:06.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:05.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:06.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:06.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:06.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:06.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:07.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:07.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:07.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:07.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:08.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:08.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:08.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:08.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:09.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:09.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:09.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:09.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:10.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:10.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:10.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:10.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:11.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:11.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:11.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:11.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:12.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:12.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:12.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:12.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:13.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:13.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:13.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:13.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:14.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:14.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:14.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:14.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:15.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:15.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:15.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:15.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:16.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:16.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:16.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:16.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:17.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:17.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:17.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:17.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:18.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:18.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:18.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:18.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:19.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:19.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:19.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:19.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:20.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:20.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:20.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:20.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:21.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:21.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:21.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:21.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:22.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:22.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:22.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:22.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:23.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:23.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:23.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:23.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:24.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:24.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:24.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:24.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:25.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:25.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:25.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:25.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:26.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:26.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:26.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:26.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:27.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:27.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:27.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:27.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:28.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:28.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:28.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:28.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:29.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:29.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:29.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:29.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:30.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:30.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:30.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:30.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:31.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:31.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:31.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:31.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:32.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:32.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:32.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:32.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:33.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:33.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:33.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:33.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:34.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:34.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:34.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:34.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:35.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:35.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:35.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:35.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:36.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:36.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:36.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:36.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:37.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:37.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:37.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:37.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:38.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:38.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:38.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:38.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:39.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:39.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:39.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:39.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:40.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:40.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:40.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:40.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:41.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:41.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:41.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:41.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:42.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:42.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:42.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:42.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:43.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:43.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:43.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:43.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:44.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:44.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:44.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:44.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:45.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:45.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:45.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:45.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:46.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:46.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:46.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:46.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:47.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:47.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:47.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:47.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:48.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:48.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:48.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:48.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:49.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:49.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:49.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:49.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:50.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:50.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:50.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:50.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:51.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:51.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:51.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:51.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:52.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:52.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:52.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:52.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:53.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:53.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:53.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:53.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:54.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:54.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:54.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:54.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:55.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:55.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:55.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:55.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:56.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:56.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:56.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:56.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:57.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:57.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:57.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:57.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:58.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:58.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:58.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:58.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:11:59.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:59.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:11:59.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:11:59.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:00.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:00.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:00.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:00.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:01.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:01.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:01.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:01.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:02.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:02.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:02.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:02.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:03.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:03.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:03.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:03.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:04.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:04.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:04.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:04.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:05.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:05.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:05.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:05.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:06.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:06.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:06.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:06.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:07.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:07.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:07.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:07.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:08.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:08.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:08.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:08.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:09.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:09.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:09.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:09.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:10.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:10.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:10.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:10.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:11.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:11.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:11.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:11.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:12.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:12.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:12.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:12.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:13.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:13.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:13.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:13.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:14.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:14.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:14.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:14.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:15.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:15.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:15.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:15.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:16.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:16.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:16.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:16.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:17.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:17.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:17.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:17.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:18.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:18.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:18.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:18.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:19.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:19.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:19.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:19.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:20.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:20.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:20.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:20.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:21.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:21.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:21.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:21.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:22.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:22.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:22.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:22.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:23.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:23.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:23.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:23.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:24.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:24.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:24.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:24.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:25.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:25.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:25.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:25.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:26.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:26.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:26.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:26.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:27.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:27.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:27.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:27.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:28.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:28.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:28.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:28.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:29.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:29.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:29.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:29.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:30.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:30.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:30.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:30.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:31.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:31.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:31.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:31.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:32.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:32.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:32.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:32.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:33.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:33.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:33.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:33.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:34.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:34.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:34.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:34.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:35.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:35.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:35.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:35.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:36.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:36.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:36.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:36.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:37.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:37.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:37.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:37.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:38.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:38.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:38.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:38.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:39.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:39.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:39.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:39.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:40.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:40.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:40.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:40.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:41.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:41.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:41.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:41.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:42.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:42.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:42.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:42.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:43.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:43.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:43.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:43.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:44.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:44.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:44.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:44.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:45.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:45.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:46.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:46.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:46.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:46.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:47.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:47.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:47.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:47.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:48.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:48.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:48.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:48.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:49.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:49.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:49.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:49.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:50.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:50.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:50.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:50.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:51.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:51.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:51.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:51.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:52.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:52.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:52.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:52.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:53.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:53.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:53.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:53.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:54.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:54.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:54.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:54.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:55.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:55.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:55.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:55.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:56.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:56.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:56.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:56.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:57.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:57.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:57.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:57.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:58.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:58.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:58.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:58.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:12:59.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:59.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:12:59.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:12:59.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:00.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:00.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:00.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:00.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:01.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:01.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:01.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:01.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:02.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:02.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:02.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:02.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:03.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:03.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:03.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:03.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:04.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:04.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:04.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:04.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:05.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:05.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:05.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:05.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:06.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:06.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:06.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:06.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:07.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:07.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:07.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:07.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:08.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:08.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:08.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:08.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:09.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:09.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:09.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:09.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:10.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:10.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:10.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:10.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:11.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:11.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:11.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:11.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:12.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:12.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:12.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:12.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:13.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:13.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:13.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:13.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:14.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:14.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:14.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:14.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:15.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:15.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:15.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:15.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:16.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:16.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:16.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:16.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:17.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:17.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:17.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:17.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:18.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:18.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:18.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:18.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:19.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:19.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:19.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:19.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:20.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:20.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:20.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:20.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:21.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:21.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:21.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:21.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:22.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:22.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:22.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:22.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:23.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:23.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:23.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:23.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:24.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:24.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:24.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:24.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:25.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:25.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:25.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:25.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:26.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:26.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:26.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:26.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:27.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:27.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:27.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:27.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:28.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:28.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:28.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:28.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:29.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:29.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:29.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:29.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:30.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:30.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:30.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:30.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:31.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:31.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:31.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:31.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:32.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:32.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:32.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:32.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:33.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:33.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:33.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:33.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:34.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:34.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:34.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:34.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:35.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:35.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:35.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:35.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:36.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:36.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:36.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:36.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:37.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:37.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:37.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:37.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:38.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:38.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:38.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:38.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:39.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:39.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:39.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:39.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:40.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:40.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:40.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:40.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:41.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:41.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:41.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:41.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:42.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:42.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:42.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:42.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:43.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:43.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:43.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:43.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:44.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:44.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:44.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:44.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:45.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:45.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:45.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:45.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:46.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:46.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:46.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:46.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:47.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:47.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:47.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:47.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:48.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:48.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:48.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:48.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:49.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:49.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:49.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:49.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:50.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:50.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:50.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:50.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:51.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:51.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:51.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:51.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:52.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:52.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:52.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:52.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:53.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:53.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:53.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:53.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:54.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:54.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:54.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:54.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:55.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:55.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:55.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:55.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:56.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:56.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:56.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:56.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:57.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:57.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:57.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:57.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:58.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:58.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:58.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:58.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:13:59.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:59.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:13:59.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:13:59.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:00.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:00.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:00.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:00.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:01.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:01.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:01.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:01.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:02.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:02.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:02.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:02.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:03.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:03.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:03.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:03.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:04.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:04.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:04.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:04.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:05.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:05.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:05.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:05.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:06.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:06.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:06.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:06.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:07.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:07.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:07.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:07.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:08.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:08.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:08.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:08.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:09.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:09.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:09.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:09.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:10.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:10.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:10.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:10.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:11.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:11.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:11.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:11.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:12.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:12.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:12.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:12.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:13.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:13.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:13.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:13.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:14.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:14.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:14.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:14.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:15.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:15.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:15.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:15.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:16.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:16.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:16.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:16.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:17.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:17.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:17.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:17.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:18.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:18.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:18.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:18.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:19.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:19.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:19.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:19.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:20.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:20.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:20.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:20.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:21.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:21.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:21.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:21.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:22.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:22.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:22.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:22.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:23.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:23.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:23.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:23.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:24.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:24.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:24.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:24.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:25.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:25.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:25.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:25.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:26.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:26.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:26.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:26.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:27.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:27.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:27.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:27.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:28.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:28.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:28.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:28.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:29.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:29.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:29.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:29.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:30.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:30.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:30.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:30.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:31.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:31.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:31.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:31.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:32.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:32.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:32.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:32.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:33.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:33.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:33.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:33.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:34.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:34.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:04:02.968035+0000 (oldest deadline 2019-10-23T10:04:22.968035+0000) 2019-10-23T10:14:34.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:34.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:35.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:35.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:36.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:36.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:37.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:37.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:38.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:38.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:39.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:39.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:40.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:40.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:41.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:41.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:42.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:42.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:43.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:43.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:44.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:44.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:45.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:45.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:46.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:46.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:47.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:47.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:48.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:48.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:49.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:49.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:50.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:50.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:51.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:51.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:52.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:52.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:53.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:53.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:54.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:54.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:55.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:55.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:56.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:56.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:14:56.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:56.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:57.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:57.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:14:57.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:57.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:58.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:58.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:14:58.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:58.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:14:59.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:59.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:14:59.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:14:59.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:00.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:00.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:00.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:00.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:01.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:01.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:01.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:01.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:02.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:02.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:02.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:02.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:03.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:03.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:03.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:03.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:04.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:04.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:04.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:04.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:05.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:05.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:05.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:05.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:06.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:06.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:06.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:06.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:07.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:07.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:07.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:07.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:08.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:08.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:08.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:08.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:09.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:09.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:09.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:09.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:10.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:10.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:10.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:10.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:11.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:11.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:11.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:11.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:12.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:12.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:12.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:12.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:13.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:13.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:13.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:13.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:14.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:14.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:14.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:14.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:15.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:15.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:15.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:15.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:16.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:16.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:16.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:16.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:17.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:17.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:17.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:17.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:18.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:18.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:18.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:18.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:19.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:19.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:19.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:19.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:20.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:20.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:20.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:20.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:21.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:21.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:21.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:21.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:22.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:22.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:22.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:22.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:23.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:23.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:23.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:23.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:24.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:24.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:24.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:24.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:25.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:25.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:25.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:25.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:26.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:26.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:26.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:26.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:27.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:27.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:27.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:27.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:28.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:28.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:28.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:28.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:29.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:29.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:29.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:29.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:30.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:30.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:30.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:30.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:31.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:31.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:31.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:31.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:32.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:32.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:32.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:32.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:33.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:33.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:33.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:33.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:34.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:34.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:34.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:34.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:35.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:35.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:35.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:35.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:36.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:36.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:36.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:36.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:36.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:36.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:36.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:36.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:37.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:37.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:37.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:37.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:38.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:38.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:38.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:38.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:39.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:39.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:39.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:39.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:40.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:40.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:40.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:40.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:41.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:41.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:41.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:41.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:42.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:42.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:42.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:42.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:43.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:43.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:43.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:43.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:44.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:44.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:44.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:44.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:45.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:45.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:45.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:45.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:46.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:46.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:46.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:46.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:47.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:47.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:47.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:47.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:48.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:48.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:48.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:48.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:49.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:49.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:49.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:49.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:51.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:51.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:51.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:51.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:52.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:52.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:52.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:52.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:53.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:53.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:53.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:53.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:54.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:54.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:54.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:54.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:55.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:55.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:55.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:55.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:56.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:56.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:56.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:56.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:57.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:57.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:57.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:57.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:58.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:58.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:58.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:58.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:15:59.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:59.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:15:59.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:15:59.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:00.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:00.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:00.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:00.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:01.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:01.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:01.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:01.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:02.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:02.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:02.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:02.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:03.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:03.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:03.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:03.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:04.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:04.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:04.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:04.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:05.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:05.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:05.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:05.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:06.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:06.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:06.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:06.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:07.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:07.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:07.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:07.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:08.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:08.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:08.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:08.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:09.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:09.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:09.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:09.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:10.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:10.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:10.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:10.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:11.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:11.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:11.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:11.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:12.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:12.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:12.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:12.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:13.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:13.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:13.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:13.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:14.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:14.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:14.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:14.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:15.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:15.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:15.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:15.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:16.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:16.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:16.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:16.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:17.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:17.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:17.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:17.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:18.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:18.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:18.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:18.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:19.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:19.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:19.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:19.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:20.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:20.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:20.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:20.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:21.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:21.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:21.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:21.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:22.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:22.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:22.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:22.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:23.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:23.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:23.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:23.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:24.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:24.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:24.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:24.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:25.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:25.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:25.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:25.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:26.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:26.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:26.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:26.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:27.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:27.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:27.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:27.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:28.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:28.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:28.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:28.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:29.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:29.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:29.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:29.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:30.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:30.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:30.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:30.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:31.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:31.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:31.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:31.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:32.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:32.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:32.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:32.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:33.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:33.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:33.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:33.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:34.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:34.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:34.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:34.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:35.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:35.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:35.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:35.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:36.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:36.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:36.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:36.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:37.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:37.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:37.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:37.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:38.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:38.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:38.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:38.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:39.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:39.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:39.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:39.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:40.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:40.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:40.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:40.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:41.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:41.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:41.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:41.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:42.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:42.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:42.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:42.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:43.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:43.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:43.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:43.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:44.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:44.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:44.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:44.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:45.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:45.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:45.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:45.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:46.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:46.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:46.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:46.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:47.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:47.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:47.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:47.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:48.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:48.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:48.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:48.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:49.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:49.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:49.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:49.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:50.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:50.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:50.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:50.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:51.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:51.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:51.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:51.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:52.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:52.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:52.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:52.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:53.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:53.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:53.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:53.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:54.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:54.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:54.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:54.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:55.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:55.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:55.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:55.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:56.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:56.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:56.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:56.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:57.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:57.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:57.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:57.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:58.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:58.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:58.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:58.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:16:59.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:59.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:16:59.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:16:59.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:00.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:00.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:00.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:00.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:01.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:01.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:01.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:01.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:02.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:02.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:02.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:02.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:03.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:03.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:03.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:03.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:04.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:04.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:04.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:04.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:05.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:05.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:05.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:05.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:06.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:06.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:06.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:06.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:07.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:07.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:07.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:07.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:08.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:08.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:08.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:08.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:09.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:09.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:09.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:09.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:10.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:10.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:10.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:10.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:11.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:11.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:11.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:11.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:12.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:12.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:12.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:12.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:13.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:13.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:13.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:13.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:14.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:14.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:14.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:14.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:15.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:15.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:15.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:15.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:16.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:16.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:16.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:16.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:17.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:17.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:17.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:17.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:18.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:18.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:18.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:18.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:19.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:19.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:19.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:19.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:20.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:20.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:20.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:20.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:21.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:21.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:21.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:21.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:22.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:22.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:22.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:22.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:23.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:23.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:23.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:23.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:24.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:24.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:24.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:24.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:25.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:25.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:25.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:25.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:26.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:26.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:26.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:26.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:27.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:27.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:27.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:27.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:28.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:28.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:28.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:28.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:29.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:29.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:29.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:29.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:30.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:30.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:30.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:30.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:31.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:31.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:31.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:31.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:32.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:32.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:32.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:32.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:33.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:33.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:33.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:33.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:34.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:34.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:34.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:34.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:35.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:35.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:35.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:35.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:36.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:36.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:36.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:36.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:37.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:37.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:37.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:37.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:38.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:38.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:38.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:38.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:39.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:39.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:39.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:39.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:40.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:40.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:40.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:40.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:41.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:41.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:41.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:41.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:42.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:42.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:42.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:42.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:43.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:43.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:43.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:43.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:44.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:44.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:44.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:44.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:45.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:45.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:45.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:45.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:46.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:46.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:46.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:46.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:47.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:47.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:47.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:47.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:48.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:48.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:48.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:48.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:49.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:49.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:49.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:49.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:50.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:50.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:50.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:50.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:51.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:51.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:51.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:51.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:52.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:52.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:52.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:52.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:53.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:53.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:53.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:53.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:54.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:54.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:54.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:54.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:55.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:55.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:55.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:55.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:56.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:56.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:56.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:56.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:57.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:57.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:57.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:57.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:58.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:58.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:58.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:58.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:17:59.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:59.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:17:59.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:17:59.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:00.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:00.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:00.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:00.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:01.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:01.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:02.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:02.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:02.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:02.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:03.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:03.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:03.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:03.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:04.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:04.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:04.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:04.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:05.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:05.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:05.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:05.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:06.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:06.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:06.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:06.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:07.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:07.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:07.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:07.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:08.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:08.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:08.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:08.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:09.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:09.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:09.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:09.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:10.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:10.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:10.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:10.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:11.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:11.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:11.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:11.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:12.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:12.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:12.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:12.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:13.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:13.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:13.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:13.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:14.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:14.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:14.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:14.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:15.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:15.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:15.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:15.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:16.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:16.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:16.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:16.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:17.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:17.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:17.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:17.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:18.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:18.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:18.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:18.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:19.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:19.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:19.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:19.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:20.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:20.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:20.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:20.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:21.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:21.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:21.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:21.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:22.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:22.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:22.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:22.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:23.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:23.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:23.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:23.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:24.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:24.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:24.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:24.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:25.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:25.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:25.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:25.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:26.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:26.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:26.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:26.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:27.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:27.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:27.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:27.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:28.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:28.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:28.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:28.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:29.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:29.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:29.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:29.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:30.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:30.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:30.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:30.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:31.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:31.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:31.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:31.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:32.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:32.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:32.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:32.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:33.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:33.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:33.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:33.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:34.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:34.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:34.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:34.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:35.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:35.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:35.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:35.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:36.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:36.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:36.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:36.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:37.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:37.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:37.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:37.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:38.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:38.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:38.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:38.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:39.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:39.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:39.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:39.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:40.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:40.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:40.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:40.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:41.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:41.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:41.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:41.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:42.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:42.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:42.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:42.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:43.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:43.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:43.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:43.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:44.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:44.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:44.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:44.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:45.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:45.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:45.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:45.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:46.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:46.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:46.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:46.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:47.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:47.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:47.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:47.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:48.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:48.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:48.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:48.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:49.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:49.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:49.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:49.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:50.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:50.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:50.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:50.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:51.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:51.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:51.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:51.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:52.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:52.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:52.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:52.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:53.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:53.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:53.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:53.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:54.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:54.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:54.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:54.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:55.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:55.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:55.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:55.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:56.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:56.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:56.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:56.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:57.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:57.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:57.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:57.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:58.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:58.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:58.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:58.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:18:59.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:59.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:18:59.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:18:59.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:00.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:00.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:00.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:00.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:01.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:01.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:01.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:01.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:02.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:02.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:02.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:02.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:03.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:03.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:03.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:03.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:04.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:04.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:04.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:04.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:05.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:05.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:05.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:05.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:06.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:06.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:06.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:06.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:07.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:07.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:07.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:07.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:08.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:08.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:08.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:08.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:09.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:09.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:09.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:09.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:10.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:10.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:10.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:10.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:11.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:11.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:11.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:11.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:12.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:12.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:12.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:12.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:13.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:13.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:13.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:13.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:14.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:13.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:14.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:13.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:14.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:14.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:14.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:14.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:15.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:15.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:15.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:15.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:17.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:17.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:17.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:17.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:18.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:18.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:18.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:18.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:19.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:19.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:19.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:19.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:20.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:20.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:20.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:20.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:21.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:21.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:21.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:21.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:22.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:22.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:22.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:22.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:23.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:23.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:23.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:23.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:24.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:24.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:24.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:24.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:25.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:25.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:25.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:25.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:26.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:26.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:26.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:26.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:27.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:27.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:27.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:27.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:28.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:28.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:28.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:28.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:29.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:29.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:29.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:29.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:30.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:30.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:30.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:30.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:31.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:31.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:31.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:31.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:32.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:32.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:32.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:32.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:33.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:33.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:33.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:33.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:34.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:34.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:34.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:34.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:35.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:35.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:35.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:35.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:36.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:36.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:36.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:36.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:37.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:37.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:37.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:37.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:38.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:38.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:38.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:38.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:39.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:39.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:39.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:39.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:40.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:40.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:40.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:40.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:41.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:41.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:41.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:41.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:42.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:42.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:42.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:42.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:43.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:43.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:43.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:43.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:44.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:44.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:44.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:44.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:45.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:45.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:45.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:45.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:46.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:46.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:46.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:46.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:47.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:47.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:47.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:47.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:48.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:48.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:48.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:48.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:49.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:49.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:49.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:49.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:50.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:50.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:50.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:50.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:51.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:51.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:51.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:51.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:52.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:52.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:52.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:52.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:52.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:52.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:52.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:52.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:54.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:54.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:54.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:54.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:55.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:54.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:55.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:54.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:55.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:55.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:55.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:55.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:56.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:56.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:56.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:56.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:58.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:58.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:58.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:58.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:58.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:58.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:58.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:58.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:19:59.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:59.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:19:59.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:19:59.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:00.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:00.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:00.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:00.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:01.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:01.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:01.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:01.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:02.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:02.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:02.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:02.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:03.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:03.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:03.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:03.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:04.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:04.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:04.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:04.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:05.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:05.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:05.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:05.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:06.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:06.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:06.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:06.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:07.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:07.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:07.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:07.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:08.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:08.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:08.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:08.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:09.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:09.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:09.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:09.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:10.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:10.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:10.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:10.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:11.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:11.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:11.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:11.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:12.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:12.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:12.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:12.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:13.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:13.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:13.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:13.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:14.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:14.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:14.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:14.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:15.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:15.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:15.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:15.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:16.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:16.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:16.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:16.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:17.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:17.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:17.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:17.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:18.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:18.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:18.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:18.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:19.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:19.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:19.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:19.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:20.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:20.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:20.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:20.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:21.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:21.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:21.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:21.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:22.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:22.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:22.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:22.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:23.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:23.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:23.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:23.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:24.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:24.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:24.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:24.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:25.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:25.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:25.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:25.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:26.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:26.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:26.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:26.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:27.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:27.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:27.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:27.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:28.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:28.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:28.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:28.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:29.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:29.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:29.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:29.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:30.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:30.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:30.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:30.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:32.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:32.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:32.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:32.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:32.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:32.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:32.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:32.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:34.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:34.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:34.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:34.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:34.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:34.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:34.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:34.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:35.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:35.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:35.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:35.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:37.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:37.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:37.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:37.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:38.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:38.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:38.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:38.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:39.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:39.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:39.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:39.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:40.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:40.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:40.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:40.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:41.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:41.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:41.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:41.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:42.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:42.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:42.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:42.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:43.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:43.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:43.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:43.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:44.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:44.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:44.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:44.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:45.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:45.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:45.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:45.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:46.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:46.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:46.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:46.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:47.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:47.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:47.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:47.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:48.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:48.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:48.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:48.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:49.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:49.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:49.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:49.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:50.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:50.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:50.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:50.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:51.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:51.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:51.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:51.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:52.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:52.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:52.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:52.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:53.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:53.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:53.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:53.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:54.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:54.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:54.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:54.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:55.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:55.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:55.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:55.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:56.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:56.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:56.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:56.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:57.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:57.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:57.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:57.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:58.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:58.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:58.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:58.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:20:59.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:59.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:20:59.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:20:59.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:00.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:00.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:00.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:00.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:01.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:01.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:01.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:01.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:02.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:02.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:02.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:02.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:03.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:03.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:03.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:03.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:04.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:04.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:04.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:04.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:05.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:05.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:05.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:05.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:06.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:06.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:06.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:06.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:07.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:07.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:07.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:07.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:08.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:08.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:08.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:08.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:09.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:09.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:09.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:09.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:10.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:10.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:10.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:10.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:11.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:11.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:11.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:11.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:12.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:12.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:12.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:12.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:13.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:13.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:13.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:13.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:14.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:13.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:14.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:13.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:15.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:15.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:15.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:15.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:16.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:16.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:16.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:16.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:17.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:17.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:17.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:17.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:17.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:17.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:17.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:17.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:18.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:18.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:18.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:18.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:19.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:19.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:19.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:19.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:20.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:20.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:20.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:20.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:21.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:21.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:21.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:21.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:22.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:22.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:22.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:22.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:23.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:23.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:23.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:23.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:24.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:24.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:24.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:24.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:25.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:25.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:25.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:25.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:26.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:26.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:26.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:26.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:27.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:27.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:27.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:27.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:28.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:28.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:28.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:28.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:29.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:29.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:29.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:29.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:30.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:30.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:30.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:30.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:31.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:31.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:31.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:31.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:32.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:32.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:32.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:32.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:33.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:33.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:33.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:33.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:34.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:34.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:34.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:34.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:35.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:35.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:36.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:36.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:36.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:36.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:37.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:37.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:37.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:37.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:38.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:38.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:38.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:38.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:39.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:39.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:39.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:39.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:40.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:40.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:40.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:40.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:41.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:41.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:41.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:41.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:42.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:42.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:42.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:42.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:43.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:43.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:43.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:43.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:44.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:44.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:44.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:44.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:45.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:45.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:45.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:45.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:46.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:46.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:47.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:47.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:47.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:47.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:48.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:48.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:48.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:48.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:49.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:49.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:49.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:49.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:50.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:50.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:50.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:50.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:51.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:51.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:51.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:51.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:52.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:52.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:52.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:52.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:53.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:53.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:53.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:53.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:54.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:54.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:54.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:54.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:55.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:55.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:55.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:55.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:56.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:56.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:56.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:56.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:57.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:57.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:57.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:57.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:58.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:58.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:58.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:58.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:21:59.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:59.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:21:59.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:21:59.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:00.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:00.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:00.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:00.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:01.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:01.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:01.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:01.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:02.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:02.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:02.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:02.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:03.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:03.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:03.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:03.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:04.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:04.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:04.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:04.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:05.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:05.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:05.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:05.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:06.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:06.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:06.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:06.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:07.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:07.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:07.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:07.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:08.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:08.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:08.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:08.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:09.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:09.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:09.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:09.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:10.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:10.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:10.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:10.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:11.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:11.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:11.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:11.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:12.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:12.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:12.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:12.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:13.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:13.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:13.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:13.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:14.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:14.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:14.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:14.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:15.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:15.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:15.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:15.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:16.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:16.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:16.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:16.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:17.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:17.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:17.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:17.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:18.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:18.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:18.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:18.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:19.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:19.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:19.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:19.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:20.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:20.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:20.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:20.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:21.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:21.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:21.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:21.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:22.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:22.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:22.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:22.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:24.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:23.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:24.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:23.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:25.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:24.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:25.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:24.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:25.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:25.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:25.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:25.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:27.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:27.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:27.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:27.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:28.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:28.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:29.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:29.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:29.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:29.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:30.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:30.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:30.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:30.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:31.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:31.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:31.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:31.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:32.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:32.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:32.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:32.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:33.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:33.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:33.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:33.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:33.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:33.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:33.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:33.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:34.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:34.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:34.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:34.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:35.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:35.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:35.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:35.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:36.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:36.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:36.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:36.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:37.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:37.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:37.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:37.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:38.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:38.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:38.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:38.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:39.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:39.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:39.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:39.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:40.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:40.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:40.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:40.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:41.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:41.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:42.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:42.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:42.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:42.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:43.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:43.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:43.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:43.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:44.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:44.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:44.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:44.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:45.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:45.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:45.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:45.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:46.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:46.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:46.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:46.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:47.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:47.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:47.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:48.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:48.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:48.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:48.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:49.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:49.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:49.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:49.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:50.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:50.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:50.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:50.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:51.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:51.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:51.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:51.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:52.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:52.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:52.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:52.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:53.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:53.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:53.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:53.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:54.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:54.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:54.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:54.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:55.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:55.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:55.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:55.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:56.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:56.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:56.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:56.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:57.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:57.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:57.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:57.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:58.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:58.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:58.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:58.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:22:59.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:59.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:22:59.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:22:59.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:00.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:00.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:00.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:00.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:01.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:01.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:01.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:01.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:02.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:02.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:02.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:02.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:03.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:03.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:04.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:04.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:04.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:04.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:05.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:05.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:05.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:05.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:06.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:06.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:06.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:06.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:07.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:07.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:07.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:07.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:08.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:08.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:08.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:08.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:09.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:09.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:10.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:10.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:10.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:10.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:11.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:11.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:11.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:11.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:12.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:12.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:12.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:12.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:13.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:13.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:13.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:13.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:14.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:14.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:14.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:14.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:15.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:15.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:15.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:15.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:16.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:16.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:16.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:16.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:17.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:17.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:17.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:17.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:18.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:18.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:18.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:18.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:19.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:19.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:19.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:19.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:20.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:20.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:20.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:20.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:21.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:21.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:21.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:21.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:22.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:22.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:22.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:22.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:23.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:23.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:23.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:23.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:24.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:24.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:24.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:24.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:25.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:25.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:25.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:25.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:26.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:26.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:26.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:26.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:27.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:27.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:27.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:27.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:28.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:28.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:28.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:28.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:29.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:29.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:29.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:29.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:30.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:30.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:30.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:30.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:31.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:31.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:31.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:31.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:32.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:32.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:32.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:32.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:33.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:33.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:33.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:33.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:34.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:34.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:34.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:34.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:35.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:35.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:35.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:35.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:36.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:36.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:36.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:36.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:37.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:37.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:37.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:37.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:38.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:38.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:38.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:38.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:39.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:39.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:39.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:39.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:40.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:40.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:40.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:40.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:42.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:41.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:42.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:41.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:43.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:43.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:43.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:43.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:44.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:44.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:44.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:44.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:45.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:45.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:45.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:45.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:46.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:46.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:46.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:46.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:47.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:47.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:47.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:47.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:48.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:48.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:48.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:48.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:49.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:49.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:49.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:49.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:50.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:50.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:50.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:50.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:51.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:51.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:51.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:51.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:52.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:52.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:52.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:52.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:53.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:53.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:53.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:53.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:54.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:54.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:54.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:54.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:55.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:55.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:55.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:55.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:56.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:56.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:56.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:56.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:57.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:57.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:57.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:57.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:58.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:58.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:58.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:58.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:23:59.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:59.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:23:59.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:23:59.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:00.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:00.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:00.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:00.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:01.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:01.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:01.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:01.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:02.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:02.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:02.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:02.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:03.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:03.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:03.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:03.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:04.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:04.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:04.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:04.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:05.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:05.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:05.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:05.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:06.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:06.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:06.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:06.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:07.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:07.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:07.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:07.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:08.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:08.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:08.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:08.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:09.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:09.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:09.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:09.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:10.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:09.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:10.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:09.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:11.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:11.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:11.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:11.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:12.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:12.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:12.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:12.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:13.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:13.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:13.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:13.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:14.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:14.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:14.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:14.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:15.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:15.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:15.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:15.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:16.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:16.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:16.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:16.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:17.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:17.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:17.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:17.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:18.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:18.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:18.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:18.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:19.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:19.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:19.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:19.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:20.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:20.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:20.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:20.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:21.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:21.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:21.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:21.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:22.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:22.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:22.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:22.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:23.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:22.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:23.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:22.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:23.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:23.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:23.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:23.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:25.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:25.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:25.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:25.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:25.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:25.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:25.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:25.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:26.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:26.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:26.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:26.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:27.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:27.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:27.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:27.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:29.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:28.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:29.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:28.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:29.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:29.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:29.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:29.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:30.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:30.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:30.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:30.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:31.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:31.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:31.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:31.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:33.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:33.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:34.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:34.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:34.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:34.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:35.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:35.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:35.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:35.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:35.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:35.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:35.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:35.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:36.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:36.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:36.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:36.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:37.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:37.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:37.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:37.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:38.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:38.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:38.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:38.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:39.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:39.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:39.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:39.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:40.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:40.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:40.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:40.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:42.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:42.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:42.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:42.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:43.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:43.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:43.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:43.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:44.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:44.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:44.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:44.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:45.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:45.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:45.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:45.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:45.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:45.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:45.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:45.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:47.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:47.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:47.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:47.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:48.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:48.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:48.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:48.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:49.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:49.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:49.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:49.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:50.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:50.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:50.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:50.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:51.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:51.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:51.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:51.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:51.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:51.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:51.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:51.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:52.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:52.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:52.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:52.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:54.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:54.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:54.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:54.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:55.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:55.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:55.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:55.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:56.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:56.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:56.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:56.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:57.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:57.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:57.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:57.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:58.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:58.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:58.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:58.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:24:59.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:59.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:24:59.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:24:59.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:00.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:00.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:00.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:00.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:01.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:01.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:01.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:01.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:02.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:02.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:02.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:02.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:03.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:03.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:03.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:03.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:04.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:04.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:04.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:04.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:04.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:04.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:04.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:04.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:05.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:05.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:05.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:05.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:06.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:06.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:06.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:06.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:07.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:07.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:14:35.294036+0000 (oldest deadline 2019-10-23T10:14:55.294036+0000) 2019-10-23T10:25:07.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:07.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:08.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:08.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:09.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:09.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:11.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:11.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:12.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:12.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:13.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:13.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:14.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:14.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:15.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:15.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:16.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:16.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:17.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:17.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:18.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:18.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:19.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:19.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:20.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:20.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:21.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:21.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:22.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:22.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:23.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:23.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:24.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:24.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:25.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:25.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:26.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:26.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:27.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:27.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:28.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:28.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:29.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:29.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:30.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:30.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:31.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:31.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:32.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:32.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:33.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:33.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:33.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:33.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:34.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:34.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:34.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:34.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:35.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:35.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:35.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:35.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:36.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:36.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:36.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:36.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:37.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:37.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:37.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:37.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:37.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:37.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:38.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:38.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:38.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:38.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:40.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:39.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:40.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:39.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:40.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:40.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:40.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:40.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:42.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:42.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:42.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:42.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:43.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:43.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:43.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:43.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:44.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:44.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:44.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:44.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:45.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:45.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:45.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:45.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:46.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:46.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:46.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:46.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:47.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:47.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:47.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:47.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:48.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:48.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:48.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:48.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:49.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:49.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:49.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:49.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:50.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:50.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:50.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:50.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:51.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:51.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:51.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:51.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:52.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:52.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:52.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:52.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:53.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:53.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:53.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:53.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:54.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:54.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:54.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:54.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:55.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:55.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:55.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:55.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:56.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:56.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:56.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:56.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:57.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:56.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:57.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:56.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:57.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:57.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:57.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:57.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:58.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:58.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:58.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:58.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:25:59.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:59.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:25:59.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:25:59.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:00.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:00.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:00.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:00.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:01.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:01.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:01.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:01.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:03.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:02.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:03.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:02.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:04.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:03.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:04.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:03.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:05.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:05.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:05.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:05.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:06.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:06.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:06.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:06.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:07.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:07.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:07.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:07.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:08.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:08.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:08.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:08.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:09.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:09.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:09.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:09.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:10.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:10.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:10.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:10.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:11.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:11.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:11.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:11.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:12.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:12.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:12.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:12.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:13.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:13.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:13.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:13.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:14.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:14.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:14.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:14.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:15.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:15.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:15.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:15.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:16.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:16.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:16.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:16.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:17.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:17.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:17.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:17.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:18.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:18.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:18.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:18.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:19.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:19.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:19.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:19.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:20.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:20.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:20.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:20.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:21.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:21.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:21.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:21.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:22.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:22.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:22.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:22.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:23.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:23.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:23.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:23.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:24.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:24.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:24.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:24.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:25.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:25.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:25.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:25.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:26.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:26.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:26.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:26.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:27.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:27.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:27.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:27.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:28.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:28.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:28.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:28.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:29.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:29.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:29.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:29.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:30.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:30.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:30.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:30.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:31.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:31.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:31.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:31.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:32.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:32.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:32.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:32.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:33.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:33.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:33.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:33.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:34.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:34.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:34.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:34.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:35.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:35.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:35.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:35.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:36.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:36.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:36.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:36.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:37.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:37.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:37.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:37.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:38.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:38.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:38.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:38.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:39.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:39.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:39.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:39.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:40.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:40.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:40.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:40.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:41.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:41.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:41.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:41.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:42.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:42.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:42.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:42.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:43.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:43.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:43.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:43.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:44.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:44.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:44.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:44.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:45.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:45.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:45.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:45.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:46.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:46.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:46.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:46.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:46.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:46.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:46.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:46.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:48.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:48.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:48.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:48.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:49.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:49.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:49.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:49.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:50.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:50.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:50.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:50.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:51.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:51.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:51.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:51.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:52.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:52.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:52.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:52.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:53.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:53.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:53.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:53.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:54.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:54.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:54.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:54.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:55.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:55.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:55.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:55.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:56.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:56.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:56.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:56.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:57.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:57.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:57.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:57.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:58.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:58.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:58.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:58.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:26:59.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:59.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:26:59.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:26:59.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:00.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:00.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:00.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:00.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:01.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:01.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:01.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:01.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:02.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:02.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:02.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:02.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:03.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:03.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:03.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:03.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:04.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:04.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:04.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:04.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:05.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:05.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:05.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:05.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:06.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:06.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:06.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:06.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:07.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:07.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:07.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:07.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:08.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:08.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:08.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:08.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:09.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:09.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:09.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:09.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:10.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:10.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:10.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:10.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:11.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:11.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:11.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:11.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:12.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:12.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:12.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:12.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:13.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:13.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:13.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:13.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:14.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:14.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:14.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:14.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:15.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:15.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:15.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:15.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:16.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:16.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:16.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:16.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:17.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:17.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:17.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:17.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:18.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:18.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:18.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:18.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:19.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:18.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:19.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:18.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:19.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:19.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:19.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:19.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:21.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:21.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:21.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:21.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:22.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:22.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:22.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:22.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:22.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:22.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:22.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:22.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:23.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:23.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:23.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:23.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:24.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:24.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:24.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:24.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:25.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:25.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:25.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:25.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:26.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:26.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:26.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:26.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:27.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:27.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:27.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:27.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:28.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:28.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:28.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:28.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:29.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:29.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:29.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:29.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:30.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:30.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:30.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:30.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:31.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:31.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:31.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:31.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:32.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:32.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:32.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:32.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:33.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:33.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:33.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:33.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:34.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:34.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:34.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:34.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:35.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:35.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:35.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:35.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:36.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:36.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:36.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:36.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:37.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:37.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:37.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:37.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:38.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:38.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:38.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:38.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:39.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:39.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:39.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:39.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:40.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:40.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:40.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:40.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:41.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:41.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:41.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:41.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:42.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:42.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:42.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:42.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:43.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:43.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:43.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:43.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:44.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:44.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:44.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:44.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:45.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:45.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:45.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:45.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:46.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:46.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:46.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:46.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:47.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:47.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:47.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:47.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:48.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:48.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:48.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:48.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:49.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:49.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:49.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:49.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:50.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:50.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:50.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:50.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:51.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:51.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:51.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:51.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:52.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:52.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:52.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:52.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:53.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:53.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:53.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:53.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:54.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:54.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:55.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:55.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:55.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:55.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:56.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:56.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:56.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:56.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:57.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:57.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:57.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:57.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:58.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:58.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:58.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:58.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:27:59.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:59.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:27:59.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:27:59.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:00.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:00.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:00.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:00.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:01.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:01.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:01.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:01.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:02.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:02.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:02.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:02.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:03.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:03.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:03.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:03.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:04.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:04.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:04.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:04.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:05.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:05.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:05.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:05.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:06.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:06.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:06.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:06.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:07.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:07.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:07.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:07.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:08.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:08.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:08.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:08.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:09.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:09.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:09.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:09.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:10.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:10.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:10.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:10.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:11.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:11.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:11.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:11.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:12.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:12.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:12.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:12.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:13.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:13.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:13.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:13.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:14.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:14.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:14.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:14.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:15.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:15.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:15.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:15.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:16.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:16.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:16.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:16.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:17.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:17.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:17.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:17.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:18.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:18.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:18.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:18.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:19.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:19.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:19.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:19.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:20.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:20.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:20.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:20.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:21.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:21.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:21.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:21.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:22.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:22.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:22.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:22.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:23.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:23.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:23.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:23.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:24.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:24.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:24.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:24.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:25.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:25.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:25.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:25.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:26.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:26.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:26.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:26.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:27.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:27.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:27.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:27.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:28.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:28.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:28.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:28.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:29.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:29.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:29.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:29.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:30.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:30.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:30.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:30.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:31.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:31.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:31.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:31.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:32.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:32.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:32.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:32.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:33.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:33.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:33.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:33.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:34.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:34.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:34.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:34.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:35.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:35.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:35.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:35.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:36.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:36.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:36.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:36.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:37.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:37.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:37.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:37.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:38.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:38.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:38.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:38.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:39.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:39.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:39.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:39.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:40.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:40.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:40.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:40.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:41.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:41.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:41.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:41.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:42.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:42.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:42.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:42.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:43.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:43.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:43.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:43.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:44.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:44.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:44.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:44.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:45.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:45.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:45.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:45.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:46.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:46.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:46.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:46.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:47.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:47.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:47.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:47.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:48.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:48.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:48.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:48.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:49.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:49.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:49.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:49.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:50.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:50.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:50.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:50.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:51.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:51.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:51.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:51.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:52.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:52.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:52.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:52.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:53.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:53.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:53.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:53.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:54.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:54.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:54.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:54.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:55.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:55.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:55.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:55.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:56.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:56.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:56.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:56.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:57.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:57.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:57.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:57.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:58.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:58.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:58.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:58.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:28:59.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:59.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:28:59.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:28:59.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:00.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:00.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:00.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:00.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:01.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:01.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:01.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:01.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:02.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:02.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:02.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:02.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:03.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:03.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:03.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:03.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:04.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:04.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:04.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:04.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:05.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:05.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:05.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:05.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:06.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:06.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:06.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:06.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:07.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:07.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:07.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:07.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:08.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:08.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:08.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:08.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:09.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:09.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:09.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:09.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:10.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:10.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:10.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:10.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:11.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:11.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:11.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:11.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:12.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:12.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:12.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:12.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:13.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:13.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:13.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:13.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:14.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:14.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:14.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:14.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:15.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:15.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:16.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:16.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:16.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:16.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:17.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:17.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:17.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:17.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:18.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:18.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:18.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:18.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:19.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:19.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:19.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:19.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:20.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:20.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:20.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:20.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:21.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:21.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:21.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:21.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:22.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:22.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:22.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:22.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:23.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:23.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:23.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:23.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:24.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:24.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:24.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:24.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:25.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:25.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:25.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:25.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:26.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:26.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:26.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:26.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:27.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:27.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:27.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:27.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:28.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:28.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:28.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:28.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:29.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:29.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:29.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:29.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:30.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:30.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:30.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:30.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:31.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:31.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:31.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:31.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:32.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:32.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:32.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:32.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:33.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:33.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:33.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:33.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:34.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:34.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:34.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:34.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:35.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:35.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:35.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:35.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:36.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:36.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:36.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:36.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:37.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:37.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:37.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:37.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:38.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:38.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:38.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:38.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:39.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:39.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:39.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:39.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:40.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:40.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:40.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:40.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:41.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:41.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:41.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:41.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:42.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:42.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:42.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:42.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:43.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:43.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:43.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:43.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:44.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:44.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:44.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:44.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:45.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:45.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:45.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:45.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:46.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:46.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:46.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:46.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:47.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:47.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:47.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:47.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:48.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:48.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:48.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:48.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:49.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:49.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:49.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:49.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:50.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:50.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:50.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:50.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:51.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:51.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:51.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:51.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:52.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:52.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:52.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:52.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:53.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:53.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:53.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:53.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:54.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:54.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:54.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:54.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:55.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:55.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:55.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:55.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:56.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:56.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:56.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:56.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:57.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:57.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:57.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:57.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:58.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:58.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:58.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:58.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:29:59.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:59.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:29:59.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:29:59.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:00.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:00.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:00.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:00.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:01.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:01.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:01.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:01.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:02.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:02.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:02.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:02.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:03.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:03.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:03.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:03.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:04.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:04.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:04.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:04.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:05.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:05.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:05.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:05.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:06.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:06.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:06.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:06.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:07.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:07.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:07.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:07.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:08.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:08.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:08.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:08.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:09.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:09.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:09.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:09.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:10.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:10.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:10.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:10.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:11.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:11.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:11.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:11.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:12.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:12.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:12.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:12.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:13.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:13.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:13.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:13.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:14.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:14.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:14.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:14.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:15.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:15.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:16.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:16.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:16.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:16.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:17.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:17.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:17.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:17.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:18.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:18.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:18.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:18.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:19.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:19.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:19.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:19.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:20.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:20.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:20.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:20.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:21.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:21.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:21.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:21.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:22.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:22.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:22.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:22.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:23.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:23.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:23.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:23.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:24.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:24.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:24.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:24.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:25.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:25.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:25.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:25.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:26.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:26.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:26.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:26.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:27.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:27.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:27.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:27.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:28.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:28.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:28.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:28.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:29.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:29.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:29.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:29.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:30.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:30.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:30.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:30.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:31.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:31.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:31.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:31.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:32.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:32.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:32.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:32.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:33.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:33.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:33.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:33.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:34.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:34.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:34.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:34.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:35.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:35.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:35.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:35.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:36.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:36.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:36.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:36.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:37.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:37.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:37.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:37.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:38.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:38.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:38.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:38.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:39.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:39.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:39.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:39.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:40.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:40.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:40.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:40.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:41.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:41.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:41.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:41.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:42.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:42.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:42.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:42.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:43.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:43.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:43.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:43.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:44.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:44.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:44.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:44.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:45.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:45.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:45.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:45.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:46.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:46.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:46.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:46.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:47.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:47.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:47.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:47.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:48.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:48.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:48.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:48.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:49.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:49.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:49.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:49.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:50.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:50.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:50.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:50.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:51.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:51.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:51.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:51.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:52.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:52.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:52.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:52.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:53.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:53.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:53.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:53.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:54.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:54.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:54.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:54.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:55.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:55.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:55.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:55.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:56.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:56.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:56.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:56.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:57.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:57.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:57.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:57.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:58.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:58.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:58.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:58.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:30:59.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:59.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:30:59.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:30:59.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:00.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:00.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:00.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:00.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:01.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:01.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:01.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:01.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:02.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:02.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:02.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:02.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:03.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:03.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:03.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:03.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:04.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:04.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:04.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:04.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:05.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:05.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:05.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:05.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:06.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:06.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:06.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:06.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:07.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:07.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:07.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:07.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:08.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:08.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:08.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:08.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:09.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:09.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:09.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:09.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:10.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:10.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:10.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:10.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:11.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:11.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:11.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:11.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:12.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:12.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:12.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:12.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:13.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:13.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:13.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:13.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:14.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:14.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:14.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:14.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:15.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:15.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:15.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:15.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:16.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:16.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:16.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:16.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:17.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:17.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:17.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:17.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:18.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:18.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:18.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:18.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:19.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:19.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:19.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:19.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:20.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:20.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:20.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:20.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:21.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:21.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:21.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:21.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:22.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:22.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:22.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:22.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:23.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:23.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:23.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:23.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:24.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:24.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:24.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:24.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:25.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:25.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:25.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:25.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:26.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:26.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:26.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:26.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:27.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:27.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:27.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:27.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:28.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:28.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:28.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:28.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:29.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:29.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:29.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:29.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:30.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:30.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:30.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:30.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:31.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:31.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:31.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:31.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:32.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:32.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:32.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:32.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:33.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:33.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:33.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:33.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:34.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:34.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:34.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:34.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:35.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:35.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:35.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:35.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:36.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:36.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:36.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:36.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:37.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:37.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:37.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:37.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:38.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:38.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:38.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:38.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:39.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:39.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:39.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:39.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:40.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:40.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:40.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:40.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:41.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:41.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:41.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:41.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:42.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:42.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:42.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:42.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:43.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:43.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:43.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:43.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:44.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:44.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:44.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:44.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:45.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:45.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:45.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:45.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:46.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:46.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:46.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:46.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:47.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:47.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:47.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:47.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:48.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:48.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:48.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:48.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:49.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:49.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:49.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:49.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:50.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:50.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:50.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:50.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:51.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:51.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:51.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:51.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:52.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:52.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:52.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:52.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:53.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:53.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:53.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:53.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:54.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:54.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:54.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:54.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:55.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:55.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:55.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:55.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:56.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:56.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:56.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:56.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:57.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:57.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:57.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:57.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:58.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:58.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:58.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:58.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:31:59.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:59.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:31:59.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:31:59.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:00.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:00.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:00.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:00.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:01.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:01.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:01.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:01.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:02.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:02.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:02.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:02.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:03.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:03.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:03.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:03.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:04.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:04.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:04.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:04.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:05.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:05.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:05.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:05.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:06.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:06.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:06.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:06.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:07.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:07.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:07.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:07.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:08.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:08.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:08.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:08.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:09.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:09.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:09.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:09.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:10.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:10.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:10.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:10.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:11.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:11.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:11.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:11.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:12.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:12.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:12.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:12.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:13.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:13.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:13.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:13.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:14.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:14.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:14.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:14.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:15.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:15.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:15.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:15.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:16.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:16.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:16.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:16.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:17.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:17.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:17.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:17.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:18.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:18.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:18.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:18.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:19.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:19.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:19.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:19.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:20.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:20.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:20.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:20.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:21.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:21.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:21.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:21.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:22.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:22.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:22.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:22.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:23.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:23.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:23.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:23.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:24.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:24.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:24.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:24.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:25.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:25.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:25.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:25.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:26.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:26.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:26.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:26.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:27.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:27.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:27.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:27.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:28.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:28.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:28.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:28.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:29.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:29.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:29.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:29.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:30.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:30.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:30.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:30.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:31.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:31.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:31.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:31.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:32.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:32.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:32.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:32.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:33.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:33.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:33.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:33.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:34.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:34.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:34.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:34.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:35.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:35.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:35.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:35.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:36.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:36.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:36.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:36.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:37.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:37.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:37.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:37.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:38.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:38.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:38.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:38.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:39.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:39.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:39.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:39.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:40.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:40.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:40.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:40.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:41.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:41.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:41.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:41.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:42.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:42.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:42.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:42.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:43.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:43.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:43.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:43.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:44.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:44.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:44.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:44.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:45.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:45.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:45.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:45.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:46.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:46.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:46.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:46.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:47.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:47.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:47.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:47.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:48.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:48.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:48.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:48.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:49.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:49.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:49.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:49.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:50.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:50.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:50.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:50.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:51.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:51.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:51.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:51.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:52.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:52.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:52.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:52.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:53.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:53.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:53.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:53.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:54.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:54.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:54.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:54.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:55.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:55.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:55.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:55.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:56.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:56.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:56.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:56.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:57.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:57.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:57.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:57.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:58.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:58.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:58.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:58.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:32:59.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:59.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:32:59.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:32:59.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:00.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:00.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:00.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:00.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:01.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:01.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:01.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:01.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:02.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:02.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:02.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:02.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:03.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:03.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:03.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:03.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:04.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:04.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:04.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:04.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:05.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:05.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:05.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:05.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:06.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:06.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:06.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:06.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:07.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:07.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:07.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:07.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:08.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:08.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:08.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:08.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:09.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:09.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:09.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:09.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:10.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:10.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:10.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:10.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:11.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:11.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:11.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:11.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:12.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:12.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:12.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:12.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:13.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:13.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:13.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:13.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:14.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:14.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:14.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:14.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:15.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:15.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:15.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:15.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:16.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:16.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:16.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:16.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:17.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:17.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:17.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:17.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:18.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:18.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:18.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:18.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:19.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:19.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:19.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:19.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:20.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:20.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:20.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:20.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:21.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:21.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:21.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:21.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:22.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:22.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:22.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:22.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:23.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:23.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:23.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:23.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:24.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:24.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:24.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:24.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:25.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:25.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:25.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:25.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:26.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:26.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:26.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:26.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:27.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:27.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:27.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:27.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:28.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:28.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:28.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:28.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:29.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:29.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:29.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:29.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:30.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:30.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:30.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:30.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:31.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:31.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:31.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:31.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:32.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:32.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:32.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:32.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:33.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:33.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:33.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:33.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:34.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:34.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:34.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:34.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:35.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:35.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:35.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:35.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:36.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:36.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:36.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:36.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:37.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:37.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:37.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:37.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:38.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:38.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:38.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:38.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:39.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:39.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:39.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:39.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:40.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:40.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:40.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:40.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:41.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:41.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:41.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:41.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:42.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:42.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:42.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:42.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:43.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:43.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:43.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:43.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:44.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:44.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:44.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:44.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:45.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:45.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:45.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:45.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:46.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:46.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:46.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:46.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:47.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:47.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:47.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:47.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:48.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:48.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:48.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:48.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:49.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:49.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:49.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:49.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:50.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:50.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:50.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:50.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:51.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:51.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:51.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:51.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:52.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:52.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:52.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:52.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:53.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:53.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:53.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:53.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:54.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:54.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:54.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:54.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:55.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:55.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:55.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:55.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:56.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:56.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:56.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:56.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:57.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:57.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:57.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:57.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:58.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:58.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:58.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:58.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:33:59.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:59.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:33:59.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:33:59.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:00.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:00.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:00.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:00.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:01.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:01.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:01.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:01.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:02.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:02.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:02.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:02.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:03.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:03.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:03.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:03.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:04.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:04.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:04.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:04.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:05.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:05.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:05.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:05.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:06.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:06.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:06.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:06.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:07.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:07.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:07.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:07.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:08.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:08.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:08.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:08.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:09.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:09.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:09.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:09.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:10.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:10.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:10.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:10.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:11.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:11.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:11.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:11.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:12.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:12.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:12.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:12.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:13.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:13.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:13.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:13.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:14.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:14.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:14.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:14.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:15.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:15.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:15.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:15.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:16.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:16.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:16.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:16.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:17.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:17.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:17.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:17.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:18.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:18.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:18.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:18.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:19.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:19.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:19.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:19.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:20.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:20.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:20.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:20.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:21.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:21.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:21.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:21.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:22.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:22.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:22.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:22.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:23.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:23.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:23.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:23.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:24.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:24.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:24.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:24.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:25.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:25.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:25.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:25.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:26.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:26.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:26.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:26.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:27.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:27.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:27.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:27.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:28.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:28.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:28.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:28.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:29.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:29.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:29.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:29.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:30.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:30.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:30.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:30.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:31.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:31.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:31.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:31.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:32.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:32.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:32.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:32.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:33.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:33.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:33.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:33.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:34.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:34.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:34.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:34.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:35.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:35.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:35.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:35.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:36.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:36.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:36.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:36.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:37.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:37.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:37.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:37.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:38.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:38.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:38.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:38.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:39.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:39.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:39.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:39.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:40.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:40.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:40.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:40.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:41.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:41.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:41.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:41.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:42.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:42.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:42.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:42.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:43.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:43.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:43.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:43.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:44.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:44.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:44.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:44.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:45.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:45.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:45.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:45.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:46.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:46.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:46.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:46.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:47.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:47.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:47.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:47.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:48.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:48.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:48.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:48.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:49.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:49.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:49.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:49.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:50.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:50.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:50.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:50.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:51.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:51.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:51.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:51.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:52.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:52.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:52.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:52.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:53.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:53.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:53.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:53.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:54.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:54.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:54.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:54.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:55.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:55.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:55.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:55.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:56.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:56.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:56.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:56.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:57.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:57.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:57.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:57.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:58.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:58.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:58.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:58.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:34:59.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:59.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:34:59.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:34:59.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:00.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:00.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:00.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:00.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:01.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:01.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:01.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:01.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:02.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:02.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:02.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:02.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:03.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:03.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:03.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:03.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:04.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:04.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:04.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:04.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:05.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:05.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:05.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:05.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:06.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:06.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:06.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:06.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:07.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:07.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:07.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:07.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:08.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:08.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:08.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:08.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:09.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:09.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:09.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:09.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:10.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:10.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:10.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:10.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:11.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:11.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:11.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:11.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:12.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:12.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:12.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:12.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:13.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:13.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:13.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:13.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:14.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:14.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:14.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:14.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:15.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:15.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:15.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:15.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:16.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:16.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:16.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:16.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:17.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:17.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:17.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:17.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:18.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:18.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:18.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:18.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:19.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:19.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:19.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:19.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:20.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:20.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:20.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:20.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:21.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:21.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:21.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:21.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:22.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:22.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:22.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:22.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:23.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:23.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:23.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:23.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:24.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:24.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:24.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:24.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:25.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:25.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:25.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:25.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:26.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:26.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:26.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:26.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:27.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:27.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:27.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:27.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:28.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:28.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:28.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:28.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:29.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:29.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:29.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:29.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:30.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:30.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:30.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:30.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:31.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:31.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:31.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:31.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:32.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:32.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:32.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:32.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:33.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:33.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:33.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:33.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:34.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:34.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:34.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:34.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:35.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:35.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:35.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:35.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:36.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:36.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:36.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:36.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:37.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:37.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:37.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:37.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:38.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:38.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:38.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:38.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:39.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:39.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:25:12.419839+0000 (oldest deadline 2019-10-23T10:25:32.419839+0000) 2019-10-23T10:35:39.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:39.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:40.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:40.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:41.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:41.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:42.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:42.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:43.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:43.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:44.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:44.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:45.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:45.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:46.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:46.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:47.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:47.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:48.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:48.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:49.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:49.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:50.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:50.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:51.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:51.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:52.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:52.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:53.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:53.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:54.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:54.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:55.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:55.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:56.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:56.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:57.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:57.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:58.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:58.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:35:59.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:35:59.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:00.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:00.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:01.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:01.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:02.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:02.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:03.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:03.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:03.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:03.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:04.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:04.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:04.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:04.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:05.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:05.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:05.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:05.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:06.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:06.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:06.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:06.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:07.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:07.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:07.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:07.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:08.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:08.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:08.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:08.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:09.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:09.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:09.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:09.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:10.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:10.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:10.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:10.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:11.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:11.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:11.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:11.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:12.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:12.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:12.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:12.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:13.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:13.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:13.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:13.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:14.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:14.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:14.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:14.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:15.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:15.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:15.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:15.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:16.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:16.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:16.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:16.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:17.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:17.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:17.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:17.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:18.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:18.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:18.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:18.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:19.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:19.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:19.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:19.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:20.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:20.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:20.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:20.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:21.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:21.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:21.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:21.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:22.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:22.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:22.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:22.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:23.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:23.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:23.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:23.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:24.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:24.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:24.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:24.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:25.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:25.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:25.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:25.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:26.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:26.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:26.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:26.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:27.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:27.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:27.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:27.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:28.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:28.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:28.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:28.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:29.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:29.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:29.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:29.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:30.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:30.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:30.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:30.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:31.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:31.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:31.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:31.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:32.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:32.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:32.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:32.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:33.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:33.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:33.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:33.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:34.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:34.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:34.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:34.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:35.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:35.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:35.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:35.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:36.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:36.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:36.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:36.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:37.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:37.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:37.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:37.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:38.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:38.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:38.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:38.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:39.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:39.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:39.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:39.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:40.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:40.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:40.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:40.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:41.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:41.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:41.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:41.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:42.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:42.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:42.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:42.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:43.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:43.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:43.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:43.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:44.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:44.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:44.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:44.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:45.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:45.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:45.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:45.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:46.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:46.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:46.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:46.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:47.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:47.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:47.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:47.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:48.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:48.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:48.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:48.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:49.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:49.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:49.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:49.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:50.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:50.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:50.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:50.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:51.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:51.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:51.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:51.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:52.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:52.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:52.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:52.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:53.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:53.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:53.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:53.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:54.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:54.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:54.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:54.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:55.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:55.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:55.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:55.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:56.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:56.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:56.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:56.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:57.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:57.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:57.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:57.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:58.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:58.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:58.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:58.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:36:59.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:59.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:36:59.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:36:59.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:00.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:00.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:00.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:00.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:01.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:01.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:01.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:01.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:02.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:02.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:02.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:02.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:03.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:03.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:03.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:03.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:04.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:04.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:04.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:04.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:05.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:05.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:05.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:05.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:06.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:06.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:06.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:06.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:07.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:07.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:07.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:07.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:08.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:08.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:08.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:08.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:09.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:09.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:09.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:09.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:10.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:10.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:10.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:10.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:11.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:11.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:11.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:11.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:12.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:12.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:12.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:12.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:13.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:13.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:13.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:13.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:14.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:14.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:14.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:14.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:15.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:15.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:15.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:15.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:16.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:16.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:16.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:16.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:17.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:17.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:17.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:17.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:18.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:18.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:18.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:18.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 72 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:19.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:19.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:19.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:19.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:20.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:20.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:20.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:20.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:21.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:21.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:21.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:21.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:22.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:22.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:22.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:22.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:23.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:23.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:23.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:23.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:24.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:24.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:24.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:24.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:25.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:25.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:25.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:25.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:26.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:26.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:26.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:26.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:27.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:27.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:27.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:27.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:28.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:28.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:28.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:28.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:29.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:29.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:29.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:29.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:30.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:30.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:30.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:30.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:31.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:31.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:31.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:31.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:32.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:32.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:32.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:32.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:33.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:33.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:33.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:33.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:34.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:34.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:34.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:34.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:35.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:35.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:35.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:35.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:36.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:36.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:36.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:36.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:37.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:37.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:37.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:37.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:38.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:38.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:38.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:38.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:39.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:39.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:39.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:39.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:40.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:40.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:40.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:40.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:41.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:41.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:41.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:41.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:42.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:42.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:42.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:42.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:43.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:43.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:43.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:43.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:44.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:44.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:44.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:44.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:45.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:45.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:45.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:45.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:46.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:46.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:46.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:46.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:47.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:47.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:47.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:47.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:48.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:48.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:48.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:48.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:49.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:49.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:49.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:49.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:50.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:50.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:50.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:50.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:51.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:51.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:51.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:51.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:52.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:52.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:52.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:52.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:53.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:53.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:53.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:53.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:54.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:54.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:54.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:54.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:55.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:55.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:55.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:55.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:56.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:56.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:56.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:56.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:57.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:57.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:57.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:57.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:58.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:58.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:58.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:58.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:37:59.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:59.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:37:59.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:37:59.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:00.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:00.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:00.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:00.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:01.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:01.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:01.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:01.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:02.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:02.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:02.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:02.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:03.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:03.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:03.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:03.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:04.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:04.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:04.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:04.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:05.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:05.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:05.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:05.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:06.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:06.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:06.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:06.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:07.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:07.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:07.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:07.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:08.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:08.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:08.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:08.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:09.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:09.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:09.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:09.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:10.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:10.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:10.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:10.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:11.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:11.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:11.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:11.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:12.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:12.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:12.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:12.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:13.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:13.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:13.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:13.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:14.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:14.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:14.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:14.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:15.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:15.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:15.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:15.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:16.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:16.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:16.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:16.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:17.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:17.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:17.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:17.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:18.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:18.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:18.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:18.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:19.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:19.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:19.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:19.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:20.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:20.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:20.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:20.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:21.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:21.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:21.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:21.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:22.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:22.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:22.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:22.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:23.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:23.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:23.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:23.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:24.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:24.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:24.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:24.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:25.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:25.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:25.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:25.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:26.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:26.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:26.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:26.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:27.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:27.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:27.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:27.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:28.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:28.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:28.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:28.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:29.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:29.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:29.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:29.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:30.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:30.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:30.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:30.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:31.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:31.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:31.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:31.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:32.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:32.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:32.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:32.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:33.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:33.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:33.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:33.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:34.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:34.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:34.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:34.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:35.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:35.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:35.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:35.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:36.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:36.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:36.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:36.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:37.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:37.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:37.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:37.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:38.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:38.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:38.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:38.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:39.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:39.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:39.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:39.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:40.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:40.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:40.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:40.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:41.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:41.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:41.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:41.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:42.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:42.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:42.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:42.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:43.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:43.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:43.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:43.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:44.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:44.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:44.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:44.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:45.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:45.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:45.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:45.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:46.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:46.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:46.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:46.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:47.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:47.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:47.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:47.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:48.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:48.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:48.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:48.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:49.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:49.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:49.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:49.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:50.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:50.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:50.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:50.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:51.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:51.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:51.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:51.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:52.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:52.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:52.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:52.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:53.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:53.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:53.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:53.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:54.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:54.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:54.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:54.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:55.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:55.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:55.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:55.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:56.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:56.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:56.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:56.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:57.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:57.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:57.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:57.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:58.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:58.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:58.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:58.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:38:59.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:59.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:38:59.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:38:59.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:00.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:00.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:00.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:00.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:01.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:01.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:01.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:01.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:02.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:02.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:02.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:02.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:03.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:03.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:03.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:03.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:04.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:04.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:04.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:04.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:05.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:05.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:05.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:05.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:06.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:06.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:06.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:06.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:07.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:07.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:07.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:07.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:08.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:08.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:08.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:08.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:09.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:09.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:09.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:09.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:10.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:10.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:10.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:10.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:11.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:11.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:11.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:11.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:12.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:12.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:12.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:12.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:13.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:13.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:13.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:13.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:14.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:14.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:14.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:14.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:15.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:15.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:15.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:15.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:16.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:16.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:16.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:16.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:17.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:17.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:17.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:17.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:18.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:18.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:18.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:18.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:19.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:19.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:19.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:19.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:20.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:20.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:20.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:20.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:21.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:21.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:21.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:21.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:22.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:22.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:22.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:22.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:23.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:23.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:23.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:23.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:24.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:24.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:24.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:24.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:25.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:25.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:25.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:25.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:26.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:26.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:26.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:26.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:27.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:27.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:27.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:27.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:28.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:28.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:28.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:28.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:29.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:29.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:29.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:29.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:30.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:30.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:30.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:30.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:31.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:31.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:31.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:31.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:32.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:32.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:32.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:32.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:33.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:33.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:33.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:33.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:34.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:34.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:34.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:34.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:35.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:35.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:35.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:35.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:36.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:36.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:36.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:36.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:37.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:37.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:37.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:37.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:38.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:38.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:38.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:38.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:39.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:39.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:39.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:39.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:40.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:40.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:40.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:40.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:41.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:41.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:41.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:41.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:42.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:42.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:42.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:42.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:43.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:43.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:43.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:43.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:44.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:44.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:44.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:44.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:45.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:45.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:45.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:45.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:46.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:46.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:46.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:46.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:47.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:47.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:47.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:47.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:48.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:48.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:48.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:48.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:49.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:49.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:49.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:49.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:50.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:50.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:50.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:50.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:51.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:51.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:51.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:51.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:52.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:52.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:52.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:52.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:53.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:53.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:53.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:53.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:54.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:54.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:54.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:54.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:55.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:55.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:55.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:55.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:56.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:56.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:56.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:56.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:57.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:57.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:57.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:57.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:58.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:58.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:58.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:58.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:39:59.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:59.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:39:59.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:39:59.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:00.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:00.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:00.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:00.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:01.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:01.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:01.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:01.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:02.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:02.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:02.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:02.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:03.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:03.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:03.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:03.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:04.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:04.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:04.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:04.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:05.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:05.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:05.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:05.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:06.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:06.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:06.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:06.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:07.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:07.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:07.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:07.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:08.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:08.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:08.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:08.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:09.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:09.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:09.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:09.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:10.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:10.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:10.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:10.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:11.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:11.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:11.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:11.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:12.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:12.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:12.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:12.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:13.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:13.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:13.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:13.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:14.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:14.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:14.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:14.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:15.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:15.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:15.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:15.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:16.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:16.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:16.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:16.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:17.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:17.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:17.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:17.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:18.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:18.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:18.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:18.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:19.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:19.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:19.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:19.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:20.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:20.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:20.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:20.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:21.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:21.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:21.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:21.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:22.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:22.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:22.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:22.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:23.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:23.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:23.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:23.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:24.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:24.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:24.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:24.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:25.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:25.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:25.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:25.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:26.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:26.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:26.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:26.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:27.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:27.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:27.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:27.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:28.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:28.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:28.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:28.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:29.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:29.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:29.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:29.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:30.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:30.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:30.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:30.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:31.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:31.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:31.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:31.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:32.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:32.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:32.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:32.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:33.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:33.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:33.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:33.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:34.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:34.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:34.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:34.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:35.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:35.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:35.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:35.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:36.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:36.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:36.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:36.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:37.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:37.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:37.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:37.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:38.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:38.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:38.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:38.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:39.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:39.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:39.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:39.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:40.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:40.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:40.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:40.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:41.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:41.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:41.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:41.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:42.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:42.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:42.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:42.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:43.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:43.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:43.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:43.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:44.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:44.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:44.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:44.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:45.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:45.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:45.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:45.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:46.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:46.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:46.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:46.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:47.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:47.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:47.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:47.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:48.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:48.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:48.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:48.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:49.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:49.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:49.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:49.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:50.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:50.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:50.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:50.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:51.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:51.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:51.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:51.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:52.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:52.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:52.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:52.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:53.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:53.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:53.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:53.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:54.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:54.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:54.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:54.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:55.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:55.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:55.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:55.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:56.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:56.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:56.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:56.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:57.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:57.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:57.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:57.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:58.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:58.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:58.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:58.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:40:59.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:59.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:40:59.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:40:59.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:00.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:00.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:00.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:00.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:01.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:01.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:01.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:01.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:02.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:02.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:02.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:02.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:03.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:03.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:03.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:03.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:04.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:04.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:04.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:04.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:05.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:05.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:05.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:05.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:06.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:06.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:06.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:06.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:07.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:07.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:07.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:07.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:08.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:08.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:08.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:08.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:09.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:09.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:09.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:09.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:10.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:10.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:10.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:10.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:11.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:11.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:11.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:11.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:12.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:12.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:12.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:12.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:13.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:13.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:13.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:13.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:14.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:14.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:14.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:14.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:15.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:15.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:15.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:15.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:16.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:16.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:16.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:16.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:17.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:17.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:17.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:17.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:18.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:18.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:18.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:18.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:19.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:19.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:19.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:19.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:20.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:20.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:20.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:20.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:21.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:21.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:21.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:21.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:22.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:22.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:22.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:22.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:23.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:23.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:23.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:23.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:24.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:24.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:24.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:24.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:25.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:25.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:25.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:25.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:26.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:26.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:26.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:26.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:27.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:27.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:27.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:27.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:28.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:28.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:28.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:28.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:29.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:29.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:29.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:29.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:30.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:30.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:30.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:30.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:31.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:31.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:31.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:31.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:32.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:32.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:32.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:32.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:33.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:33.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:33.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:33.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:34.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:34.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:34.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:34.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:35.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:35.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:35.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:35.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:36.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:36.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:36.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:36.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:37.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:37.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:37.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:37.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:38.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:38.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:38.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:38.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:39.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:39.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:39.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:39.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:40.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:40.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:40.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:40.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:41.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:41.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:41.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:41.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:42.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:42.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:42.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:42.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:43.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:43.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:43.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:43.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:44.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:44.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:44.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:44.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:45.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:45.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:45.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:45.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:45.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:45.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:45.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:45.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:46.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:46.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:46.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:46.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:47.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:47.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:47.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:47.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:49.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:49.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:49.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:49.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:50.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:50.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:50.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:50.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:51.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:51.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:51.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:51.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:52.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:52.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:52.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:52.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:53.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:53.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:53.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:53.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:54.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:54.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:54.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:54.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:55.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:55.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:55.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:55.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:56.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:56.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:56.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:56.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:57.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:57.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:57.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:57.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:58.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:58.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:58.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:58.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:41:59.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:59.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:41:59.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:41:59.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:00.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:00.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:00.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:00.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:01.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:01.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:01.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:01.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:02.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:02.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:02.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:02.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:03.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:03.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:03.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:03.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:04.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:04.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:04.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:04.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:05.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:04.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:05.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:04.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:06.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:06.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:06.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:06.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:07.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:07.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:07.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:07.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:08.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:08.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:08.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:08.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:09.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:09.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:09.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:09.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:09.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:09.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:09.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:09.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:10.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:10.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:10.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:10.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:11.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:11.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:11.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:11.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:12.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:12.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:12.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:12.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:14.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:14.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:14.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:14.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:14.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:14.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:14.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:14.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:16.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:15.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:16.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:15.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:17.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:17.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:17.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:17.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:18.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:18.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:18.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:18.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:19.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:19.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:19.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:19.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:20.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:20.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:20.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:20.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:21.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:20.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:21.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:20.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:21.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:21.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:21.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:21.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:23.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:22.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:23.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:22.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:24.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:24.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:24.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:24.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:25.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:25.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:25.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:25.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:26.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:26.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:26.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:26.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:27.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:27.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:27.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:27.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:28.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:28.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:28.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:28.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:29.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:29.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:29.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:29.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:30.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:30.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:30.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:30.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:31.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:31.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:31.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:31.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:32.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:32.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:32.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:32.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:33.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:33.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:33.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:33.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:33.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:33.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:33.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:33.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:34.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:34.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:34.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:34.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:35.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:35.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:35.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:35.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:36.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:36.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:36.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:36.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:37.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:37.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:37.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:37.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:38.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:38.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:38.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:38.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:39.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:39.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:39.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:39.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:40.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:40.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:40.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:40.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:41.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:41.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:41.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:41.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:42.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:42.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:42.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:42.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:43.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:43.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:43.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:43.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:44.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:44.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:44.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:44.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:45.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:45.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:45.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:45.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:46.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:46.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:46.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:47.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:47.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:47.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:47.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:48.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:48.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:48.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:48.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:49.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:49.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:49.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:49.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:50.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:50.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:50.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:50.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:51.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:51.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:51.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:51.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:52.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:52.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:52.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:52.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:53.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:53.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:53.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:53.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:54.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:54.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:54.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:54.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:55.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:55.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:55.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:55.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:56.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:56.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:56.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:56.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:57.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:57.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:57.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:57.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:58.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:58.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:58.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:58.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:42:59.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:59.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:42:59.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:42:59.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:00.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:00.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:00.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:00.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:01.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:01.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:01.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:01.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:03.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:03.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:03.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:03.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:04.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:04.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:04.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:04.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:05.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:05.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:05.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:05.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:06.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:06.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:06.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:06.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:07.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:07.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:07.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:07.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:08.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:08.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:08.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:08.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:09.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:09.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:09.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:09.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:09.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:09.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:09.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:09.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:10.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:10.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:10.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:10.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:11.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:11.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:11.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:11.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:12.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:12.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:12.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:12.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:13.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:13.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:13.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:13.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:14.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:14.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:14.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:14.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:15.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:15.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:15.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:15.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:16.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:16.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:16.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:16.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:17.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:17.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:17.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:17.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:18.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:18.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:18.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:18.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:19.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:19.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:19.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:19.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:20.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:20.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:20.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:20.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:21.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:21.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:21.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:21.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:22.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:22.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:22.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:22.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:23.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:23.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:23.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:23.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:24.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:24.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:24.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:24.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:25.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:25.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:25.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:25.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:26.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:26.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:26.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:26.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:27.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:27.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:27.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:27.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:29.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:29.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:29.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:29.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:29.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:29.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:29.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:29.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:30.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:30.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:30.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:30.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:31.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:31.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:31.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:31.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:32.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:32.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:32.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:32.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:33.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:33.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:33.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:33.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:34.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:34.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:34.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:34.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:35.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:35.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:35.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:35.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:36.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:36.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:36.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:36.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:37.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:37.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:37.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:37.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:38.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:38.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:38.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:38.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:39.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:39.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:39.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:39.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:40.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:40.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:40.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:40.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:41.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:41.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:41.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:41.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:42.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:42.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:42.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:42.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:43.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:43.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:43.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:43.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:44.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:44.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:44.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:44.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:45.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:45.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:45.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:45.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:46.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:46.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:46.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:46.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:47.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:47.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:47.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:47.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:48.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:48.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:48.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:48.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:49.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:49.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:50.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:50.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:50.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:50.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:51.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:51.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:51.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:51.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:52.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:52.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:52.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:52.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:53.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:53.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:53.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:53.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:54.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:54.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:54.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:54.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:55.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:55.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:55.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:55.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:56.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:56.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:56.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:56.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:57.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:57.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:57.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:57.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:58.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:58.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:58.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:58.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:43:59.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:59.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:43:59.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:43:59.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:00.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:00.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:00.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:00.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:01.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:01.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:01.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:01.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:02.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:02.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:02.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:02.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:03.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:03.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:03.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:03.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:04.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:04.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:04.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:04.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:05.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:05.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:05.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:05.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:06.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:06.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:06.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:06.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:07.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:07.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:07.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:07.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:08.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:08.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:08.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:08.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:09.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:09.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:09.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:09.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:10.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:10.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:10.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:10.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:11.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:11.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:11.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:11.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:12.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:12.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:12.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:12.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:13.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:13.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:13.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:13.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:14.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:14.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:14.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:14.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:15.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:15.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:15.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:15.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:16.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:16.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:16.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:16.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:17.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:17.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:17.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:17.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:18.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:18.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:18.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:18.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:19.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:19.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:19.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:19.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:20.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:20.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:20.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:20.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:21.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:21.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:21.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:21.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:22.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:22.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:22.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:22.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:23.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:23.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:23.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:23.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:24.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:24.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:24.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:24.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:25.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:25.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:25.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:25.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:26.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:26.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:26.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:26.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:27.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:27.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:27.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:27.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:28.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:28.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:28.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:28.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:29.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:29.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:29.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:29.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:30.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:30.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:30.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:30.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:31.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:31.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:31.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:31.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:32.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:32.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:32.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:32.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:33.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:33.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:33.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:33.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:34.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:34.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:34.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:34.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:35.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:35.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:35.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:35.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:36.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:36.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:36.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:36.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:37.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:37.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:37.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:37.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:38.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:38.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:38.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:38.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:39.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:39.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:39.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:39.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:40.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:40.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:40.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:40.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:41.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:41.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:41.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:41.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:42.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:42.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:42.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:42.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:43.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:43.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:43.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:43.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:44.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:44.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:44.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:44.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:45.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:45.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:45.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:45.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:46.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:46.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:46.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:46.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:47.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:47.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:47.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:47.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:48.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:48.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:48.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:48.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:49.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:49.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:49.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:49.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:50.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:50.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:50.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:50.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:51.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:51.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:51.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:51.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:52.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:52.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:52.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:52.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:53.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:53.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:53.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:53.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:54.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:54.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:54.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:54.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:55.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:55.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:55.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:55.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:57.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:56.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:57.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:56.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:57.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:57.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:57.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:57.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:44:58.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:58.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:44:58.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:44:58.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:00.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:00.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:00.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:00.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:01.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:01.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:01.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:01.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:01.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:01.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:01.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:01.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:02.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:02.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:02.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:02.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:03.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:03.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:03.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:03.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:04.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:04.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:04.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:04.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:05.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:05.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:05.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:05.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:06.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:06.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:06.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:06.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:07.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:07.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:07.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:07.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:08.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:08.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:08.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:08.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:09.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:09.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:09.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:09.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:10.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:10.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:10.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:10.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:11.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:11.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:11.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:11.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:12.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:12.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:12.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:12.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:13.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:13.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:13.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:13.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:14.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:14.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:14.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:14.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:15.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:15.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:15.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:15.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:16.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:16.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:16.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:16.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:17.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:17.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:17.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:17.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:18.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:18.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:18.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:18.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:19.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:19.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:19.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:19.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:20.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:20.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:20.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:20.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:21.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:21.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:21.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:21.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:22.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:22.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:22.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:22.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:23.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:23.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:23.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:23.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:24.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:24.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:24.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:24.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:25.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:25.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:25.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:25.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:26.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:26.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:26.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:26.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:27.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:27.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:27.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:27.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:28.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:28.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:28.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:28.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:29.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:29.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:29.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:29.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:31.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:31.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:31.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:31.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:31.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:31.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:32.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:31.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:33.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:33.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:33.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:33.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:34.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:34.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:34.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:34.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:35.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:35.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:35.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:35.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:36.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:36.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:36.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:36.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:37.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:37.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:37.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:37.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:38.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:38.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:38.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:38.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:39.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:39.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:39.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:39.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:40.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:40.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:40.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:40.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:41.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:41.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:41.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:41.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:42.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:42.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:42.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:42.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:43.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:43.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:43.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:43.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:44.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:44.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:44.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:44.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:45.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:45.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:45.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:45.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:46.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:46.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:46.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:46.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:47.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:47.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:47.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:47.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:48.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:48.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:48.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:48.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:49.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:49.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:49.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:49.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:50.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:50.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:50.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:50.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:51.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:51.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:51.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:51.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:52.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:52.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:52.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:52.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:53.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:53.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:53.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:53.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:54.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:54.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:54.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:54.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:55.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:55.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:55.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:55.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:56.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:56.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:56.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:56.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:57.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:57.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:57.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:57.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:58.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:58.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:58.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:58.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:45:59.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:59.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:45:59.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:45:59.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:00.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:00.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:00.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:00.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:01.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:01.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:02.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:02.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:02.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:02.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:03.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:03.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:03.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:03.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:04.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:04.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:04.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:04.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:05.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:05.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:05.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:05.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:06.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:06.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:06.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:06.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:07.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:07.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:07.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:07.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:08.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:08.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:08.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:08.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:09.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:09.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:09.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:09.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:10.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:10.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:10.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:10.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:11.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:11.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:11.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:11.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:12.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:12.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:12.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:12.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:13.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:13.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:13.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:13.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:14.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:14.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:14.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:14.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:15.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:15.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:15.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:15.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:16.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:16.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:16.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:16.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:17.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:17.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:35:42.747557+0000 (oldest deadline 2019-10-23T10:36:02.747557+0000) 2019-10-23T10:46:17.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:17.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:18.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:18.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:19.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:19.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:20.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:20.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:21.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:21.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:22.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:22.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:23.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:23.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:24.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:24.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:25.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:25.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:26.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:26.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:27.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:27.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:28.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:28.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:29.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:29.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:30.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:30.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:31.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:31.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:32.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:32.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:33.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:33.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:34.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:34.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:35.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:35.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:36.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:36.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:37.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:37.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:38.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:38.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:39.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:39.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:39.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:39.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:40.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:40.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:40.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:40.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:41.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:41.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:41.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:41.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:42.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:42.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:42.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:42.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:43.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:43.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:43.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:43.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:44.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:44.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:44.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:44.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:45.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:45.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:45.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:45.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:46.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:46.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:46.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:46.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:47.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:47.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:47.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:47.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:48.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:48.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:48.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:48.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:49.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:49.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:49.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:49.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:50.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:50.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:50.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:50.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:51.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:51.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:51.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:51.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:52.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:52.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:52.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:52.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:53.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:53.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:53.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:53.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:54.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:54.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:54.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:54.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:55.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:55.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:55.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:55.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:56.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:56.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:56.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:56.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:57.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:57.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:57.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:57.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:58.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:58.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:58.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:58.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:46:59.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:59.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:46:59.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:46:59.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:00.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:00.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:00.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:00.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:01.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:01.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:01.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:01.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:02.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:02.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:02.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:02.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:03.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:03.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:03.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:03.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:04.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:04.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:04.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:04.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:05.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:05.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:05.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:05.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:06.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:06.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:06.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:06.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:07.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:07.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:07.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:07.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:08.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:08.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:08.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:08.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:09.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:09.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:09.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:09.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:10.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:10.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:10.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:10.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:11.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:11.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:11.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:11.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:12.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:12.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:13.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:13.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:13.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:13.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:14.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:14.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:14.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:14.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:15.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:15.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:15.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:15.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:16.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:15.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:16.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:15.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:16.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:16.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:16.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:16.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:17.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:17.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:17.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:17.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:18.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:18.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:18.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:18.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:19.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:19.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:19.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:19.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:20.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:20.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:20.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:20.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:21.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:21.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:21.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:21.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:23.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:23.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:23.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:23.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:23.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:23.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:23.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:23.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:24.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:24.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:24.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:24.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:26.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:26.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:26.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:26.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:27.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:27.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:27.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:27.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:28.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:28.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:28.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:28.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:29.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:29.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:29.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:29.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:30.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:30.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:30.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:30.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:31.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:31.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:31.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:31.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:32.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:32.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:32.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:32.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:33.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:33.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:33.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:33.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:34.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:34.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:34.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:34.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:35.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:35.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:35.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:35.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:36.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:36.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:36.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:36.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:36.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:36.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:36.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:36.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:38.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:38.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:38.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:38.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:38.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:38.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:38.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:38.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:39.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:39.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:39.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:39.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:40.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:40.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:40.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:40.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:41.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:41.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:41.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:41.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:42.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:42.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:42.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:42.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:43.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:43.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:43.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:43.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:44.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:44.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:44.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:44.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:45.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:45.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:45.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:45.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:46.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:46.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:46.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:46.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:47.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:47.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:47.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:47.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:48.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:48.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:48.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:48.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:49.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:49.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:49.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:49.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:50.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:50.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:50.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:50.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:51.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:51.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:51.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:51.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:52.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:52.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:52.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:52.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:53.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:53.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:53.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:53.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:54.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:54.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:54.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:54.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:55.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:55.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:55.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:55.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:56.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:56.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:56.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:56.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:57.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:57.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:57.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:57.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:58.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:58.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:58.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:58.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:47:59.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:59.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:47:59.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:47:59.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:00.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:00.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:00.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:00.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:01.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:01.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:01.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:01.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:02.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:02.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:02.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:02.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:03.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:03.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:03.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:03.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:04.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:04.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:04.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:04.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:05.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:05.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:05.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:05.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:06.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:06.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:06.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:06.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:07.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:07.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:07.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:07.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:08.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:08.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:08.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:08.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:09.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:09.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:09.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:09.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:10.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:10.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:10.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:10.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:11.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:11.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:11.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:11.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:12.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:12.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:12.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:12.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:13.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:13.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:13.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:13.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:14.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:14.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:14.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:14.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:15.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:15.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:15.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:15.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:16.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:16.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:16.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:16.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:17.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:17.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:17.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:17.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:18.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:18.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:18.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:18.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:19.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:19.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:19.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:19.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:20.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:20.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:20.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:20.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:21.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:21.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:21.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:21.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:22.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:22.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:22.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:22.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:23.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:23.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:23.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:23.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:24.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:24.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:24.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:24.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:25.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:25.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:25.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:25.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:26.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:26.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:26.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:26.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:27.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:27.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:27.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:27.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:28.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:28.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:28.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:28.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:29.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:29.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:29.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:29.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:30.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:30.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:30.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:30.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:31.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:31.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:31.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:31.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:32.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:32.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:32.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:32.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:33.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:33.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:33.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:33.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:34.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:34.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:34.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:34.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:35.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:35.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:35.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:35.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:36.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:36.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:36.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:36.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:37.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:37.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:37.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:37.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:38.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:38.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:38.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:38.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:39.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:39.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:39.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:39.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:40.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:40.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:40.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:40.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:41.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:41.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:41.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:41.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:42.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:42.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:42.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:42.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:43.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:43.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:43.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:43.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:44.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:44.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:44.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:44.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:45.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:45.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:45.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:45.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:46.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:46.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:46.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:46.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:47.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:47.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:47.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:47.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:48.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:48.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:48.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:48.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:49.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:49.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:49.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:49.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:50.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:50.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:50.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:50.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:51.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:51.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:51.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:51.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:52.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:52.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:52.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:52.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:53.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:53.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:53.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:53.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:54.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:54.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:54.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:54.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:55.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:55.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:55.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:55.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:56.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:56.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:56.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:56.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:57.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:57.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:57.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:57.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:58.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:58.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:58.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:58.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:48:59.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:59.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:48:59.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:48:59.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:00.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:00.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:00.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:00.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:01.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:01.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:01.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:01.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:02.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:02.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:02.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:02.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:03.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:03.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:03.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:03.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:04.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:04.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:04.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:04.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:05.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:05.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:05.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:05.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:06.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:06.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:06.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:06.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:07.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:07.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:07.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:07.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:08.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:08.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:08.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:08.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:09.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:09.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:09.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:09.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:10.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:10.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:10.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:10.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:11.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:11.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:11.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:11.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:12.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:12.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:12.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:12.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:13.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:13.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:13.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:13.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:14.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:14.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:14.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:14.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:15.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:15.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:15.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:15.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:16.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:16.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:16.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:16.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:17.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:17.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:17.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:17.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:18.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:18.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:18.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:18.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:19.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:19.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:19.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:19.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:20.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:20.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:20.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:20.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:21.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:21.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:21.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:21.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:22.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:22.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:22.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:22.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:23.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:23.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:23.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:23.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:24.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:24.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:24.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:24.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:25.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:25.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:25.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:25.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:26.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:26.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:26.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:26.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:27.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:27.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:27.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:27.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:28.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:28.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:28.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:28.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:29.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:29.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:29.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:29.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:30.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:30.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:30.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:30.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:31.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:31.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:31.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:31.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:32.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:32.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:32.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:32.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:33.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:33.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:33.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:33.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:34.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:34.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:34.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:34.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:35.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:35.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:35.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:35.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:36.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:36.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:36.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:36.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:37.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:37.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:37.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:37.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:38.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:38.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:38.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:38.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:39.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:39.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:39.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:39.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:40.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:40.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:40.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:40.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:41.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:41.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:41.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:41.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:42.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:42.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:42.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:42.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:43.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:43.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:43.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:43.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:44.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:44.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:44.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:44.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:45.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:45.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:45.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:45.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:46.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:46.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:46.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:46.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:47.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:47.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:47.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:47.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:48.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:48.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:48.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:48.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:49.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:49.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:49.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:49.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:50.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:50.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:50.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:50.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:51.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:51.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:51.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:51.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:52.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:52.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:52.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:52.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:53.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:53.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:53.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:53.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:54.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:54.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:54.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:54.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:55.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:55.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:55.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:55.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:56.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:56.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:56.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:56.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:57.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:57.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:57.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:57.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:58.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:58.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:58.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:58.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:49:59.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:59.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:49:59.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:49:59.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:00.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:00.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:00.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:00.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:01.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:01.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:01.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:01.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:02.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:02.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:02.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:02.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:03.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:03.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:03.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:03.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:04.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:04.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:04.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:04.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:05.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:05.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:05.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:05.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:06.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:06.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:06.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:06.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:07.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:07.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:07.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:07.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:08.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:08.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:08.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:08.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:09.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:09.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:09.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:09.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:10.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:10.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:10.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:10.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:11.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:11.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:11.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:11.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:12.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:12.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:12.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:12.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:13.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:13.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:13.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:13.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:14.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:14.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:14.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:14.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:15.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:15.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:15.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:15.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:16.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:16.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:16.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:16.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:17.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:17.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:17.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:17.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:18.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:18.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:18.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:18.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:20.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:20.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:20.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:20.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:21.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:21.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:21.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:21.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:22.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:22.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:22.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:22.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:23.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:22.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:23.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:22.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:24.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:24.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:24.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:24.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:25.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:25.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:25.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:25.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:26.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:26.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:26.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:26.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:27.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:27.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:27.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:27.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:28.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:28.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:28.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:28.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:29.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:29.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:29.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:29.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:30.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:30.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:30.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:30.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:31.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:31.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:31.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:31.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:31.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:31.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:31.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:31.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:33.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:32.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:33.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:32.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:33.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:33.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:33.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:33.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:34.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:34.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:34.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:34.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:35.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:35.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:35.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:35.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:36.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:36.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:36.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:36.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:37.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:37.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:37.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:37.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:38.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:38.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:38.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:38.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:39.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:39.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:39.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:39.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:40.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:40.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:40.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:40.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:41.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:41.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:41.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:41.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:42.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:42.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:42.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:42.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:44.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:43.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:44.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:43.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:44.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:44.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:44.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:44.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:45.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:45.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:45.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:45.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:46.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:46.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:46.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:46.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:47.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:47.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:47.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:47.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:48.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:48.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:48.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:48.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:49.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:49.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:49.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:49.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:50.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:50.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:50.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:50.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:51.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:51.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:51.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:51.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:52.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:52.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:52.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:52.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:53.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:53.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:53.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:53.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:54.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:54.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:54.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:54.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:55.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:55.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:55.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:55.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:56.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:56.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:56.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:56.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:57.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:57.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:57.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:57.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:50:58.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:58.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:50:58.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:50:58.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:00.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:00.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:00.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:00.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:01.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:01.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:01.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:01.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:02.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:02.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:02.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:02.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:03.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:03.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:03.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:03.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:04.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:04.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:04.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:04.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:05.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:05.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:05.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:05.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:06.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:06.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:06.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:06.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:07.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:07.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:07.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:07.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:08.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:08.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:08.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:08.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:09.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:09.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:09.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:09.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:10.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:10.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:10.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:10.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:11.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:11.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:11.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:11.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:12.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:12.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:12.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:12.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:13.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:13.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:13.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:13.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:14.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:14.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:14.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:14.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:15.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:15.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:15.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:15.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:16.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:16.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:16.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:16.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:17.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:17.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:17.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:17.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:18.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:18.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:18.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:18.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:19.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:19.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:19.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:19.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:20.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:20.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:20.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:20.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:21.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:21.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:21.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:21.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:22.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:22.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:22.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:22.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:23.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:23.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:23.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:23.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:24.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:24.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:24.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:24.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:25.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:25.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:25.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:25.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:26.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:26.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:26.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:26.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:27.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:27.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:27.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:27.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:28.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:28.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:28.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:28.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:29.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:29.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:29.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:29.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:30.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:30.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:30.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:30.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:31.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:31.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:31.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:31.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:32.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:32.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:32.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:32.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:33.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:33.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:33.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:33.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:34.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:34.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:34.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:34.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:35.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:35.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:35.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:35.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:36.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:36.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:36.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:36.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:37.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:37.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:37.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:37.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:38.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:38.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:38.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:38.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:39.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:39.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:39.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:39.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:40.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:40.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:40.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:40.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:41.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:41.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:41.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:41.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:42.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:42.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:42.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:42.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:43.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:43.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:43.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:43.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:44.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:44.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:44.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:44.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:45.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:45.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:45.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:45.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:46.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:46.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:46.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:46.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:47.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:47.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:47.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:47.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:48.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:48.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:48.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:48.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:49.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:49.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:49.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:49.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:50.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:50.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:50.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:50.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:51.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:51.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:51.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:51.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:52.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:52.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:52.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:52.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:53.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:53.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:53.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:53.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:54.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:54.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:54.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:54.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:55.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:55.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:55.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:55.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:56.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:56.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:56.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:56.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:57.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:57.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:57.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:57.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:58.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:58.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:58.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:58.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:51:59.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:59.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:51:59.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:51:59.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:00.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:00.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:00.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:00.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:01.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:01.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:01.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:01.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:02.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:02.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:02.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:02.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:03.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:03.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:03.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:03.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:04.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:04.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:04.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:04.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:05.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:05.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:05.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:05.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:06.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:06.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:06.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:06.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:07.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:07.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:07.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:07.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:08.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:08.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:08.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:08.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:09.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:09.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:09.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:09.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:10.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:10.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:10.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:10.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:11.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:11.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:11.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:11.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:12.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:12.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:12.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:12.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:13.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:13.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:13.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:13.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:14.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:14.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:14.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:14.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:15.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:15.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:15.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:15.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:16.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:16.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:16.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:16.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:17.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:17.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:17.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:17.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:18.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:18.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:18.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:18.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 84 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:19.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:19.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:19.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:19.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:20.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:20.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:20.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:20.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:21.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:21.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:21.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:21.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:22.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:22.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:22.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:22.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:23.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:23.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:23.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:23.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:24.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:24.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:24.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:24.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:25.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:25.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:25.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:25.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:26.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:26.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:26.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:26.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:27.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:27.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:27.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:27.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:28.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:28.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:28.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:29.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:29.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:29.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:29.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:30.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:30.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:30.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:30.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:31.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:31.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:31.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:31.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:32.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:32.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:32.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:32.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:32.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:32.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:32.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:32.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:34.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:34.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:34.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:34.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:35.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:35.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:35.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:35.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:36.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:36.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:36.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:36.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:37.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:36.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:37.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:36.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:38.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:38.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:38.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:38.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:38.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:38.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:38.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:38.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:39.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:39.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:39.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:39.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:40.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:40.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:40.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:40.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:41.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:41.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:41.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:41.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:42.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:42.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:42.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:42.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:43.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:43.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:43.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:43.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:44.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:44.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:44.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:44.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:45.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:45.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:45.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:45.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:46.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:46.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:46.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:46.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:47.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:47.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:47.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:47.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:48.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:48.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:48.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:48.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:49.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:49.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:49.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:49.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:50.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:50.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:50.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:50.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:51.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:51.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:51.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:51.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:52.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:52.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:52.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:52.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:53.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:53.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:53.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:53.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:54.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:54.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:55.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:55.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:55.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:55.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:56.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:56.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:56.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:56.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:57.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:57.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:57.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:57.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:58.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:58.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:58.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:58.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:52:59.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:59.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:52:59.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:52:59.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:00.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:00.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:00.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:00.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:01.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:01.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:01.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:01.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:02.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:02.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:02.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:02.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:03.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:03.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:03.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:03.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:04.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:04.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:04.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:04.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:05.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:05.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:05.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:05.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:06.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:06.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:06.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:06.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:07.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:07.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:07.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:07.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:08.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:08.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:08.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:08.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:10.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:10.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:10.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:10.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:11.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:11.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:11.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:11.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:12.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:12.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:12.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:12.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:13.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:13.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:13.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:13.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:14.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:14.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:14.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:14.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:15.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:15.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:15.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:15.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:16.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:16.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:16.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:16.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:17.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:17.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:17.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:17.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:18.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:18.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:18.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:18.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:19.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:19.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:19.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:19.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:20.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:20.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:20.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:20.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:21.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:21.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:21.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:21.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:22.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:22.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:22.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:22.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:23.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:23.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:23.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:23.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:24.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:24.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:24.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:24.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:25.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:25.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:25.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:25.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:26.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:26.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:26.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:26.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:27.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:27.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:27.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:27.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:28.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:28.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:28.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:28.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:29.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:29.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:29.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:29.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:30.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:30.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:30.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:30.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:31.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:31.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:31.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:31.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:32.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:32.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:32.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:32.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:33.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:33.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:33.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:33.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:34.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:34.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:34.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:34.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:35.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:35.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:35.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:35.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:36.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:36.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:36.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:36.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:37.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:37.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:37.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:37.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:38.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:38.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:38.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:38.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:39.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:39.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:39.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:39.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:40.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:40.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:40.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:40.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:41.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:41.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:41.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:41.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:42.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:42.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:42.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:42.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:43.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:43.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:43.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:43.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:44.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:44.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:44.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:44.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:45.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:45.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:45.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:45.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:46.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:46.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:46.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:46.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:47.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:47.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:47.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:47.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:48.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:48.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:48.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:48.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:49.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:49.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:49.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:49.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:50.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:50.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:50.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:50.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:51.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:51.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:51.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:51.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:52.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:52.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:52.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:52.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:53.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:53.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:53.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:53.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:54.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:54.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:54.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:54.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:55.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:55.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:55.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:55.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:56.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:56.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:56.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:56.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:57.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:57.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:57.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:57.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:58.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:58.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:58.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:58.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:53:59.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:59.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:53:59.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:53:59.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:00.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:00.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:00.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:00.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:01.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:01.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:01.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:01.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:02.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:02.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:02.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:02.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:03.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:03.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:03.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:03.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:03.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:03.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:03.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:03.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:04.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:04.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:04.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:04.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:06.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:06.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:06.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:06.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:07.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:07.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:07.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:07.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:07.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:07.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:07.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:07.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:09.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:09.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:09.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:09.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:10.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:09.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:10.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:09.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:10.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:10.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:10.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:10.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:11.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:11.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:11.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:11.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:12.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:12.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:12.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:12.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:13.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:13.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:13.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:13.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:15.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:14.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:15.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:14.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:15.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:15.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:15.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:15.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:16.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:16.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:16.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:16.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:17.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:17.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:17.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:17.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:18.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:18.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:18.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:18.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:19.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:19.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:19.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:19.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:20.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:20.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:20.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:20.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:21.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:21.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:21.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:21.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:22.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:22.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:22.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:22.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:23.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:23.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:23.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:23.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:24.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:24.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:24.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:24.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:25.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:25.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:25.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:25.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:26.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:26.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:26.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:26.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:27.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:27.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:27.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:27.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:28.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:28.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:28.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:28.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:29.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:29.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:29.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:29.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:30.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:30.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:30.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:30.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:31.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:31.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:31.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:31.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:32.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:32.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:32.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:32.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:33.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:33.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:33.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:33.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:34.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:34.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:34.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:34.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:35.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:35.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:35.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:35.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:36.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:36.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:36.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:36.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:37.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:37.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:37.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:37.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:38.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:38.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:38.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:38.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:39.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:39.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:39.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:39.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:40.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:40.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:40.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:40.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:41.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:41.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:41.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:41.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:42.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:42.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:42.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:42.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:43.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:43.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:43.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:43.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:44.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:44.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:44.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:44.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:45.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:45.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:45.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:45.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:46.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:46.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:46.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:46.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:47.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:47.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:47.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:47.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:48.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:48.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:48.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:48.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:49.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:49.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:49.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:49.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:50.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:50.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:50.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:50.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:51.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:51.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:51.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:51.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:53.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:53.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:53.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:53.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:54.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:54.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:54.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:54.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:55.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:55.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:55.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:55.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:56.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:56.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:56.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:56.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:56.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:56.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:56.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:56.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:58.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:58.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:58.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:58.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:58.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:58.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:58.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:58.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:54:59.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:59.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:54:59.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:54:59.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:00.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:00.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:00.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:00.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:01.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:01.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:01.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:01.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:02.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:02.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:02.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:02.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:03.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:03.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:03.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:03.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:04.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:04.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:04.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:04.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:05.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:05.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:05.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:05.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:06.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:06.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:06.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:06.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:07.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:07.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:07.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:07.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:08.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:08.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:08.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:08.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:09.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:09.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:09.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:09.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:10.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:10.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:10.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:10.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:11.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:11.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:11.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:11.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:12.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:12.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:12.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:12.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:13.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:13.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:13.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:13.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:15.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:14.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:15.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:14.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:15.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:15.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:15.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:15.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:16.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:16.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:16.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:16.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:17.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:17.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:17.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:17.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:18.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:18.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:18.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:18.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:20.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:19.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:20.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:19.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:20.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:20.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:20.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:20.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:21.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:21.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:21.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:21.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:22.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:22.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:22.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:22.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:23.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:23.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:23.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:23.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:24.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:24.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:24.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:24.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:25.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:25.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:25.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:25.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:26.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:26.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:26.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:26.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:27.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:27.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:27.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:27.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:28.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:28.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:28.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:28.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:29.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:29.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:29.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:29.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:30.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:30.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:30.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:30.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:31.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:31.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:31.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:31.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:33.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:33.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:34.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:34.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:34.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:34.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:35.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:34.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:35.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:34.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:35.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:35.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:36.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:35.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:36.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:36.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:36.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:36.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:37.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:37.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:37.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:37.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:38.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:38.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:38.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:38.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:39.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:39.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:39.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:39.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:40.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:40.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:40.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:40.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:41.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:41.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:41.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:41.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:42.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:42.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:42.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:42.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:43.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:43.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:43.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:43.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:44.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:44.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:45.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:45.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:45.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:45.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:46.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:46.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:46.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:46.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:47.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:47.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:47.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:47.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:48.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:48.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:48.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:48.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:49.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:49.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:49.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:49.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:50.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:50.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:50.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:50.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:51.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:51.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:51.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:51.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:52.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:52.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:52.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:52.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:53.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:53.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:53.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:53.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:54.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:54.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:54.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:54.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:55.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:55.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:55.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:55.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:56.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:56.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:56.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:56.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:57.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:57.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:57.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:57.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:58.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:58.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:58.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:58.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:55:59.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:59.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:55:59.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:55:59.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:00.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:00.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:00.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:00.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:01.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:01.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:01.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:01.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:02.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:02.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:02.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:02.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:03.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:03.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:03.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:03.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:04.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:04.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:04.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:04.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:05.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:05.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:05.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:05.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:06.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:06.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:06.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:06.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:07.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:07.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:07.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:07.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:08.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:08.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:08.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:08.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:09.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:09.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:09.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:09.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:10.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:10.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:10.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:10.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:11.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:11.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:11.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:11.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:12.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:12.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:12.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:12.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:13.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:13.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:13.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:13.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:14.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:14.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:14.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:14.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:16.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:15.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:16.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:15.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:17.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:17.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:17.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:17.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:18.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:18.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:18.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:18.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:19.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:19.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:19.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:19.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:20.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:20.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:20.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:20.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:21.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:21.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:21.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:21.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:22.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:22.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:22.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:22.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:23.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:23.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:23.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:23.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:24.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:24.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:24.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:24.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:24.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:24.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:24.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:24.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:26.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:25.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:26.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:25.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:26.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:26.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:26.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:26.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:27.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:27.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:27.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:27.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:29.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:29.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:29.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:29.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:30.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:30.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:30.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:30.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:31.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:31.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:31.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:31.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:31.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:31.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:31.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:31.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:32.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:32.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:32.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:32.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:33.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:33.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:33.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:33.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:34.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:34.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:35.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:34.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:36.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:36.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:36.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:36.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:37.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:37.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:37.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:37.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:38.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:38.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:38.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:38.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:39.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:39.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:39.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:39.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:40.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:40.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:40.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:40.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:41.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:41.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:41.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:41.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:42.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:42.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:42.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:42.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:43.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:43.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:43.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:43.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:44.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:44.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:44.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:44.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:45.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:45.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:45.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:45.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:46.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:46.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:46.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:46.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:47.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:47.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:47.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:47.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:48.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:48.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:48.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:48.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:48.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:48.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:48.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:48.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:49.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:49.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:49.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:49.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:51.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:51.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:46:18.973702+0000 (oldest deadline 2019-10-23T10:46:38.973702+0000) 2019-10-23T10:56:51.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:51.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:52.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:52.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:52.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:52.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:53.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:53.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:54.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:54.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:55.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:55.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:56.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:56.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:57.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:57.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:58.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:58.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:56:59.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:56:59.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:00.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:00.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:02.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:02.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:03.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:03.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:04.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:04.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:05.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:05.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:06.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:06.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:07.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:07.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:07.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:07.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:09.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:09.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:09.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:09.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:10.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:10.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:11.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:11.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:12.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:12.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:13.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:13.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:13.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:13.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:14.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:14.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:14.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:14.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:15.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:15.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:15.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:15.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:16.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:16.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:16.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:16.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:17.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:17.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:17.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:17.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:18.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:18.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:18.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:18.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:19.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:19.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:19.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:19.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:20.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:20.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:20.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:20.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:21.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:21.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:21.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:21.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:22.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:22.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:22.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:22.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:23.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:23.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:23.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:23.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:24.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:24.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:24.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:24.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:25.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:25.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:25.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:25.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:26.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:26.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:26.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:26.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:27.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:27.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:27.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:27.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:28.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:28.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:28.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:28.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:29.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:29.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:29.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:29.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:30.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:30.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:30.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:30.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:31.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:31.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:31.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:31.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:32.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:32.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:32.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:32.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:33.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:33.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:33.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:33.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:34.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:34.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:34.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:34.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:35.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:35.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:35.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:35.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:36.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:36.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:36.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:36.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:37.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:37.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:37.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:37.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:38.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:38.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:38.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:38.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:39.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:39.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:39.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:39.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:40.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:40.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:40.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:40.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:41.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:41.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:41.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:41.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:42.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:42.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:42.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:42.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:43.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:43.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:43.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:43.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:44.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:44.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:44.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:44.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:45.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:45.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:46.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:46.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:46.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:46.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:47.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:47.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:47.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:47.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:48.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:48.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:48.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:48.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:49.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:49.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:49.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:49.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:50.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:50.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:50.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:50.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:51.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:51.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:51.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:51.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:52.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:52.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:52.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:52.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:53.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:53.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:53.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:53.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:54.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:54.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:54.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:54.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:55.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:55.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:55.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:55.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:56.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:56.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:56.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:56.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:57.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:57.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:57.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:57.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:58.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:58.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:58.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:58.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:57:59.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:59.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:57:59.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:57:59.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:00.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:00.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:00.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:00.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:01.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:01.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:01.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:01.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:02.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:02.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:02.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:02.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:03.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:03.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:03.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:03.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:04.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:04.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:04.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:04.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:05.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:05.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:05.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:05.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:06.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:06.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:06.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:06.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:07.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:07.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:07.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:07.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:08.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:08.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:08.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:08.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:09.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:09.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:09.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:09.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:10.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:10.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:10.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:10.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:11.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:11.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:11.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:11.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:12.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:12.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:12.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:12.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:13.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:13.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:13.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:13.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:14.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:14.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:14.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:14.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:15.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:15.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:15.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:15.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:16.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:16.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:16.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:16.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:17.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:17.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:17.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:17.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:18.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:18.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:18.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:18.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:19.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:19.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:19.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:19.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:20.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:20.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:20.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:20.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:21.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:21.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:21.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:21.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:22.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:22.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:22.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:22.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:23.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:23.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:23.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:23.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:24.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:24.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:24.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:24.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:25.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:25.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:25.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:25.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:26.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:26.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:26.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:26.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:27.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:27.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:27.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:27.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:28.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:28.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:28.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:28.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:29.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:29.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:29.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:29.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:30.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:30.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:30.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:30.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:31.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:31.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:31.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:31.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:32.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:32.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:32.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:32.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:33.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:33.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:33.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:33.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:34.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:34.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:34.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:34.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:35.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:35.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:35.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:35.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:36.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:36.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:36.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:36.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:37.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:37.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:37.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:37.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:38.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:38.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:38.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:38.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:39.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:39.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:39.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:39.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:40.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:40.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:40.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:40.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:41.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:41.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:41.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:41.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:42.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:42.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:42.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:42.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:43.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:43.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:43.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:43.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:44.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:44.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:44.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:44.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:45.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:45.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:45.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:45.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:46.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:46.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:46.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:46.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:47.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:47.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:47.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:47.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:48.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:48.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:48.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:48.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:49.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:49.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:49.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:49.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:50.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:50.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:50.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:50.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:51.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:51.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:51.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:51.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:52.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:52.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:52.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:52.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:53.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:53.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:53.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:53.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:54.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:54.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:54.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:54.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:55.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:55.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:55.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:55.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:56.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:56.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:56.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:56.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:57.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:57.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:57.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:57.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:58.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:58.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:58.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:58.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:58:59.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:59.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:58:59.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:58:59.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:00.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:00.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:00.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:00.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:01.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:01.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:01.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:01.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:02.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:02.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:02.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:02.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:03.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:03.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:03.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:03.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:04.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:04.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:04.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:04.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:05.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:05.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:05.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:05.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:06.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:06.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:06.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:06.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:07.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:07.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:07.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:07.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:08.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:08.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:08.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:08.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:09.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:09.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:09.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:09.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:10.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:10.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:10.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:10.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:11.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:11.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:11.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:11.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:12.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:12.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:12.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:12.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:13.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:13.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:13.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:13.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:14.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:14.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:14.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:14.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:15.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:15.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:15.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:15.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:16.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:16.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:16.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:16.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:17.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:17.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:17.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:17.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:18.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:18.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:18.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:18.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:19.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:19.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:19.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:19.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:20.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:20.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:20.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:20.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:21.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:21.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:21.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:21.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:22.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:22.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:22.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:22.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:23.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:23.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:23.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:23.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:24.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:24.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:24.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:24.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:25.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:25.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:25.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:25.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:26.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:26.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:26.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:26.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:27.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:27.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:27.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:27.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:28.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:28.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:28.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:28.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:29.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:29.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:29.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:29.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:30.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:30.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:30.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:30.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:31.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:31.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:31.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:31.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:32.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:32.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:32.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:32.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:33.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:33.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:33.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:33.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:34.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:34.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:34.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:34.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:35.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:35.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:35.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:35.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:36.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:36.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:36.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:36.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:37.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:37.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:37.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:37.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:38.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:38.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:38.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:38.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:39.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:39.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:39.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:39.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:40.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:40.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:40.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:40.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:41.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:41.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:41.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:41.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:43.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:43.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:43.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:43.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:43.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:43.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:43.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:43.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:44.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:44.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:44.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:44.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:46.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:46.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:46.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:46.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:46.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:46.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:46.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:46.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:47.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:47.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:47.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:47.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:48.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:48.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:48.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:48.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:49.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:49.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:49.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:49.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:50.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:50.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:50.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:50.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:51.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:51.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:51.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:51.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:52.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:52.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:52.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:52.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:53.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:53.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:53.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:53.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:54.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:54.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:54.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:54.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:55.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:55.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:55.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:55.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:56.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:56.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:56.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:56.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:57.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:57.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:57.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:57.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:58.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:58.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:58.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:58.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T10:59:59.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:59.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T10:59:59.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T10:59:59.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:00.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:00.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:00.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:00.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:01.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:01.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:01.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:01.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:02.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:02.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:02.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:02.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:03.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:03.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:03.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:03.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:05.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:05.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:05.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:05.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:06.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:06.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:06.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:06.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:06.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:06.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:06.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:06.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:07.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:07.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:07.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:07.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:08.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:08.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:08.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:08.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:09.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:09.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:09.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:09.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:10.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:10.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:10.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:10.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:11.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:11.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:11.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:11.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:13.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:13.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:13.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:13.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:14.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:14.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:14.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:14.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:15.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:15.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:15.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:15.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:16.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:16.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:16.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:16.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:17.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:17.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:17.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:17.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:18.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:18.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:18.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:18.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:18.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:18.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:18.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:18.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:19.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:19.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:19.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:19.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:20.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:20.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:20.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:20.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:22.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:22.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:22.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:22.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:23.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:23.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:23.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:23.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:24.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:24.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:24.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:24.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:25.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:25.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:25.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:25.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:26.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:26.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:26.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:26.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:27.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:27.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:27.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:27.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:28.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:28.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:28.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:28.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:29.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:29.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:29.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:29.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:30.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:30.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:30.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:30.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:31.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:31.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:31.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:31.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:32.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:32.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:32.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:32.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:33.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:33.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:33.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:33.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:34.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:34.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:34.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:34.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:35.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:35.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:35.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:35.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:36.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:36.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:36.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:36.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:37.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:37.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:37.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:37.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:38.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:38.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:38.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:38.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:39.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:39.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:39.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:39.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:40.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:40.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:40.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:40.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:41.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:41.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:41.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:41.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:42.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:42.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:42.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:42.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:43.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:43.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:43.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:43.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:44.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:44.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:44.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:44.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:45.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:45.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:45.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:45.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:46.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:46.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:46.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:46.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:47.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:47.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:47.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:47.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:48.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:48.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:48.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:48.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:49.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:49.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:49.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:49.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:50.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:50.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:50.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:50.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:51.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:51.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:51.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:51.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:52.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:52.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:52.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:52.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:52.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:52.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:52.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:52.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:53.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:53.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:53.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:53.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:55.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:54.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:55.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:54.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:56.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:56.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:56.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:56.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:57.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:57.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:57.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:57.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:58.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:58.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:58.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:58.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:00:59.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:59.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:00:59.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:00:59.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:00.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:00.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:00.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:00.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:01.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:01.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:01.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:01.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:02.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:02.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:02.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:02.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:03.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:03.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:03.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:03.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:04.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:04.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:04.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:04.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:05.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:05.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:05.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:05.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:06.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:06.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:06.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:06.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:07.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:07.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:07.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:07.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:08.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:08.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:08.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:08.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:09.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:09.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:09.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:09.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:10.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:10.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:10.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:10.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:11.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:11.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:11.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:11.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:12.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:12.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:12.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:12.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:13.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:13.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:13.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:13.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:14.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:14.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:14.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:14.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:15.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:15.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:15.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:15.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:16.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:16.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:16.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:16.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:17.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:17.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:17.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:17.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:18.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:18.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:18.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:18.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:19.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:19.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:19.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:19.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:20.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:20.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:20.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:20.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:21.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:21.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:21.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:21.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:22.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:22.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:22.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:22.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:23.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:23.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:23.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:23.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:24.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:24.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:24.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:24.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:25.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:25.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:25.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:25.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:26.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:26.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:26.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:26.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:27.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:27.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:27.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:27.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:28.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:28.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:28.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:28.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:29.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:29.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:29.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:29.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:30.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:30.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:30.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:30.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:31.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:31.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:31.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:31.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:32.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:32.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:32.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:32.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:33.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:33.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:33.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:33.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:34.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:34.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:34.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:34.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:35.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:35.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:35.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:35.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:36.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:36.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:36.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:36.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:37.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:37.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:37.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:37.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:38.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:38.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:38.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:38.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:39.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:39.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:39.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:39.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:40.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:40.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:40.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:40.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:41.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:41.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:41.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:41.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:42.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:42.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:42.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:42.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:43.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:43.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:43.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:43.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:44.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:44.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:44.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:44.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:45.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:45.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:45.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:45.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:46.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:46.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:46.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:46.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:47.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:47.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:47.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:47.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:48.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:48.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:48.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:48.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:49.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:49.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:49.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:49.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:50.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:50.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:50.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:50.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:51.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:51.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:51.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:51.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:52.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:52.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:52.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:52.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:53.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:53.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:53.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:53.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:54.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:54.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:54.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:54.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:55.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:55.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:55.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:55.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:56.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:56.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:56.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:56.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:57.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:57.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:57.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:57.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:58.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:58.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:58.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:58.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:01:59.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:59.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:01:59.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:01:59.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:00.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:00.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:00.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:00.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:01.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:01.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:01.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:01.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:02.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:02.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:02.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:02.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:03.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:03.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:03.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:03.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:04.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:04.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:04.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:04.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:05.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:05.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:05.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:05.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:06.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:06.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:06.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:06.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:07.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:07.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:07.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:07.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:08.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:08.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:08.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:08.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:09.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:09.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:09.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:09.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:09.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:09.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:09.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:09.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:10.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:10.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:10.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:10.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:11.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:11.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:11.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:11.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:12.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:12.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:12.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:12.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:13.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:13.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:13.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:13.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:14.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:14.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:14.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:14.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:16.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:16.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:16.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:16.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:16.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:16.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:16.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:16.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:18.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:18.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:18.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:18.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:19.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:19.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:19.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:19.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:20.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:20.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:20.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:20.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:21.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:21.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:21.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:21.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:22.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:22.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:22.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:22.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:23.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:23.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:23.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:23.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:24.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:24.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:24.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:24.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:25.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:25.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:25.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:25.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:26.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:26.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:26.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:26.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:27.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:27.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:27.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:27.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:28.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:28.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:28.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:28.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:29.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:29.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:29.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:29.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:30.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:30.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:30.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:30.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:31.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:31.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:31.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:31.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:32.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:32.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:32.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:32.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:33.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:33.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:33.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:33.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:34.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:34.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:34.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:34.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:35.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:35.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:35.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:35.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:36.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:36.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:36.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:36.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:37.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:37.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:37.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:37.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:38.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:38.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:38.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:38.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:39.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:39.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:39.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:39.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:40.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:40.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:40.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:40.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:41.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:41.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:41.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:41.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:42.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:42.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:42.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:42.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:43.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:43.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:43.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:43.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:44.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:44.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:44.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:44.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:45.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:45.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:45.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:45.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:46.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:46.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:46.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:46.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:47.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:47.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:47.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:47.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:48.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:48.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:48.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:48.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:49.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:49.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:49.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:49.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:50.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:50.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:50.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:50.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:51.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:51.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:51.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:51.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:52.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:52.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:52.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:52.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:53.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:53.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:53.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:53.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:54.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:54.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:54.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:54.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:55.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:55.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:55.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:55.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:56.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:56.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:56.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:56.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:57.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:57.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:57.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:57.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:58.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:58.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:58.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:58.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:02:59.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:59.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:02:59.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:02:59.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:00.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:00.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:00.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:00.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:01.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:01.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:01.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:01.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:02.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:02.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:02.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:02.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:03.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:03.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:03.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:03.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:04.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:04.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:04.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:04.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:05.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:05.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:05.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:05.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:06.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:06.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:06.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:06.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:07.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:07.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:07.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:07.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:08.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:08.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:08.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:08.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:09.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:09.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:09.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:09.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:10.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:10.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:10.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:10.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:11.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:11.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:11.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:11.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:12.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:12.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:12.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:12.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:13.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:13.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:13.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:13.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:14.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:14.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:14.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:14.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:15.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:15.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:15.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:15.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:16.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:16.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:16.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:16.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:17.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:17.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:17.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:17.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:18.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:18.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:18.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:18.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:19.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:19.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:19.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:19.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:20.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:20.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:20.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:20.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:21.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:21.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:21.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:21.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:22.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:22.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:22.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:22.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:23.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:23.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:23.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:23.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:24.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:24.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:24.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:24.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:25.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:25.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:25.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:25.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:26.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:26.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:26.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:26.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:27.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:27.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:27.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:27.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:28.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:28.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:28.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:28.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:29.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:29.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:29.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:29.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:30.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:30.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:30.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:30.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:31.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:31.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:31.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:31.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:32.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:32.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:32.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:32.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:33.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:33.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:33.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:33.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:34.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:34.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:34.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:34.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:35.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:35.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:35.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:35.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:36.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:36.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:36.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:36.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:37.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:37.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:37.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:37.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:38.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:38.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:38.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:38.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:39.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:39.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:39.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:39.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:40.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:40.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:40.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:40.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:41.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:41.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:41.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:41.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:42.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:42.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:42.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:42.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:43.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:43.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:43.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:43.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:44.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:44.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:44.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:44.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:45.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:45.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:46.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:46.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:46.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:46.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:47.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:47.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:47.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:47.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:48.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:48.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:48.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:48.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:49.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:49.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:49.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:49.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:50.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:50.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:50.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:50.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:51.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:51.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:51.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:51.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:52.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:52.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:52.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:52.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:53.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:53.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:53.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:53.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:54.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:54.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:54.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:54.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:55.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:55.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:55.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:55.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:56.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:56.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:56.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:56.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:57.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:57.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:57.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:57.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:58.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:58.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:58.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:58.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:03:59.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:59.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:03:59.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:03:59.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:00.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:00.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:00.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:00.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:01.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:01.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:01.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:01.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:02.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:02.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:02.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:02.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:03.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:03.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:03.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:03.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:04.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:04.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:04.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:04.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:05.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:05.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:05.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:05.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:06.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:06.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:06.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:06.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:07.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:07.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:07.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:07.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:08.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:08.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:08.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:08.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:09.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:09.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:09.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:09.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:10.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:10.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:10.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:10.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:11.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:11.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:11.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:11.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:12.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:12.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:12.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:12.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:13.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:13.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:13.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:13.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:14.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:14.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:14.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:14.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:15.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:15.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:15.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:15.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:16.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:16.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:16.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:16.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:17.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:17.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:17.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:17.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:18.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:18.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:18.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:18.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:19.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:19.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:19.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:19.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:20.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:20.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:20.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:20.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:21.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:21.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:21.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:21.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:22.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:22.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:22.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:22.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:23.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:23.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:23.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:23.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:24.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:24.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:24.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:24.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:25.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:25.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:25.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:25.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:26.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:26.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:26.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:26.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:27.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:27.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:27.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:27.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:28.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:28.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:28.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:28.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:29.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:29.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:29.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:29.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:30.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:30.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:30.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:30.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:31.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:31.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:31.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:31.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:32.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:32.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:32.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:32.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:33.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:33.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:33.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:33.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:34.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:34.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:34.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:34.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:35.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:35.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:35.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:35.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:36.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:36.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:36.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:36.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:37.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:37.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:37.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:37.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:38.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:38.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:38.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:38.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:38.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:38.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:38.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:38.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:40.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:40.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:40.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:40.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:41.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:41.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:41.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:41.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:42.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:42.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:42.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:42.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:43.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:43.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:43.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:43.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:44.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:44.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:44.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:44.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:45.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:45.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:45.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:45.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:45.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:45.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:45.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:45.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:47.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:47.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:47.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:47.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:48.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:48.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:48.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:48.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:49.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:49.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:49.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:49.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:50.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:50.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:50.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:50.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:50.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:50.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:50.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:50.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:51.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:51.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:51.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:51.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:52.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:52.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:52.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:52.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:53.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:53.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:53.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:53.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:54.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:54.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:54.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:54.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:56.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:56.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:56.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:56.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:57.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:57.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:57.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:57.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:58.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:58.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:58.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:58.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:04:59.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:59.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:04:59.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:04:59.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:00.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:00.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:00.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:00.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:01.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:01.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:01.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:01.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:02.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:02.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:02.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:02.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:03.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:03.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:03.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:03.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:04.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:04.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:04.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:04.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:05.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:05.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:05.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:05.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:06.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:06.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:06.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:06.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:07.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:07.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:07.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:07.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:08.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:08.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:08.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:08.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:09.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:09.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:09.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:09.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:10.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:10.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:10.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:10.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:10.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:10.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:10.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:10.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:11.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:11.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:11.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:11.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:12.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:12.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:12.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:12.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:13.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:13.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:13.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:13.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:14.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:14.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:14.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:14.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:15.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:15.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:15.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:15.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:16.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:16.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:16.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:16.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:17.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:17.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:17.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:17.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:18.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:18.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:18.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:18.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:19.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:19.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:19.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:19.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:21.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:21.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:21.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:21.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:21.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:21.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:21.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:21.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:22.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:22.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:22.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:22.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:23.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:23.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:23.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:23.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:24.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:24.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:24.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:24.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:26.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:26.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:26.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:26.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:26.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:26.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:26.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:26.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:28.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:28.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:28.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:28.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:29.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:29.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:29.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:29.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:30.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:30.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:30.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:30.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:31.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:31.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:31.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:31.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:32.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:32.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:32.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:32.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:33.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:33.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:33.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:33.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:34.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:34.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:34.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:34.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:34.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:34.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:34.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:34.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:35.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:35.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:35.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:35.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:36.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:36.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:36.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:36.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:37.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:37.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:37.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:37.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:38.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:38.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:38.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:38.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:39.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:39.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:39.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:39.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:40.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:40.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:40.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:40.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:41.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:41.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:41.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:41.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:42.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:42.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:42.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:42.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:43.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:43.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:43.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:43.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:44.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:44.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:44.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:44.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:45.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:45.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:45.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:45.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:46.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:46.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:46.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:46.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:47.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:47.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:47.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:47.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:48.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:48.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:48.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:48.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:49.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:49.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:49.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:49.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:50.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:50.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:50.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:50.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:51.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:51.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:51.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:51.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:52.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:52.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:52.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:52.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:53.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:53.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:53.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:53.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:54.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:54.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:54.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:54.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:55.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:55.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:55.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:55.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:56.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:56.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:56.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:56.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:57.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:57.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:57.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:57.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:58.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:58.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:58.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:58.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:05:59.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:59.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:05:59.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:05:59.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:00.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:00.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:00.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:00.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:01.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:01.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:01.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:01.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:02.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:02.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:02.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:02.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:03.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:03.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:03.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:03.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:04.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:04.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:04.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:04.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:05.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:05.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:05.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:05.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:07.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:06.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:07.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:06.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:08.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:08.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:08.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:08.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:09.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:09.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:09.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:09.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:10.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:10.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:10.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:10.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:11.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:11.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:11.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:11.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:12.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:12.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:12.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:12.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:13.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:13.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:13.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:13.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:14.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:14.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:14.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:14.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:15.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:15.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:15.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:15.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:16.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:16.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:16.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:16.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:17.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:17.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:17.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:17.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:18.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:18.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:18.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:18.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:19.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:19.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:19.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:19.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:20.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:20.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:20.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:20.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:21.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:21.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:21.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:21.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:22.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:22.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:22.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:22.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:23.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:23.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:23.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:23.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:24.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:24.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:24.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:24.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:25.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:25.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:25.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:25.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:26.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:26.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:26.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:26.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:27.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:27.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:27.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:27.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:28.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:28.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:28.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:28.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:29.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:29.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:29.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:29.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:30.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:30.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:30.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:30.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:31.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:31.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:31.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:31.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:32.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:32.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:32.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:32.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:33.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:33.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:33.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:33.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:34.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:34.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:34.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:34.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:35.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:35.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:35.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:35.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:36.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:36.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:36.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:36.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:37.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:37.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:37.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:37.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:38.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:38.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:38.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:38.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:39.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:39.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:39.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:39.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:40.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:40.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:40.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:40.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:41.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:41.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:41.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:41.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:42.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:42.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:42.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:42.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:43.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:43.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:43.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:43.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:44.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:44.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:44.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:44.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:45.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:45.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:45.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:45.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:46.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:46.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:46.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:46.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:47.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:47.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:47.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:47.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:48.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:48.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:48.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:48.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:49.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:49.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:49.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:49.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:50.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:50.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:50.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:50.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:51.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:51.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:51.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:51.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:52.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:52.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:52.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:52.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:53.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:53.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:53.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:53.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:54.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:54.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:54.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:54.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:55.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:55.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:55.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:55.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:56.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:56.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:56.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:56.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:57.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:57.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:57.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:57.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:58.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:58.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:58.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:58.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:06:59.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:59.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:06:59.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:06:59.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:00.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:00.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:00.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:00.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:01.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:01.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:01.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:01.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:02.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:02.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:02.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:02.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:03.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:03.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:03.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:03.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:04.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:04.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:04.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:04.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:05.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:05.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:05.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:05.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:06.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:06.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:06.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:06.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:07.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:07.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:07.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:07.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:08.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:08.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:08.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:08.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:09.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:09.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:09.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:09.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:10.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:10.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:10.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:10.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:11.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:11.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:11.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:11.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:12.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:12.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:12.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:12.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:13.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:13.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:13.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:13.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:14.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:14.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:14.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:14.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:15.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:15.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:15.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:15.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:16.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:16.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:16.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:16.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:17.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:17.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:17.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:17.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:18.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:18.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:18.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:18.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:19.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:19.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:19.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:19.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:20.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:20.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:20.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:20.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:21.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:21.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:21.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:21.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:22.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:22.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:22.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:22.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:23.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:23.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:23.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:23.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:24.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:24.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:24.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:24.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:25.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:25.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T10:56:53.800590+0000 (oldest deadline 2019-10-23T10:57:13.800590+0000) 2019-10-23T11:07:25.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:25.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:26.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:26.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:27.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:27.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:28.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:28.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:29.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:29.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:30.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:30.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:31.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:31.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:32.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:32.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:33.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:33.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:34.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:34.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:35.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:35.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:36.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:36.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:37.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:37.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:38.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:38.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:39.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:39.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:40.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:40.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:41.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:41.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:42.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:42.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:43.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:43.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:44.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:44.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:45.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:45.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:46.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:46.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:47.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:47.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:48.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:48.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:48.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:48.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:49.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:49.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:49.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:49.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:50.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:50.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:50.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:50.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:51.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:51.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:51.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:51.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:52.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:52.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:52.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:52.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:53.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:53.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:53.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:53.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:54.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:54.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:54.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:54.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:55.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:55.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:55.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:55.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:56.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:56.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:56.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:56.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:57.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:57.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:57.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:57.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:58.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:58.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:58.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:58.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:07:59.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:59.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:07:59.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:07:59.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:00.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:00.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:00.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:00.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:01.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:01.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:01.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:01.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:02.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:02.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:02.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:02.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:02.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:02.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:02.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:02.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:03.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:03.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:03.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:03.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:04.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:04.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:04.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:04.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:05.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:05.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:05.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:05.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:06.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:06.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:06.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:06.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:07.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:07.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:07.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:07.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:09.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:09.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:09.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:09.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:10.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:10.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:10.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:10.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:11.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:11.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:11.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:11.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:12.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:12.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:12.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:12.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:13.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:13.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:13.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:13.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:14.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:14.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:14.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:14.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:15.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:15.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:15.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:15.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:16.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:16.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:16.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:16.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:17.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:17.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:17.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:17.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:17.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:17.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:17.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:17.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:19.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:18.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:19.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:18.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:19.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:19.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:19.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:19.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:21.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:21.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:21.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:21.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:22.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:22.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:22.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:22.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:23.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:22.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:23.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:22.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:24.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:24.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:24.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:24.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:24.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:24.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:24.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:24.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:26.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:26.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:26.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:26.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:26.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:26.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:26.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:26.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:27.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:27.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:27.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:27.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:29.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:29.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:29.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:29.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:30.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:30.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:30.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:30.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:31.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:31.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:31.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:31.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:32.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:32.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:32.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:32.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:33.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:33.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:33.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:33.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:34.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:34.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:34.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:34.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:35.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:35.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:35.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:35.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:36.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:36.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:36.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:36.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:37.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:37.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:37.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:37.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:38.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:38.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:38.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:38.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:39.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:39.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:39.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:39.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:40.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:40.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:40.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:40.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:41.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:41.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:41.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:41.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:42.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:42.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:42.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:42.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:43.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:43.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:43.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:43.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:44.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:44.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:44.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:44.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:45.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:45.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:45.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:45.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:46.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:46.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:46.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:46.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:47.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:47.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:47.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:47.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:48.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:48.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:48.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:48.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:49.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:49.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:49.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:49.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:50.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:50.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:50.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:50.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:51.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:51.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:51.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:51.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:52.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:52.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:52.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:52.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:53.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:53.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:53.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:53.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:54.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:54.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:54.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:54.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:55.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:55.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:55.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:55.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:56.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:56.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:56.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:56.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:57.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:57.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:57.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:57.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:58.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:58.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:58.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:58.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:08:59.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:59.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:08:59.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:08:59.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:00.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:00.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:00.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:00.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:01.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:01.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:01.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:01.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:02.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:02.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:02.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:02.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:03.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:03.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:03.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:03.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:04.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:04.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:04.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:04.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:05.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:05.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:05.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:05.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:06.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:06.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:06.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:06.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:07.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:07.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:07.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:07.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:08.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:08.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:08.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:08.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:09.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:09.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:09.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:09.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:10.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:10.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:10.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:10.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:11.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:11.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:11.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:11.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:12.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:12.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:12.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:12.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:13.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:13.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:13.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:13.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:14.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:14.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:14.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:14.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:15.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:15.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:15.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:15.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:16.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:16.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:16.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:16.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:17.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:17.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:17.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:17.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:18.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:18.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:18.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:18.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:19.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:19.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:19.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:19.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:20.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:20.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:20.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:20.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:21.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:21.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:21.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:21.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:22.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:22.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:22.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:22.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:23.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:23.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:23.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:23.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:24.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:24.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:24.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:24.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:25.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:25.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:25.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:25.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:25.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:25.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:25.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:25.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:27.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:27.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:27.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:27.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:28.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:28.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:28.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:28.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:29.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:29.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:29.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:29.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:29.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:29.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:29.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:29.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:30.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:30.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:30.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:30.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:31.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:31.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:31.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:31.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:32.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:32.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:32.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:32.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:33.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:33.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:33.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:33.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:34.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:34.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:34.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:34.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:35.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:35.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:35.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:35.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:36.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:36.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:36.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:36.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:37.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:37.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:37.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:37.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:38.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:38.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:38.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:38.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:39.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:39.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:39.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:39.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:40.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:40.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:40.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:40.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:41.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:41.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:41.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:41.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:42.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:42.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:42.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:42.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:43.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:43.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:43.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:43.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:44.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:44.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:44.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:44.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:45.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:45.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:45.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:45.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:46.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:46.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:46.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:46.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:47.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:47.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:47.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:47.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:48.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:48.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:48.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:48.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:49.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:49.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:49.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:49.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:50.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:50.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:50.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:50.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:51.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:51.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:51.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:51.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:53.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:53.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:53.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:53.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:54.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:54.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:54.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:54.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:55.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:55.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:55.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:55.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:56.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:56.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:56.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:56.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:57.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:57.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:57.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:57.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:58.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:58.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:58.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:58.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:09:59.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:59.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:09:59.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:09:59.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:00.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:00.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:00.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:00.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:01.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:01.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:01.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:01.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:02.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:02.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:02.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:02.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:03.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:03.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:03.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:03.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:04.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:04.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:04.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:04.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:05.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:05.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:05.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:05.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:06.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:06.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:06.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:06.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:07.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:07.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:07.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:07.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:08.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:08.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:08.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:08.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:09.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:09.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:09.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:09.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:10.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:10.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:10.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:10.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:11.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:11.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:11.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:11.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:12.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:12.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:12.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:12.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:13.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:13.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:13.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:13.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:14.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:14.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:14.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:14.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:15.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:15.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:15.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:15.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:16.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:16.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:16.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:16.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:17.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:17.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:17.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:17.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:18.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:18.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:18.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:18.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:19.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:19.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:19.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:19.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:19.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:19.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:19.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:19.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:21.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:21.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:21.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:21.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:21.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:21.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:23.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:23.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:23.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:23.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:24.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:24.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:24.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:24.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:25.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:25.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:25.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:25.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:26.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:26.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:26.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:26.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:27.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:27.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:27.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:27.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:28.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:28.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:28.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:28.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:29.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:29.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:29.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:29.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:30.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:30.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:30.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:30.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:31.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:31.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:31.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:31.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:32.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:32.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:32.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:32.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:33.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:33.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:33.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:33.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:34.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:34.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:34.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:34.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:35.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:35.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:35.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:35.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:36.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:36.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:36.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:36.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:37.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:37.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:37.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:37.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:38.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:38.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:38.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:38.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:39.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:39.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:39.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:39.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:40.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:40.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:40.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:41.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:41.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:41.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:41.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:42.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:42.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:42.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:42.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:42.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:42.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:42.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:42.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:43.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:43.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:43.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:43.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:45.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:45.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:45.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:45.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:46.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:46.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:46.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:46.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:47.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:47.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:47.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:47.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:48.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:48.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:48.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:48.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:49.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:49.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:49.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:49.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:50.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:50.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:50.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:50.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:51.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:51.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:51.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:51.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:52.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:52.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:52.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:52.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:53.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:53.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:53.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:53.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:54.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:54.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:54.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:54.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:55.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:55.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:55.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:55.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:56.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:56.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:56.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:56.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:57.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:57.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:57.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:57.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:58.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:58.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:58.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:58.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:10:59.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:59.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:10:59.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:10:59.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:00.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:00.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:00.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:00.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:01.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:01.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:01.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:01.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:02.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:02.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:02.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:02.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:03.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:03.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:03.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:03.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:04.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:04.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:04.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:04.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:05.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:05.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:05.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:05.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:06.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:06.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:06.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:06.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:07.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:07.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:07.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:07.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:08.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:08.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:08.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:08.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:09.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:09.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:09.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:09.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:10.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:10.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:10.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:10.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:11.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:11.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:11.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:11.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:12.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:12.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:12.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:12.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:13.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:13.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:13.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:13.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:14.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:14.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:14.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:14.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:15.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:15.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:15.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:15.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:15.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:15.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:15.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:15.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:16.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:16.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:16.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:16.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:17.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:17.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:17.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:17.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:18.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:18.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:18.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:18.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:19.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:19.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:19.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:19.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:21.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:20.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:21.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:20.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:22.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:22.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:22.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:22.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:23.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:23.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:23.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:23.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:24.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:24.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:24.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:24.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:25.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:25.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:25.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:25.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:26.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:26.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:26.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:26.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:27.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:27.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:27.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:27.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:28.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:28.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:28.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:28.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:29.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:29.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:29.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:29.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:30.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:30.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:30.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:30.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:31.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:31.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:31.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:31.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:32.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:32.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:32.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:32.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:33.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:33.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:33.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:33.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:34.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:34.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:34.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:34.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:34.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:34.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:34.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:34.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:35.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:35.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:35.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:35.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:36.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:36.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:36.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:36.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:38.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:38.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:38.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:38.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:39.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:39.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:39.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:39.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:40.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:40.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:40.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:40.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:41.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:41.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:41.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:41.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:42.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:42.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:42.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:42.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:43.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:43.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:43.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:43.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:44.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:44.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:44.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:44.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:45.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:45.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:45.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:45.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:46.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:46.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:46.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:46.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:47.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:47.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:47.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:47.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:48.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:48.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:48.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:48.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:49.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:49.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:49.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:49.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:50.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:50.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:50.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:50.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:51.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:51.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:51.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:51.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:52.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:52.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:52.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:52.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:53.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:53.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:53.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:53.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:54.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:54.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:54.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:54.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:55.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:55.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:55.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:55.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:56.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:56.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:56.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:56.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:57.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:57.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:57.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:57.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:58.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:58.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:58.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:58.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:11:59.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:59.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:11:59.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:11:59.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:00.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:00.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:00.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:00.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:01.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:01.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:01.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:01.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:02.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:02.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:02.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:02.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:03.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:03.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:03.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:03.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:04.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:04.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:04.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:04.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:05.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:05.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:05.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:05.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:06.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:06.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:06.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:06.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:07.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:07.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:07.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:07.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:07.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:07.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:07.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:07.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:08.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:08.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:08.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:08.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:09.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:09.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:09.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:09.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:10.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:10.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:10.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:10.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:11.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:11.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:11.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:11.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:12.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:12.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:12.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:12.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:13.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:13.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:13.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:13.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:14.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:14.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:14.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:14.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:15.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:15.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:15.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:15.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:16.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:16.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:16.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:16.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:17.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:17.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:17.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:17.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:18.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:18.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:18.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:18.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:19.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:19.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:19.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:19.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:20.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:20.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:20.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:20.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:21.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:21.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:21.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:21.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:22.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:22.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:22.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:22.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:23.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:23.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:23.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:23.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:24.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:24.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:24.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:24.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:25.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:25.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:25.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:25.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:26.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:26.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:26.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:26.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:27.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:27.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:27.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:27.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:28.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:28.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:28.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:28.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:29.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:29.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:29.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:29.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:30.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:30.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:30.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:30.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:31.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:31.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:31.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:31.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:32.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:32.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:32.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:32.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:33.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:33.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:33.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:33.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:34.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:34.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:34.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:34.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:35.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:35.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:35.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:35.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:36.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:36.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:36.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:36.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:37.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:37.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:37.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:37.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:38.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:38.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:38.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:38.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:39.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:39.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:39.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:39.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:40.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:40.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:40.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:40.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:41.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:41.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:41.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:41.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:42.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:42.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:42.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:42.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:43.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:43.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:43.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:43.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:44.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:44.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:44.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:44.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:45.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:45.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:45.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:45.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:46.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:46.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:46.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:46.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:47.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:47.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:47.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:47.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:48.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:48.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:48.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:48.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:49.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:49.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:49.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:49.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:50.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:50.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:50.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:50.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:51.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:51.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:51.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:51.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:52.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:52.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:52.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:52.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:53.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:53.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:53.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:53.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:54.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:54.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:54.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:54.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:55.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:55.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:55.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:55.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:56.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:56.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:56.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:56.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:57.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:57.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:57.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:57.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:58.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:58.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:58.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:58.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:12:59.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:59.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:12:59.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:12:59.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:00.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:00.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:00.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:00.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:01.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:01.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:01.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:01.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:02.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:02.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:02.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:02.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:03.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:03.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:03.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:03.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:04.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:04.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:04.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:04.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:05.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:05.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:05.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:05.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:06.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:06.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:06.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:06.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:07.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:07.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:07.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:07.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:08.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:08.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:08.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:08.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:09.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:09.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:09.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:09.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:10.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:10.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:10.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:10.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:11.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:11.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:11.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:11.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:12.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:12.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:12.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:12.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:13.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:13.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:13.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:13.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:14.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:14.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:14.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:14.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:15.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:15.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:15.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:15.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:16.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:16.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:16.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:16.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:17.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:17.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:17.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:17.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:18.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:18.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:19.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:19.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:19.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:19.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:20.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:20.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:20.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:20.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:21.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:21.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:21.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:21.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:22.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:22.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:22.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:22.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:23.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:23.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:23.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:23.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:24.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:24.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:24.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:24.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:25.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:25.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:25.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:25.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:26.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:26.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:26.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:26.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:27.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:27.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:27.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:27.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:28.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:28.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:28.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:28.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:30.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:30.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:30.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:30.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:30.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:30.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:30.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:30.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:31.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:31.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:31.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:31.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:32.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:32.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:32.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:32.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:33.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:33.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:33.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:33.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:34.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:34.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:34.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:34.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:35.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:35.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:35.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:35.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:36.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:36.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:36.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:36.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:37.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:37.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:38.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:38.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:38.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:38.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:39.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:39.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:39.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:39.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:40.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:40.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:40.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:40.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:42.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:42.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:42.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:42.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:43.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:43.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:43.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:43.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:44.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:44.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:44.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:44.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:44.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:44.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:44.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:44.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:46.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:46.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:46.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:46.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:47.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:47.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:47.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:47.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:48.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:48.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:48.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:48.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:49.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:48.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:49.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:48.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:50.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:50.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:50.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:50.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:51.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:50.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:51.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:50.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:51.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:51.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:51.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:51.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:52.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:52.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:52.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:52.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:53.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:53.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:54.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:54.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:54.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:54.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:55.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:55.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:55.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:55.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:56.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:56.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:56.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:56.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:57.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:57.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:57.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:57.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:58.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:58.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:58.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:58.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:13:59.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:59.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:13:59.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:13:59.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:00.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:00.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:00.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:00.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:01.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:01.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:01.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:01.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:02.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:02.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:02.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:02.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:03.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:03.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:03.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:03.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:04.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:04.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:04.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:04.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:05.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:05.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:05.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:05.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:06.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:06.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:06.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:06.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:07.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:07.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:07.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:07.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:08.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:08.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:08.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:08.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:09.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:09.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:09.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:09.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:10.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:10.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:10.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:10.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:11.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:11.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:11.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:11.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:12.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:12.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:12.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:12.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:13.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:13.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:13.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:13.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:15.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:15.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:15.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:15.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:16.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:16.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:16.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:16.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:17.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:17.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:17.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:17.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:18.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:18.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:18.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:18.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:19.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:19.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:19.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:19.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:20.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:20.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:20.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:20.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:21.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:21.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:21.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:21.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:22.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:22.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:22.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:22.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:22.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:22.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:22.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:22.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:23.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:23.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:23.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:23.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:24.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:24.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:24.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:24.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:25.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:25.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:25.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:25.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:26.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:26.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:26.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:26.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:27.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:27.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:27.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:27.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:28.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:28.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:28.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:28.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:29.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:29.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:29.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:29.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:30.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:30.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:30.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:30.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:32.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:32.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:32.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:32.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:32.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:32.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:32.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:32.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:34.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:34.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:34.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:34.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:35.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:35.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:35.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:35.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:36.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:35.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:36.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:35.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:37.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:37.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:37.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:37.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:38.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:38.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:38.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:38.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:39.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:39.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:39.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:39.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:39.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:39.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:39.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:39.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:40.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:40.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:40.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:40.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:41.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:41.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:41.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:41.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:42.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:42.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:42.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:42.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:43.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:43.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:43.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:43.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:44.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:44.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:44.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:44.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:45.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:45.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:45.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:45.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:46.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:46.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:46.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:46.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:47.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:47.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:47.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:47.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:49.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:48.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:49.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:48.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:50.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:49.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:50.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:49.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:50.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:50.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:50.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:50.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:51.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:51.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:51.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:51.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:52.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:52.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:52.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:52.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:53.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:53.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:53.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:53.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:54.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:54.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:54.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:54.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:55.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:55.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:55.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:55.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:56.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:56.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:56.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:56.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:57.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:57.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:57.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:57.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:58.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:58.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:58.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:58.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:14:59.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:59.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:14:59.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:14:59.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:00.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:00.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:00.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:00.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:01.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:01.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:01.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:01.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:02.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:02.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:02.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:02.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:03.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:03.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:03.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:03.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:04.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:04.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:04.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:04.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:05.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:05.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:05.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:05.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:06.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:06.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:06.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:06.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:07.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:07.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:07.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:07.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:08.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:08.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:08.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:08.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:09.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:09.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:09.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:09.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:10.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:10.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:10.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:10.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:11.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:11.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:11.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:11.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:12.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:12.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:12.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:12.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:13.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:13.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:13.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:13.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:14.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:14.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:14.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:14.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:15.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:15.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:15.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:15.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:16.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:16.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:16.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:16.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:17.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:17.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:17.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:17.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:18.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:18.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:18.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:18.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:19.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:19.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:19.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:19.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:20.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:20.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:20.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:20.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:21.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:21.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:21.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:21.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:22.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:22.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:22.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:22.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:23.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:23.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:23.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:23.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:24.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:24.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:24.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:24.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:25.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:25.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:25.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:25.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:26.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:26.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:26.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:26.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:27.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:27.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:27.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:27.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:28.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:28.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:28.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:28.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:29.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:29.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:29.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:29.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:30.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:30.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:30.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:30.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:31.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:31.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:31.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:31.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:32.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:32.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:32.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:32.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:33.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:33.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:33.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:33.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:34.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:34.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:34.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:34.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:35.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:35.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:35.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:35.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:36.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:36.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:36.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:36.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:37.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:37.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:37.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:37.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:38.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:38.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:38.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:38.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:39.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:39.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:39.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:39.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:40.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:40.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:40.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:40.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:41.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:41.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:41.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:41.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:42.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:42.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:42.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:42.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:43.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:43.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:43.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:43.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:44.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:44.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:44.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:44.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:45.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:45.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:45.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:45.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:46.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:46.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:46.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:46.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:47.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:47.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:47.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:47.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:48.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:48.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:48.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:48.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:49.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:49.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:49.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:49.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:50.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:50.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:50.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:50.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:51.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:51.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:51.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:51.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:52.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:52.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:52.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:52.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:53.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:53.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:53.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:53.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:54.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:54.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:54.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:54.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:55.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:55.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:55.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:55.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:56.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:56.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:56.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:56.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:57.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:57.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:57.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:57.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:58.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:58.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:58.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:58.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:15:59.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:59.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:15:59.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:15:59.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:00.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:00.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:00.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:00.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:01.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:01.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:01.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:01.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:02.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:02.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:02.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:02.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:03.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:03.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:03.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:03.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:04.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:04.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:04.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:04.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:05.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:05.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:05.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:05.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:06.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:06.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:06.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:06.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:07.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:07.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:07.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:07.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:08.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:08.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:08.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:08.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:09.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:09.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:09.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:09.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:10.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:10.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:10.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:10.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:11.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:11.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:11.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:11.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:12.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:12.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:12.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:12.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:13.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:13.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:13.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:13.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:14.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:14.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:14.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:14.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:15.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:15.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:15.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:15.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:16.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:16.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:16.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:16.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:17.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:17.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:17.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:17.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:18.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:18.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:18.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:18.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:19.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:19.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:19.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:19.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:20.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:20.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:20.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:20.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:21.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:21.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:21.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:21.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:22.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:22.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:23.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:23.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:23.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:23.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:24.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:24.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:24.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:24.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:25.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:25.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:25.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:25.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:26.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:26.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:26.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:26.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:27.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:27.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:27.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:27.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:28.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:28.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:28.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:28.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:29.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:29.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:29.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:29.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:30.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:30.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:30.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:30.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:31.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:31.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:31.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:31.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:32.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:32.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:32.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:32.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:33.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:33.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:33.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:33.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:34.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:34.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:34.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:34.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:35.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:35.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:35.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:35.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:36.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:36.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:36.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:36.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:37.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:37.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:37.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:37.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:38.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:38.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:38.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:38.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:39.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:39.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:39.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:39.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:40.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:40.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:40.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:40.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:41.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:41.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:41.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:41.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:42.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:42.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:42.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:42.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:43.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:43.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:43.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:43.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:44.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:44.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:44.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:44.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:45.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:45.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:45.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:45.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:46.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:46.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:46.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:46.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:47.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:47.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:47.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:47.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:48.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:48.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:48.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:48.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:49.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:49.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:49.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:49.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:50.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:50.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:50.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:50.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:51.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:51.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:51.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:51.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:52.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:52.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:52.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:52.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:53.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:53.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:53.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:53.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:54.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:54.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:54.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:54.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:55.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:55.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:55.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:55.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:56.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:56.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:56.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:56.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:57.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:57.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:57.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:57.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:16:58.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:58.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:16:58.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:16:58.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:00.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:00.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:00.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:00.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:01.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:01.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:01.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:01.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:01.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:01.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:01.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:01.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:03.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:03.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:03.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:03.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:04.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:04.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:04.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:04.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:05.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:05.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:05.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:05.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:06.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:06.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:06.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:06.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:07.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:07.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:07.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:07.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:08.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:08.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:08.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:08.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:09.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:09.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:09.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:09.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:10.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:10.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:10.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:10.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:11.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:11.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:11.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:11.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:12.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:12.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:12.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:12.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:12.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:12.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:12.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:12.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:14.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:14.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:14.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:14.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:14.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:14.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:14.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:14.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:15.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:15.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:15.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:15.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:16.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:16.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:16.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:16.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:17.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:17.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:17.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:17.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:18.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:18.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:18.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:18.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:19.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:19.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:19.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:19.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:20.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:20.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:20.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:20.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:21.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:21.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:21.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:21.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:22.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:22.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:22.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:22.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:24.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:23.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:24.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:23.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:25.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:25.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:25.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:25.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:26.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:26.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:26.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:26.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:27.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:27.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:27.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:27.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:28.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:28.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:28.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:28.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:28.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:28.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:28.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:28.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:29.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:29.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:29.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:29.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:31.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:30.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:31.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:30.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:31.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:31.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:31.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:31.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:32.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:32.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:32.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:32.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:33.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:33.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:33.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:33.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:35.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:34.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:35.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:34.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:36.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:36.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:36.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:36.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:37.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:36.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:37.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:36.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:37.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:37.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:37.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:37.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:38.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:38.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:38.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:38.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:39.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:39.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:39.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:39.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:40.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:40.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:40.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:40.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:41.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:41.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:41.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:41.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:42.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:42.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:42.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:42.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:43.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:43.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:43.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:43.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:44.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:44.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:44.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:44.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:45.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:45.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:45.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:45.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:46.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:46.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:46.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:46.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:47.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:47.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:48.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:48.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:48.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:48.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:49.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:49.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:49.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:49.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:50.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:50.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:50.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:50.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:51.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:51.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:51.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:51.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:52.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:52.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:52.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:52.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:53.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:53.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:53.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:53.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:54.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:54.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:55.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:55.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:55.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:55.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:56.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:56.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:56.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:56.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:57.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:57.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:57.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:57.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:58.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:58.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:58.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:58.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:17:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:59.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:17:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:17:59.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:00.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:00.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:07:27.926091+0000 (oldest deadline 2019-10-23T11:07:47.926091+0000) 2019-10-23T11:18:00.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:00.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:01.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:01.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:02.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:02.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:03.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:03.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:04.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:04.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:05.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:05.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:06.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:06.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:07.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:07.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:08.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:08.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:09.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:09.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:10.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:10.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:11.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:11.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:13.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:13.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:14.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:13.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:15.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:15.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:16.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:16.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:17.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:17.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:18.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:18.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:19.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:19.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:20.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:20.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:21.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:21.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:21.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:21.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:22.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:22.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:24.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:24.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:24.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:24.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:24.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:24.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:25.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:25.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:25.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:25.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:26.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:26.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:26.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:26.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:27.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:27.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:27.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:27.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:28.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:28.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:28.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:28.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:29.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:29.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:29.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:29.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:30.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:30.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:30.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:30.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:31.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:31.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:31.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:31.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:32.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:32.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:32.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:32.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:33.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:33.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:33.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:33.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:34.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:34.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:34.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:34.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:35.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:35.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:35.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:35.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:36.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:36.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:36.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:36.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:37.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:37.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:37.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:37.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:38.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:38.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:38.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:38.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:39.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:39.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:39.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:39.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:40.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:40.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:40.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:40.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:41.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:41.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:41.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:41.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:42.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:42.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:42.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:42.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:43.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:43.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:43.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:43.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:44.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:44.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:44.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:44.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:45.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:45.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:45.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:45.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:46.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:46.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:46.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:46.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:47.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:47.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:47.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:47.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:48.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:48.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:48.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:48.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:49.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:49.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:49.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:49.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:50.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:50.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:50.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:50.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:51.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:51.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:51.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:51.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:52.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:52.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:52.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:52.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:53.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:53.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:53.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:53.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:54.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:54.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:54.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:54.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:55.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:55.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:55.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:55.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:56.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:56.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:56.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:56.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:57.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:57.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:57.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:57.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:58.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:58.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:58.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:58.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:18:59.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:59.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:18:59.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:18:59.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:00.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:00.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:00.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:00.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:01.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:01.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:01.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:01.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:02.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:02.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:02.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:02.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:03.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:03.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:03.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:03.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:04.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:04.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:04.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:04.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:05.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:05.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:05.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:05.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:06.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:06.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:06.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:06.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:07.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:07.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:07.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:07.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:08.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:08.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:08.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:08.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:09.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:09.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:10.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:10.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:10.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:10.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:11.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:11.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:11.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:11.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:12.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:12.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:12.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:12.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:13.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:13.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:13.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:13.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:14.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:14.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:14.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:14.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:15.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:15.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:15.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:15.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:16.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:16.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:16.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:16.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:17.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:17.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:17.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:17.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:18.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:18.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:18.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:18.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:19.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:19.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:19.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:19.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:20.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:20.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:20.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:20.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:21.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:21.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:21.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:21.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:22.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:22.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:22.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:22.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:23.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:23.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:23.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:23.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:24.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:24.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:24.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:24.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:25.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:25.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:25.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:25.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:26.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:26.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:26.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:26.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:27.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:27.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:27.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:27.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:28.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:28.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:28.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:28.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:29.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:29.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:29.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:29.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:30.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:30.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:30.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:30.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:31.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:31.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:31.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:31.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:32.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:32.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:32.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:32.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:33.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:33.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:33.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:33.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:34.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:34.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:34.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:34.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:35.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:35.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:35.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:35.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:36.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:36.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:36.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:36.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:37.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:37.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:37.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:37.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:38.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:38.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:38.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:38.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:39.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:39.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:39.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:39.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:40.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:40.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:40.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:40.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:41.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:41.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:42.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:42.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:42.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:42.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:43.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:43.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:43.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:43.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:44.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:44.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:44.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:44.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:45.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:45.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:45.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:45.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:46.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:46.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:46.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:46.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:47.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:47.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:47.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:47.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:48.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:48.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:48.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:48.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:49.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:49.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:49.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:49.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:50.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:50.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:50.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:50.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:51.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:51.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:52.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:52.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:52.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:52.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:53.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:53.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:53.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:53.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:54.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:54.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:54.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:54.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:55.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:55.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:55.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:55.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:56.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:56.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:56.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:56.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:57.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:57.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:57.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:57.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:58.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:58.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:58.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:58.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:19:59.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:59.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:19:59.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:19:59.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:00.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:00.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:00.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:00.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:01.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:01.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:01.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:01.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:02.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:02.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:02.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:02.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:03.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:03.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:03.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:03.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:04.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:04.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:04.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:04.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:05.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:05.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:05.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:05.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:06.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:06.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:06.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:06.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:07.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:07.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:07.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:07.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:08.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:08.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:08.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:08.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:09.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:09.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:09.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:09.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:10.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:10.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:10.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:10.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:11.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:11.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:11.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:11.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:12.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:12.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:12.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:12.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:13.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:13.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:13.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:13.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:14.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:14.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:14.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:14.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:15.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:15.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:15.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:15.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:16.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:16.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:16.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:16.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:17.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:17.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:17.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:17.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:18.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:18.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:18.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:18.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:19.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:19.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:19.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:19.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:20.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:20.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:20.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:20.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:21.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:21.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:21.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:21.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:22.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:22.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:22.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:22.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:23.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:23.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:23.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:23.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:24.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:24.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:24.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:24.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:25.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:25.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:25.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:25.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:26.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:26.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:26.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:26.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:27.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:27.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:27.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:27.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:28.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:28.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:28.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:28.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:29.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:29.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:29.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:29.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:30.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:30.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:30.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:30.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:31.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:31.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:31.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:31.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:32.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:32.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:32.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:32.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:33.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:33.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:33.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:33.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:34.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:34.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:34.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:34.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:35.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:35.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:35.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:35.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:36.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:36.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:36.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:36.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:37.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:37.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:37.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:37.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:38.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:38.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:38.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:38.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:39.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:39.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:39.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:39.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:40.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:40.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:40.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:40.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:41.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:41.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:41.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:41.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:42.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:42.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:42.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:42.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:43.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:43.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:43.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:43.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:44.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:44.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:44.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:44.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:45.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:45.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:45.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:45.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:46.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:46.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:46.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:46.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:47.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:47.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:47.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:47.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:48.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:48.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:48.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:48.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:49.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:49.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:49.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:49.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:50.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:50.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:50.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:50.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:51.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:51.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:51.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:51.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:52.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:52.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:52.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:52.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:53.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:53.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:53.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:53.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:54.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:54.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:54.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:54.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:55.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:55.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:55.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:55.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:56.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:56.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:56.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:56.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:57.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:57.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:57.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:57.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:58.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:58.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:58.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:58.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:20:59.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:59.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:20:59.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:20:59.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:00.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:00.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:00.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:00.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:01.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:01.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:01.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:01.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:02.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:02.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:02.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:02.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:03.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:03.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:03.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:03.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:04.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:04.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:04.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:04.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:05.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:05.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:05.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:05.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:06.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:06.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:06.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:06.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:07.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:07.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:07.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:07.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:08.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:08.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:08.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:08.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:09.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:09.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:09.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:09.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:10.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:10.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:10.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:10.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:11.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:11.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:11.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:11.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:12.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:12.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:12.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:12.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:13.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:13.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:13.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:13.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:14.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:14.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:14.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:14.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:15.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:15.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:15.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:15.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:16.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:16.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:16.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:16.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:17.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:17.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:17.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:17.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:18.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:18.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:18.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:18.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:19.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:19.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:19.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:19.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:20.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:20.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:20.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:20.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:21.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:21.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:21.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:21.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:22.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:22.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:22.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:22.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:23.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:23.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:23.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:23.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:24.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:24.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:24.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:24.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:25.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:25.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:25.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:25.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:26.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:26.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:26.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:26.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:27.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:27.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:27.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:27.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:28.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:28.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:28.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:28.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:29.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:29.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:29.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:29.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:30.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:30.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:30.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:30.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:31.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:31.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:31.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:31.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:32.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:32.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:32.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:32.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:33.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:33.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:33.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:33.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:34.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:34.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:34.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:34.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:35.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:35.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:35.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:35.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:36.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:36.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:36.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:36.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:37.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:37.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:37.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:37.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:38.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:38.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:38.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:38.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:39.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:39.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:39.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:39.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:40.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:40.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:40.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:40.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:41.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:41.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:41.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:41.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:42.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:42.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:42.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:42.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:43.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:43.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:43.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:43.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:44.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:44.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:44.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:44.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:45.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:45.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:45.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:45.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:46.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:46.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:46.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:46.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:47.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:47.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:47.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:47.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:48.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:48.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:48.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:48.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:49.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:49.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:49.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:49.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:50.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:50.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:50.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:50.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:51.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:51.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:51.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:51.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:52.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:52.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:52.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:52.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:53.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:53.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:53.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:53.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:54.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:54.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:54.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:54.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:55.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:55.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:55.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:55.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:56.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:56.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:56.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:56.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:57.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:57.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:57.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:57.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:58.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:58.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:58.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:58.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:21:59.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:59.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:21:59.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:21:59.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:00.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:00.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:00.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:00.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:01.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:01.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:01.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:01.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:02.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:02.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:02.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:02.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:03.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:03.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:03.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:03.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:04.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:04.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:04.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:04.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:05.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:05.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:05.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:05.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:06.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:06.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:06.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:06.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:07.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:07.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:07.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:07.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:08.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:08.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:08.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:08.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:09.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:09.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:09.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:09.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:10.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:10.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:10.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:10.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:11.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:11.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:11.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:11.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:12.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:12.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:12.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:12.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:13.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:13.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:13.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:13.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:14.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:14.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:14.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:14.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:15.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:15.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:15.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:15.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:16.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:16.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:16.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:16.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:17.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:17.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:17.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:17.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 96 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:18.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:18.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:18.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:18.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:19.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:19.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:19.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:19.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:20.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:20.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:20.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:20.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:21.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:21.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:21.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:21.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:22.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:22.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:22.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:22.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:23.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:23.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:23.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:23.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:24.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:24.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:24.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:24.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:25.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:25.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:25.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:25.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:26.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:26.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:26.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:26.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:27.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:27.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:27.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:27.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:28.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:28.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:28.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:28.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:29.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:29.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:29.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:29.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:30.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:30.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:30.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:30.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:31.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:31.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:31.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:31.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:32.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:32.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:32.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:32.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:33.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:33.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:33.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:33.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:34.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:34.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:34.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:34.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:35.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:35.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:35.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:35.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:36.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:36.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:36.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:36.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:37.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:37.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:37.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:37.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:38.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:38.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:38.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:38.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:39.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:39.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:39.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:39.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:40.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:40.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:40.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:40.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:41.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:41.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:41.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:41.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:42.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:42.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:42.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:42.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:43.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:43.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:43.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:43.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:44.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:44.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:44.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:44.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:45.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:45.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:45.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:45.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:46.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:46.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:46.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:46.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:47.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:47.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:47.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:47.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:48.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:48.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:48.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:48.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:49.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:49.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:49.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:49.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:50.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:50.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:50.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:50.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:51.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:51.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:51.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:51.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:52.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:52.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:52.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:52.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:53.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:53.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:53.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:53.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:54.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:54.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:54.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:54.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:55.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:55.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:55.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:55.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:56.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:56.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:56.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:56.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:57.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:57.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:57.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:57.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:58.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:58.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:58.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:58.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:22:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:59.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:22:59.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:22:59.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:00.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:00.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:00.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:00.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:01.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:01.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:01.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:01.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:02.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:02.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:02.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:02.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:03.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:03.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:03.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:03.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:04.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:04.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:04.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:04.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:05.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:05.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:05.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:05.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:06.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:06.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:06.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:06.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:07.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:07.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:07.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:07.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:08.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:08.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:08.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:08.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:09.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:09.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:09.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:09.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:10.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:10.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:10.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:10.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:11.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:11.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:11.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:11.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:12.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:12.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:12.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:12.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:13.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:13.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:13.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:13.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:14.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:14.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:14.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:14.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:15.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:15.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:15.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:15.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:16.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:16.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:16.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:16.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:17.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:17.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:17.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:17.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:18.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:18.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:18.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:18.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:19.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:19.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:19.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:19.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:20.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:20.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:20.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:20.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:21.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:21.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:21.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:21.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:22.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:22.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:22.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:22.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:23.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:23.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:23.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:23.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:24.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:24.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:24.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:24.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:25.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:25.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:25.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:25.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:26.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:26.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:26.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:26.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:27.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:27.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:27.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:27.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:28.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:28.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:28.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:28.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:29.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:29.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:29.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:29.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:30.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:30.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:30.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:30.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:31.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:31.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:31.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:31.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:32.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:32.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:32.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:32.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:33.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:33.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:33.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:33.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:34.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:34.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:34.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:34.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:35.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:35.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:35.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:35.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:36.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:36.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:36.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:36.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:37.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:37.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:37.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:37.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:38.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:38.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:38.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:38.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:39.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:39.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:39.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:39.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:40.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:40.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:40.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:40.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:41.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:41.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:41.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:41.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:42.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:42.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:42.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:42.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:43.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:43.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:43.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:43.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:44.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:44.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:44.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:44.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:45.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:45.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:45.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:45.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:46.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:46.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:46.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:46.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:47.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:47.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:48.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:48.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:48.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:48.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:49.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:49.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:49.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:49.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:50.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:50.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:50.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:50.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:51.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:51.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:51.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:51.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:52.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:52.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:52.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:52.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:53.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:53.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:53.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:53.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:54.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:54.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:54.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:54.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:55.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:55.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:55.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:55.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:56.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:56.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:56.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:56.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:57.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:57.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:57.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:57.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:58.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:58.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:58.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:58.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:23:59.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:59.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:23:59.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:23:59.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:00.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:00.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:00.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:00.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:01.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:01.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:01.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:01.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:02.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:02.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:02.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:02.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:03.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:03.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:03.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:04.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:04.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:04.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:04.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:05.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:05.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:05.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:05.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:06.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:06.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:06.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:06.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:07.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:07.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:07.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:07.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:08.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:08.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:08.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:08.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:09.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:09.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:09.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:09.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:10.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:10.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:10.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:10.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:11.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:11.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:11.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:11.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:12.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:12.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:12.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:12.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:13.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:13.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:13.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:13.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:14.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:14.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:14.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:14.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:16.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:16.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:16.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:16.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:16.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:16.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:16.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:16.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:17.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:17.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:17.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:17.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:19.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:19.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:19.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:19.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:19.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:19.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:19.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:19.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:20.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:20.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:20.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:20.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:21.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:21.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:21.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:21.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:22.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:22.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:22.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:22.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:23.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:23.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:23.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:23.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:24.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:24.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:24.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:24.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:25.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:25.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:25.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:25.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:26.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:26.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:26.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:26.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:27.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:27.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:27.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:27.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:28.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:28.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:28.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:28.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:29.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:29.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:29.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:29.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:30.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:30.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:30.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:30.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:31.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:31.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:31.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:31.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:32.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:32.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:32.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:32.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:33.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:33.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:33.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:33.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:34.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:34.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:34.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:34.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:35.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:35.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:35.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:35.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:36.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:36.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:36.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:36.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:37.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:37.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:38.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:38.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:38.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:38.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:39.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:39.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:39.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:39.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:40.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:40.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:40.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:40.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:41.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:41.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:41.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:42.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:42.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:42.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:42.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:43.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:43.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:43.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:43.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:44.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:44.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:44.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:44.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:45.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:45.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:45.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:45.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:46.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:46.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:46.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:46.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:47.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:47.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:47.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:47.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:48.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:48.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:48.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:48.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:50.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:50.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:50.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:50.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:50.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:50.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:50.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:50.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:51.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:51.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:51.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:51.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:53.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:53.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:53.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:53.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:54.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:54.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:54.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:54.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:55.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:55.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:55.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:55.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:56.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:56.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:56.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:56.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:57.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:57.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:57.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:57.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:58.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:58.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:58.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:58.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:24:59.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:59.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:24:59.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:59.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:00.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:59.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:00.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:24:59.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:01.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:01.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:01.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:01.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:02.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:02.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:02.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:02.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:03.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:03.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:03.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:03.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:04.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:04.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:04.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:04.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:05.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:05.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:05.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:05.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:06.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:06.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:06.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:06.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:07.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:07.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:07.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:07.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:08.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:08.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:08.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:08.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:09.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:09.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:09.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:09.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:10.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:10.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:10.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:10.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:11.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:11.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:11.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:11.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:12.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:12.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:12.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:12.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:12.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:12.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:12.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:12.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:14.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:14.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:14.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:14.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:14.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:14.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:14.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:14.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:15.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:15.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:15.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:15.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:16.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:16.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:16.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:16.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:17.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:17.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:17.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:17.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:18.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:18.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:18.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:18.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:19.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:19.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:19.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:19.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:20.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:20.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:20.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:20.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:22.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:22.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:22.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:22.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:23.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:22.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:23.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:22.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:23.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:23.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:23.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:23.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:24.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:24.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:24.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:24.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:25.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:25.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:26.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:26.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:26.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:26.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:27.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:27.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:27.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:27.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:28.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:28.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:28.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:28.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:29.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:29.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:29.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:29.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:30.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:30.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:30.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:30.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:31.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:31.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:31.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:31.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:32.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:32.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:32.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:32.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:33.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:33.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:33.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:33.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:34.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:34.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:34.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:34.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:35.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:35.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:35.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:35.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:36.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:36.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:36.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:36.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:37.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:37.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:37.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:37.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:38.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:38.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:38.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:38.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:39.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:39.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:39.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:39.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:40.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:40.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:40.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:40.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:41.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:41.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:42.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:42.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:42.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:42.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:43.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:43.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:43.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:43.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:44.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:44.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:44.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:44.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:45.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:45.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:45.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:45.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:46.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:46.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:46.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:46.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:47.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:47.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:47.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:47.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:48.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:48.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:48.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:48.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:49.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:49.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:49.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:49.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:50.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:50.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:50.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:50.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:51.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:51.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:51.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:51.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:52.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:52.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:52.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:52.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:53.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:53.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:53.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:53.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:54.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:54.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:54.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:54.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:55.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:55.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:55.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:55.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:56.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:56.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:56.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:56.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:57.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:57.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:57.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:57.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:58.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:58.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:58.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:58.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:25:59.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:59.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:25:59.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:25:59.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:00.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:00.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:00.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:00.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:01.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:01.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:01.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:01.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:02.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:02.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:02.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:02.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:03.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:03.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:03.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:03.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:04.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:04.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:04.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:04.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:05.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:05.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:05.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:05.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:06.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:06.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:06.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:06.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:07.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:07.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:07.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:07.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:08.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:08.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:08.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:08.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:09.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:09.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:09.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:09.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:10.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:10.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:10.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:10.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:11.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:11.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:11.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:11.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:12.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:12.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:12.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:12.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:13.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:13.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:13.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:13.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:14.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:14.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:14.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:14.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:15.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:15.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:15.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:15.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:16.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:16.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:16.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:16.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:17.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:17.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:17.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:17.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:18.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:18.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:18.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:18.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:19.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:19.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:19.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:19.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:20.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:20.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:20.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:20.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:21.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:21.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:21.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:21.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:22.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:22.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:22.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:22.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:23.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:23.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:23.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:23.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:24.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:24.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:24.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:24.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:25.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:25.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:25.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:25.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:26.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:26.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:26.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:26.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:27.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:27.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:27.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:27.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:28.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:28.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:28.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:28.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:29.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:29.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:29.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:29.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:30.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:30.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:30.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:30.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:31.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:31.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:31.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:31.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:32.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:32.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:32.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:32.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:33.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:33.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:33.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:33.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:34.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:34.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:34.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:34.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:35.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:35.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:35.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:35.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:36.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:36.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:36.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:36.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:37.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:37.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:37.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:37.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:38.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:38.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:38.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:38.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:39.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:39.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:39.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:39.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:40.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:40.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:40.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:40.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:41.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:41.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:41.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:41.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:42.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:42.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:42.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:42.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:43.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:43.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:43.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:43.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:44.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:44.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:44.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:44.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:45.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:45.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:45.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:45.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:46.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:46.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:46.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:46.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:47.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:47.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:47.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:47.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:48.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:48.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:48.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:48.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:49.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:49.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:49.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:49.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:50.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:50.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:50.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:50.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:51.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:51.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:51.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:51.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:52.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:52.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:52.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:52.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:53.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:53.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:53.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:53.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:54.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:54.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:54.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:54.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:55.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:55.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:55.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:55.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:56.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:56.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:56.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:56.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:57.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:57.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:57.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:57.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:58.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:58.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:58.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:58.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:26:59.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:59.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:26:59.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:26:59.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:00.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:00.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:00.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:00.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:01.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:01.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:01.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:01.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:02.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:02.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:02.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:02.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:03.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:03.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:03.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:03.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:04.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:04.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:04.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:04.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:05.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:05.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:05.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:05.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:06.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:06.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:06.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:06.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:07.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:07.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:07.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:07.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:08.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:08.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:08.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:08.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:09.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:09.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:09.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:09.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:10.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:10.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:10.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:10.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:11.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:11.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:11.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:11.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:12.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:12.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:12.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:12.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:13.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:13.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:13.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:13.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:14.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:14.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:14.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:14.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:15.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:15.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:15.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:15.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:16.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:16.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:16.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:16.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:17.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:17.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:17.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:17.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:18.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:18.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:18.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:18.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:19.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:19.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:19.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:19.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:20.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:20.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:20.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:20.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:21.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:21.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:21.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:21.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:22.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:22.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:22.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:22.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:23.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:23.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:23.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:23.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:24.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:24.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:24.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:24.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:25.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:25.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:25.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:25.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:26.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:26.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:26.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:26.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:27.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:27.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:27.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:27.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:28.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:28.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:28.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:28.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:29.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:29.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:29.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:29.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:30.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:30.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:30.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:30.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:31.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:31.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:31.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:31.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:32.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:32.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:32.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:32.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:33.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:33.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:33.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:33.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:34.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:34.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:34.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:34.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:35.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:35.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:35.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:35.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:36.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:36.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:36.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:36.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:37.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:37.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:37.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:37.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:38.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:38.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:38.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:38.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:39.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:39.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:39.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:39.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:40.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:40.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:40.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:40.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:41.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:41.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:41.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:41.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:42.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:42.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:42.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:42.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:43.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:43.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:43.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:43.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:44.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:44.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:44.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:44.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:45.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:45.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:45.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:45.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:46.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:46.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:46.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:46.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:47.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:47.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:47.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:47.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:48.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:48.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:48.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:48.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:49.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:49.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:49.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:49.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:50.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:50.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:50.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:50.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:51.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:51.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:51.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:51.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:52.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:52.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:52.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:52.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:53.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:53.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:53.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:53.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:54.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:54.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:54.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:54.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:55.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:55.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:55.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:55.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:56.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:56.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:56.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:56.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:57.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:57.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:57.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:57.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:58.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:58.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:58.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:58.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:27:59.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:59.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:27:59.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:27:59.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:00.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:00.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:00.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:00.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:02.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:01.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:02.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:01.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:03.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:03.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:03.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:03.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:03.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:03.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:03.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:03.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:04.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:04.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:04.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:04.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:05.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:05.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:05.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:05.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:06.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:06.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:06.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:06.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:07.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:07.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:07.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:07.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:08.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:08.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:08.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:08.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:09.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:09.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:09.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:09.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:10.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:10.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:10.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:10.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:11.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:11.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:11.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:11.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:12.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:12.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:12.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:12.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:13.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:13.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:13.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:13.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:14.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:14.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:14.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:14.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:15.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:15.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:15.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:15.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:16.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:16.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:16.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:16.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:17.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:17.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:17.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:17.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:18.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:18.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:18.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:18.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:20.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:20.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:20.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:20.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:20.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:20.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:20.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:20.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:22.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:22.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:22.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:22.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:23.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:23.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:23.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:23.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:24.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:24.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:24.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:24.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:25.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:25.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:25.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:25.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:26.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:26.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:26.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:26.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:27.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:27.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:27.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:27.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:28.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:28.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:28.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:28.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:29.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:29.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:29.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:29.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:30.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:30.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:30.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:30.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:31.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:31.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:31.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:31.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:32.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:32.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:32.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:32.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:33.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:33.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:33.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:33.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:34.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:34.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:34.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:34.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:35.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:35.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:35.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:35.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:36.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:36.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:36.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:36.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:37.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:37.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:37.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:37.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:38.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:38.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:18:04.151752+0000 (oldest deadline 2019-10-23T11:18:24.151752+0000) 2019-10-23T11:28:38.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:38.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:39.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:39.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:40.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:40.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:41.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:41.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:42.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:42.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:43.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:43.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:44.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:44.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:45.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:46.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:46.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:47.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:47.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:48.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:48.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:49.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:49.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:50.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:50.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:51.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:51.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:52.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:52.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:53.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:53.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:54.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:54.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:55.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:55.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:56.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:56.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:57.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:57.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:58.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:58.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:28:59.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:28:59.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:00.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:00.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:00.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:00.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:01.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:01.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:01.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:01.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:02.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:02.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:02.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:02.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:03.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:03.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:03.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:03.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:04.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:04.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:04.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:04.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:05.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:05.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:05.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:05.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:06.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:06.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:06.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:06.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:07.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:07.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:07.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:07.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:08.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:08.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:08.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:08.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:09.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:09.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:09.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:09.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:10.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:10.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:10.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:10.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:11.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:11.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:11.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:11.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:12.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:12.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:12.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:12.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:13.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:13.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:13.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:13.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:14.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:14.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:14.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:14.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:15.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:15.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:15.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:15.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:16.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:16.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:16.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:16.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:17.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:17.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:17.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:17.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:18.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:18.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:18.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:18.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:19.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:19.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:19.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:19.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:20.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:20.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:20.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:20.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:21.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:21.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:21.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:21.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:22.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:22.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:22.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:22.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:23.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:23.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:23.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:23.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:24.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:24.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:24.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:24.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:25.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:25.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:25.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:25.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:26.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:26.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:26.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:26.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:27.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:27.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:27.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:27.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:28.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:28.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:28.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:28.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:29.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:29.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:29.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:29.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:30.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:30.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:30.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:30.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:31.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:31.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:31.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:31.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:32.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:32.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:32.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:32.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:33.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:33.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:33.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:33.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:34.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:34.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:34.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:34.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:35.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:35.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:35.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:35.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:36.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:36.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:36.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:36.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:37.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:37.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:37.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:37.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:38.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:38.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:38.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:38.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:39.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:39.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:39.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:39.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:40.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:40.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:40.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:40.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:41.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:41.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:41.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:41.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:42.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:42.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:42.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:42.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:43.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:43.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:43.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:43.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:44.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:44.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:44.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:44.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:45.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:45.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:46.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:46.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:46.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:46.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:47.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:47.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:47.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:47.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:48.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:48.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:48.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:48.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:49.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:49.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:49.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:49.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:50.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:50.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:50.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:50.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:51.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:51.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:51.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:51.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:52.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:52.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:52.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:52.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:53.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:53.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:53.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:53.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:54.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:54.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:54.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:54.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:55.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:55.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:55.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:55.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:56.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:56.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:56.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:56.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:57.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:57.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:57.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:57.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:58.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:58.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:58.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:58.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:29:59.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:59.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:29:59.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:29:59.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:00.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:00.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:00.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:00.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:01.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:01.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:01.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:01.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:02.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:02.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:02.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:02.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:03.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:03.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:03.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:03.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:04.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:04.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:04.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:04.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:05.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:05.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:05.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:05.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:06.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:06.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:06.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:06.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:07.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:07.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:07.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:07.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:08.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:08.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:08.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:08.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:09.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:09.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:09.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:09.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:10.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:10.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:10.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:10.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:11.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:11.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:11.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:11.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:12.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:12.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:12.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:12.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:13.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:13.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:13.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:13.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:14.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:14.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:14.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:14.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:15.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:15.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:15.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:15.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:16.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:16.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:16.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:16.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:17.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:17.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:17.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:17.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:18.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:18.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:18.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:18.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:19.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:19.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:19.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:19.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:20.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:20.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:20.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:20.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:21.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:21.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:21.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:21.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:22.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:22.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:22.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:22.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:23.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:23.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:23.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:23.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:24.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:24.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:24.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:24.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:25.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:25.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:25.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:25.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:26.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:26.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:26.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:26.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:27.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:27.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:27.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:27.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:28.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:28.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:28.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:28.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:29.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:29.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:29.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:29.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:30.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:30.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:30.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:30.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:31.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:31.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:31.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:31.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:32.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:32.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:32.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:32.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:33.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:33.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:33.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:33.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:34.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:34.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:34.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:34.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:35.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:35.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:35.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:35.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:36.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:36.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:36.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:36.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:37.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:37.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:37.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:37.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:38.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:38.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:38.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:38.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:39.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:39.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:39.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:39.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:40.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:40.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:40.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:40.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:41.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:41.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:41.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:41.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:42.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:42.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:42.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:42.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:43.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:43.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:43.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:43.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:44.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:44.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:44.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:44.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:45.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:45.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:45.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:45.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:46.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:46.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:46.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:46.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:47.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:47.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:47.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:47.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:48.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:48.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:48.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:48.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:49.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:49.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:49.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:49.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:50.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:50.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:50.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:50.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:51.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:51.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:51.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:51.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:52.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:52.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:52.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:52.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:53.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:53.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:53.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:53.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:54.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:54.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:54.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:54.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:55.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:55.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:55.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:55.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:56.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:56.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:56.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:56.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:57.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:57.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:57.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:57.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:58.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:58.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:58.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:58.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:30:59.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:59.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:30:59.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:30:59.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:00.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:00.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:00.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:00.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:02.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:02.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:02.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:02.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:03.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:03.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:03.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:03.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:04.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:04.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:04.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:04.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:05.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:05.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:05.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:05.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:06.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:06.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:06.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:06.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:07.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:07.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:07.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:07.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:08.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:08.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:08.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:08.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:09.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:09.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:09.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:09.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:10.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:10.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:10.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:10.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:11.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:11.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:11.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:11.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:12.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:12.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:12.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:12.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:12.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:12.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:12.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:12.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:14.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:13.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:14.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:13.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:15.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:15.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:15.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:15.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:15.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:15.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:15.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:15.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:16.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:16.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:16.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:16.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:17.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:17.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:17.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:17.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:18.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:18.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:18.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:18.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:19.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:19.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:19.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:19.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:21.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:21.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:21.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:21.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:22.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:22.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:22.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:22.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:23.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:23.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:23.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:23.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:24.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:24.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:24.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:24.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:25.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:25.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:25.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:25.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:26.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:26.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:26.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:26.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:26.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:26.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:26.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:26.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:27.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:27.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:27.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:27.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:28.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:28.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:28.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:28.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:30.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:30.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:30.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:30.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:31.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:31.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:31.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:31.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:32.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:32.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:32.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:32.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:33.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:33.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:33.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:33.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:34.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:34.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:34.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:34.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:35.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:35.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:35.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:35.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:36.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:36.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:36.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:36.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:37.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:37.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:37.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:37.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:38.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:38.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:38.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:38.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:39.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:39.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:39.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:39.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:40.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:40.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:40.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:40.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:41.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:41.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:41.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:41.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:42.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:42.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:42.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:42.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:43.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:43.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:43.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:43.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:44.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:44.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:44.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:44.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:45.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:45.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:45.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:45.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:46.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:46.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:46.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:46.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:47.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:47.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:47.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:47.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:48.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:48.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:48.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:48.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:49.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:49.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:49.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:49.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:50.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:50.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:50.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:50.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:50.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:50.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:50.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:50.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:51.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:51.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:51.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:51.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:52.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:52.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:52.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:52.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:53.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:53.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:53.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:53.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:54.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:54.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:54.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:54.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:55.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:55.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:55.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:55.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:56.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:56.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:56.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:57.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:57.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:57.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:57.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:58.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:58.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:58.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:58.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:31:59.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:59.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:31:59.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:31:59.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:00.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:00.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:00.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:00.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:02.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:02.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:02.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:02.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:02.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:02.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:02.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:02.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:04.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:04.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:04.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:04.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:05.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:05.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:05.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:05.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:06.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:06.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:06.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:06.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:07.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:07.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:07.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:07.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:08.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:08.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:08.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:08.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:09.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:09.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:09.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:09.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:10.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:10.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:10.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:10.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:11.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:11.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:11.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:11.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:12.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:12.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:12.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:12.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:13.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:13.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:13.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:13.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:14.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:14.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:14.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:14.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:15.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:15.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:15.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:15.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:16.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:16.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:16.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:16.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:17.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:17.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:17.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:17.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:18.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:18.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:18.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:18.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:19.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:19.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:19.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:19.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:20.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:20.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:20.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:20.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:21.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:21.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:21.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:21.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:22.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:22.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:22.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:22.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:23.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:23.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:23.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:23.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:24.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:24.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:24.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:24.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:25.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:25.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:25.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:25.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:26.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:26.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:26.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:26.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:27.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:27.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:27.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:27.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:28.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:28.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:28.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:28.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:29.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:29.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:29.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:29.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:30.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:30.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:30.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:30.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:31.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:31.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:31.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:31.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:32.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:32.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:32.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:32.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:33.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:33.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:33.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:33.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:34.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:34.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:34.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:34.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:35.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:35.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:35.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:35.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:36.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:36.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:36.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:36.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:37.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:37.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:37.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:37.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:38.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:38.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:38.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:38.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:39.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:39.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:39.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:39.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:40.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:40.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:40.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:40.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:41.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:41.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:41.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:41.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:42.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:42.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:42.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:42.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:43.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:43.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:43.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:43.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:44.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:44.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:44.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:44.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:45.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:45.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:45.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:45.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:46.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:46.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:46.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:46.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:47.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:47.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:47.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:47.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:48.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:48.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:49.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:48.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:49.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:48.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:49.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:49.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:49.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:49.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:50.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:50.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:50.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:50.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:51.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:51.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:51.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:51.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:52.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:52.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:52.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:52.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:54.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:54.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:54.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:54.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:54.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:54.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:54.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:54.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:55.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:55.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:55.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:55.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:56.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:56.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:56.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:56.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:57.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:57.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:57.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:57.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:58.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:58.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:58.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:58.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:32:59.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:59.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:32:59.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:32:59.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:01.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:00.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:01.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:00.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:02.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:01.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:02.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:01.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:03.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:03.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:03.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:03.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:04.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:04.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:04.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:04.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:05.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:05.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:05.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:05.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:05.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:05.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:05.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:05.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:06.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:06.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:06.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:06.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:08.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:08.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:08.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:08.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:08.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:08.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:08.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:08.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:10.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:10.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:10.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:10.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:10.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:10.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:10.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:10.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:11.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:11.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:11.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:11.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:12.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:12.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:12.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:12.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:13.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:13.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:13.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:13.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:14.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:14.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:14.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:14.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:15.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:15.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:15.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:15.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:16.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:16.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:16.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:16.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:17.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:17.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:17.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:17.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:18.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:18.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:18.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:18.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:19.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:19.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:19.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:19.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:20.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:20.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:20.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:20.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:21.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:21.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:21.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:21.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:22.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:22.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:22.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:22.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:23.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:23.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:23.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:23.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:24.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:24.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:24.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:24.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:25.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:25.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:25.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:25.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:26.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:26.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:26.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:26.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:27.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:27.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:27.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:27.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:28.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:28.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:28.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:28.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:29.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:29.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:29.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:29.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:30.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:30.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:30.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:30.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:31.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:31.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:31.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:31.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:32.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:32.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:32.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:32.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:33.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:33.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:33.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:33.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:34.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:34.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:34.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:34.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:35.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:35.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:35.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:35.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:36.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:36.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:36.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:36.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:37.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:37.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:37.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:37.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:38.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:38.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:38.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:38.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:39.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:39.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:39.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:39.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:40.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:40.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:40.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:40.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:41.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:41.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:41.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:41.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:42.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:42.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:42.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:42.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:43.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:43.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:43.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:43.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:44.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:44.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:44.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:44.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:45.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:45.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:45.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:45.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:46.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:46.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:46.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:46.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:47.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:47.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:47.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:47.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:48.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:48.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:48.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:48.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:49.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:49.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:49.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:49.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:50.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:50.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:50.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:50.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:51.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:51.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:51.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:51.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:52.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:52.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:52.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:52.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:53.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:53.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:53.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:53.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:54.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:54.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:54.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:54.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:55.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:55.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:55.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:55.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:56.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:56.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:56.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:56.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:57.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:57.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:57.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:57.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:58.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:58.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:58.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:58.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:33:59.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:59.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:33:59.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:33:59.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:00.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:00.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:00.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:00.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:01.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:01.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:01.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:01.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:02.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:02.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:02.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:02.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:03.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:03.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:03.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:03.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:04.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:04.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:04.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:04.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:05.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:05.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:05.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:05.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:06.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:06.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:06.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:06.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:07.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:07.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:07.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:07.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:08.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:08.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:08.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:08.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:09.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:09.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:09.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:09.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:10.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:10.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:10.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:10.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:11.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:11.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:11.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:11.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:12.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:12.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:12.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:12.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:13.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:13.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:13.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:13.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:14.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:14.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:14.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:14.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:15.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:15.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:15.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:15.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:16.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:16.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:16.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:16.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:17.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:17.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:17.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:17.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:18.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:18.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:18.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:18.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:19.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:19.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:19.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:19.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:20.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:20.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:20.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:20.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:21.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:21.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:21.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:21.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:22.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:22.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:22.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:22.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:23.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:23.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:23.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:23.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:24.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:24.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:24.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:24.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:25.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:25.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:25.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:25.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:26.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:26.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:26.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:26.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:27.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:27.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:27.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:27.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:28.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:28.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:28.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:28.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:29.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:29.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:29.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:29.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:30.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:30.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:30.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:30.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:31.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:31.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:31.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:31.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:32.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:32.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:32.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:32.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:33.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:33.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:33.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:33.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:34.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:34.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:34.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:34.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:35.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:35.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:35.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:35.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:36.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:36.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:36.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:36.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:37.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:37.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:37.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:37.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:38.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:38.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:38.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:38.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:39.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:39.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:39.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:39.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:40.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:40.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:40.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:40.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:41.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:41.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:41.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:41.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:42.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:42.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:42.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:42.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:43.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:43.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:43.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:43.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:44.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:44.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:44.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:44.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:45.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:45.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:45.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:45.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:46.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:46.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:46.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:46.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:48.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:48.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:48.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:48.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:49.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:49.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:49.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:49.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:50.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:50.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:50.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:50.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:51.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:51.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:51.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:51.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:52.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:52.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:52.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:52.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:53.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:53.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:53.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:53.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:54.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:54.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:54.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:54.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:55.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:55.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:55.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:55.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:56.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:56.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:56.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:56.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:57.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:57.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:57.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:57.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:58.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:58.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:58.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:58.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:34:59.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:59.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:34:59.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:34:59.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:00.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:00.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:00.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:00.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:01.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:01.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:01.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:01.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:02.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:02.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:02.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:02.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:02.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:02.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:03.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:03.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:03.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:03.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:04.528 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:35:04.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:04.523428+0000) 2019-10-23T11:35:04.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:04.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:04.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:04.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:05.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:35:05.522+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:05.523872+0000) 2019-10-23T11:35:05.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:35:05.538+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:05.540009+0000) 2019-10-23T11:35:05.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:05.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:05.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:05.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:06.506 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:35:06.502+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:06.504033+0000) 2019-10-23T11:35:06.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:06.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:06.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:06.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:07.539 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:35:07.535+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:07.536768+0000) 2019-10-23T11:35:07.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:07.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:07.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:07.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:08.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:08.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:08.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:08.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:10.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:09.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:10.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:09.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:11.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:11.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:11.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:11.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:12.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:12.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:12.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:12.046 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:35:12.042+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:12.043388+0000) 2019-10-23T11:35:13.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:13.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:13.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:13.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:14.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:14.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:14.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:14.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:14.528 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:35:14.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:14.523523+0000) 2019-10-23T11:35:15.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:15.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:15.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:15.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:15.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:35:15.522+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:15.523967+0000) 2019-10-23T11:35:15.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:35:15.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:15.540129+0000) 2019-10-23T11:35:16.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:16.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:16.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:16.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:16.506 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:35:16.502+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:16.504131+0000) 2019-10-23T11:35:17.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:17.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:17.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:17.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:17.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:35:17.535+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:17.536879+0000) 2019-10-23T11:35:18.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:18.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:18.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:18.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:19.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:19.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:19.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:19.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:20.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:20.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:20.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:20.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:21.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:21.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:21.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:21.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:22.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:22.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:22.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:22.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:22.046 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:35:22.042+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:22.043503+0000) 2019-10-23T11:35:22.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:22.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:22.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:22.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:23.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:23.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:23.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:23.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:24.528 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:35:24.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:24.523619+0000) 2019-10-23T11:35:24.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:24.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:24.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:24.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:25.526 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:35:25.522+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:25.524062+0000) 2019-10-23T11:35:25.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:35:25.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:25.540246+0000) 2019-10-23T11:35:25.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:25.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:25.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:25.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:26.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:35:26.502+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:26.504231+0000) 2019-10-23T11:35:26.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:26.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:26.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:26.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:27.539 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:35:27.535+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:27.536987+0000) 2019-10-23T11:35:27.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:27.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:27.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:27.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:28.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:28.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:28.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:28.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:29.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:29.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:29.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:29.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:30.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:30.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:30.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:30.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:31.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:31.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:31.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:31.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:32.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:35:32.042+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:32.043612+0000) 2019-10-23T11:35:32.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:32.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:32.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:32.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:33.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:33.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:33.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:33.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:34.528 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:35:34.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:34.523709+0000) 2019-10-23T11:35:34.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:34.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:34.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:34.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:35.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:35:35.522+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:35.524160+0000) 2019-10-23T11:35:35.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:35:35.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:35.540363+0000) 2019-10-23T11:35:35.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:35.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:35.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:35.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:36.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:35:36.503+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:36.504324+0000) 2019-10-23T11:35:36.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:36.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:36.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:36.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:37.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:35:37.535+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:37.537101+0000) 2019-10-23T11:35:37.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:37.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:37.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:37.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:39.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:39.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:39.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:39.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:40.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:40.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:40.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:40.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:41.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:41.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:41.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:41.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:42.046 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:35:42.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:42.043731+0000) 2019-10-23T11:35:42.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:42.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:42.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:42.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:43.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:43.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:43.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:43.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:44.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:44.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:44.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:44.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:44.528 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:35:44.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:44.523802+0000) 2019-10-23T11:35:45.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:45.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:45.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:45.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:45.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:35:45.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:45.524259+0000) 2019-10-23T11:35:45.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:35:45.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:45.540475+0000) 2019-10-23T11:35:45.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:45.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:45.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:45.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:46.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:35:46.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:46.504421+0000) 2019-10-23T11:35:46.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:46.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:46.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:46.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:47.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:35:47.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:47.537219+0000) 2019-10-23T11:35:47.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:47.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:47.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:47.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:48.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:48.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:48.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:48.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:49.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:49.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:49.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:49.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:50.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:50.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:50.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:50.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:51.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:51.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:51.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:51.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:52.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:35:52.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:52.043845+0000) 2019-10-23T11:35:52.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:52.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:52.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:52.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:53.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:53.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:53.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:53.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:54.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:35:54.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:54.523901+0000) 2019-10-23T11:35:54.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:54.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:54.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:54.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:55.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:35:55.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:55.524358+0000) 2019-10-23T11:35:55.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:35:55.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:55.540590+0000) 2019-10-23T11:35:55.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:55.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:55.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:55.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:56.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:35:56.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:56.504518+0000) 2019-10-23T11:35:56.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:56.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:56.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:56.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:57.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:35:57.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:35:57.537327+0000) 2019-10-23T11:35:57.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:57.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:57.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:57.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:58.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:58.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:58.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:58.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:35:59.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:59.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:35:59.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:35:59.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:00.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:00.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:00.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:00.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:01.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:01.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:01.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:01.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:02.046 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:36:02.042+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:02.043970+0000) 2019-10-23T11:36:02.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:02.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:02.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:02.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:03.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:03.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:03.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:03.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:04.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:36:04.522+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:04.523998+0000) 2019-10-23T11:36:04.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:04.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:04.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:04.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:05.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:36:05.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:05.524453+0000) 2019-10-23T11:36:05.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:36:05.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:05.540712+0000) 2019-10-23T11:36:05.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:05.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:05.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:05.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:06.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:36:06.503+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:06.504613+0000) 2019-10-23T11:36:06.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:06.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:06.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:06.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:07.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:36:07.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:07.537438+0000) 2019-10-23T11:36:07.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:07.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:07.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:07.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:08.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:08.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:08.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:08.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:09.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:09.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:09.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:09.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:10.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:10.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:10.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:10.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:11.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:11.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:11.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:11.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:12.046 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:36:12.042+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:12.044088+0000) 2019-10-23T11:36:12.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:12.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:12.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:12.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:13.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:13.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:13.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:13.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:14.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:36:14.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:14.524098+0000) 2019-10-23T11:36:14.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:14.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:14.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:14.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:15.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:36:15.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:15.524544+0000) 2019-10-23T11:36:15.545 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:36:15.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:15.540827+0000) 2019-10-23T11:36:15.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:15.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:15.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:15.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:16.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:36:16.503+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:16.504713+0000) 2019-10-23T11:36:16.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:16.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:16.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:16.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:17.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:36:17.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:17.537549+0000) 2019-10-23T11:36:17.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:17.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:17.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:17.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:19.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:18.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:19.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:18.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:20.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:19.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:20.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:19.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:21.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:21.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:21.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:21.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:21.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:21.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:21.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:21.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:22.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:36:22.042+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:22.044204+0000) 2019-10-23T11:36:22.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:22.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:22.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:22.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:23.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:23.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:23.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:23.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:24.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:36:24.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:24.524193+0000) 2019-10-23T11:36:24.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:24.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:24.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:24.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:25.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:36:25.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:25.524641+0000) 2019-10-23T11:36:25.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:36:25.539+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:25.540941+0000) 2019-10-23T11:36:25.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:25.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:25.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:25.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:26.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:36:26.503+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:26.504810+0000) 2019-10-23T11:36:27.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:26.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:27.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:26.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:27.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:36:27.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:27.537659+0000) 2019-10-23T11:36:28.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:28.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:28.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:28.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:29.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:29.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:29.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:29.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:30.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:30.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:30.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:30.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:31.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:31.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:31.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:31.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:32.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:36:32.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:32.044321+0000) 2019-10-23T11:36:32.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:32.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:32.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:32.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:33.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:33.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:33.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:33.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:34.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:34.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:34.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:34.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:34.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:36:34.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:34.524293+0000) 2019-10-23T11:36:34.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:34.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:34.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:34.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:35.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:36:35.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:35.524740+0000) 2019-10-23T11:36:35.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:36:35.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:35.541060+0000) 2019-10-23T11:36:35.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:35.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:35.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:35.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:36.507 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:36:36.503+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:36.504907+0000) 2019-10-23T11:36:36.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:36.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:36.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:36.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:37.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:36:37.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:37.537767+0000) 2019-10-23T11:36:37.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:37.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:37.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:37.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:38.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:38.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:38.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:38.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:39.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:39.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:39.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:39.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:40.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:40.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:40.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:40.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:41.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:41.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:41.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:41.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:42.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:36:42.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:42.044440+0000) 2019-10-23T11:36:42.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:42.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:42.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:42.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:43.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:43.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:43.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:43.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:44.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:36:44.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:44.524386+0000) 2019-10-23T11:36:44.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:44.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:44.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:44.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:45.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:36:45.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:45.524836+0000) 2019-10-23T11:36:45.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:36:45.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:45.541176+0000) 2019-10-23T11:36:45.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:45.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:45.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:45.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:46.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:36:46.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:46.505003+0000) 2019-10-23T11:36:46.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:46.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:46.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:46.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:47.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:36:47.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:47.537888+0000) 2019-10-23T11:36:47.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:47.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:47.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:47.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:48.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:48.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:48.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:48.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:49.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:49.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:49.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:49.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:50.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:50.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:50.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:50.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:51.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:51.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:51.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:51.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:52.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:36:52.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:52.044553+0000) 2019-10-23T11:36:52.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:52.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:52.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:52.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:53.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:53.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:53.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:53.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:54.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:36:54.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:54.524480+0000) 2019-10-23T11:36:54.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:54.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:54.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:54.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:55.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:36:55.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:55.524931+0000) 2019-10-23T11:36:55.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:36:55.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:55.541291+0000) 2019-10-23T11:36:55.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:55.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:55.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:55.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:56.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:36:56.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:56.505099+0000) 2019-10-23T11:36:56.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:56.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:56.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:56.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:57.540 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:36:57.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:36:57.537996+0000) 2019-10-23T11:36:57.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:57.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:57.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:57.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:58.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:58.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:58.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:58.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:36:59.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:59.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:36:59.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:36:59.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:00.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:00.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:00.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:00.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:01.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:01.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:01.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:01.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:02.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:37:02.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:02.044670+0000) 2019-10-23T11:37:02.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:02.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:02.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:02.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:03.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:03.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:03.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:03.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:04.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:37:04.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:04.524577+0000) 2019-10-23T11:37:04.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:04.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:04.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:04.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:05.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:37:05.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:05.525026+0000) 2019-10-23T11:37:05.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:37:05.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:05.541405+0000) 2019-10-23T11:37:05.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:05.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:05.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:05.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:06.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:37:06.503+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:06.505190+0000) 2019-10-23T11:37:06.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:06.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:06.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:06.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:07.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:37:07.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:07.538103+0000) 2019-10-23T11:37:07.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:07.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:07.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:07.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:08.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:08.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:08.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:08.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:09.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:09.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:09.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:09.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:10.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:10.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:10.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:10.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:11.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:11.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:11.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:11.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:12.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:37:12.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:12.044796+0000) 2019-10-23T11:37:12.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:12.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:12.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:12.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:13.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:13.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:13.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:13.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:14.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:37:14.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:14.524674+0000) 2019-10-23T11:37:14.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:14.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:14.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:14.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:15.527 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:37:15.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:15.525123+0000) 2019-10-23T11:37:15.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:37:15.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:15.541531+0000) 2019-10-23T11:37:15.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:15.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:15.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:15.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:16.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:37:16.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:16.505293+0000) 2019-10-23T11:37:16.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:16.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:16.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:16.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:17.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:37:17.536+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:17.538215+0000) 2019-10-23T11:37:17.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:17.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:17.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:17.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:18.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:18.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:18.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:18.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:19.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:19.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:19.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:19.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:20.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:20.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:20.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:20.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:21.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:21.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:21.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:21.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:22.053 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:37:22.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:22.044914+0000) 2019-10-23T11:37:22.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:22.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:22.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:22.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:23.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:23.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:23.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:23.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:24.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:37:24.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:24.524772+0000) 2019-10-23T11:37:24.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:24.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:24.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:24.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:25.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:37:25.523+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:25.525220+0000) 2019-10-23T11:37:25.546 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:37:25.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:25.541648+0000) 2019-10-23T11:37:25.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:25.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:25.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:25.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:26.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:37:26.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:26.505390+0000) 2019-10-23T11:37:26.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:26.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:26.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:26.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:27.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:37:27.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:27.538323+0000) 2019-10-23T11:37:27.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:27.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:27.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:27.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:28.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:28.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:28.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:28.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:29.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:29.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:29.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:29.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:30.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:30.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:30.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:30.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:31.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:31.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:31.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:31.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:32.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:37:32.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:32.045027+0000) 2019-10-23T11:37:32.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:32.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:32.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:32.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:33.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:33.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:33.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:33.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:34.529 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:37:34.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:34.524866+0000) 2019-10-23T11:37:34.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:34.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:34.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:34.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:35.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:37:35.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:35.525299+0000) 2019-10-23T11:37:35.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:37:35.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:35.541767+0000) 2019-10-23T11:37:35.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:35.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:35.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:35.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:36.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:37:36.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:36.505486+0000) 2019-10-23T11:37:36.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:36.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:36.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:36.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:37.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:37:37.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:37.538440+0000) 2019-10-23T11:37:37.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:37.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:37.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:37.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:38.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:38.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:38.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:38.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:39.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:39.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:39.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:39.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:40.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:40.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:40.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:40.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:41.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:41.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:41.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:41.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:42.047 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:37:42.043+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:42.045147+0000) 2019-10-23T11:37:42.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:42.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:42.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:42.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:43.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:43.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:43.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:43.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:44.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:37:44.523+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:44.524964+0000) 2019-10-23T11:37:44.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:44.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:44.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:44.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:45.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:37:45.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:45.525397+0000) 2019-10-23T11:37:45.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:37:45.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:45.541878+0000) 2019-10-23T11:37:45.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:45.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:45.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:45.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:46.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:37:46.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:46.505582+0000) 2019-10-23T11:37:46.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:46.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:46.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:46.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:47.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:37:47.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:47.538554+0000) 2019-10-23T11:37:47.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:47.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:47.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:47.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:48.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:48.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:48.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:48.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:49.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:49.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:49.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:49.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:50.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:50.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:50.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:50.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:51.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:51.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:51.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:51.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:52.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:37:52.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:52.045262+0000) 2019-10-23T11:37:52.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:52.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:52.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:52.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:53.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:53.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:53.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:53.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:54.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:37:54.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:54.525063+0000) 2019-10-23T11:37:54.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:54.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:54.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:54.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:55.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:37:55.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:55.525499+0000) 2019-10-23T11:37:55.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:37:55.540+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:55.541994+0000) 2019-10-23T11:37:55.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:55.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:55.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:55.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:56.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:37:56.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:56.505675+0000) 2019-10-23T11:37:56.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:56.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:56.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:56.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:57.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:37:57.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:37:57.538666+0000) 2019-10-23T11:37:57.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:57.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:57.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:57.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:58.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:58.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:58.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:58.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:37:59.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:59.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:37:59.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:37:59.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:00.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:00.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:00.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:00.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:01.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:01.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:01.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:01.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:02.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:38:02.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:02.045380+0000) 2019-10-23T11:38:02.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:02.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:02.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:02.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:03.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:03.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:03.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:03.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:04.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:38:04.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:04.525154+0000) 2019-10-23T11:38:04.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:04.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:04.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:04.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:05.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:38:05.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:05.525595+0000) 2019-10-23T11:38:05.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:38:05.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:05.542110+0000) 2019-10-23T11:38:05.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:05.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:05.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:05.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:06.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:38:06.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:06.505776+0000) 2019-10-23T11:38:06.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:06.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:06.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:06.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:07.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:38:07.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:07.538772+0000) 2019-10-23T11:38:07.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:07.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:07.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:07.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:08.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:08.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:08.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:08.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:09.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:09.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:09.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:09.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:10.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:10.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:11.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:11.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:11.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:11.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:12.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:38:12.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:12.045494+0000) 2019-10-23T11:38:12.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:12.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:12.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:12.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:13.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:13.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:13.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:13.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:14.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:38:14.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:14.525251+0000) 2019-10-23T11:38:14.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:14.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:14.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:14.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:15.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:38:15.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:15.525696+0000) 2019-10-23T11:38:15.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:38:15.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:15.542227+0000) 2019-10-23T11:38:15.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:15.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:15.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:15.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:16.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:38:16.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:16.505875+0000) 2019-10-23T11:38:16.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:16.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:16.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:16.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:17.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:38:17.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:17.538883+0000) 2019-10-23T11:38:17.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:17.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:17.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:17.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:18.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:18.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:18.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:18.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:19.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:19.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:19.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:19.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:20.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:20.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:20.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:20.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:21.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:21.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:21.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:21.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:22.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:38:22.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:22.045613+0000) 2019-10-23T11:38:22.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:22.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:22.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:22.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:23.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:23.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:23.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:23.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:24.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:38:24.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:24.525351+0000) 2019-10-23T11:38:24.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:24.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:24.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:24.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:25.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:38:25.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:25.525794+0000) 2019-10-23T11:38:25.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:38:25.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:25.542347+0000) 2019-10-23T11:38:25.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:25.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:25.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:25.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:26.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:38:26.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:26.505967+0000) 2019-10-23T11:38:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:26.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:26.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:26.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:27.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:38:27.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:27.538995+0000) 2019-10-23T11:38:27.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:27.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:27.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:27.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:28.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:28.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:28.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:28.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:29.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:29.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:29.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:29.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:30.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:30.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:30.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:30.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:31.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:31.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:31.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:31.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:32.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:38:32.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:32.045727+0000) 2019-10-23T11:38:32.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:32.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:32.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:32.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:33.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:33.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:33.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:33.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:34.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:38:34.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:34.525452+0000) 2019-10-23T11:38:34.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:34.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:34.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:34.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:35.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:38:35.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:35.525896+0000) 2019-10-23T11:38:35.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:38:35.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:35.542464+0000) 2019-10-23T11:38:35.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:35.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:35.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:35.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:36.508 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:38:36.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:36.506061+0000) 2019-10-23T11:38:36.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:36.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:36.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:36.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:37.541 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:38:37.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:37.539106+0000) 2019-10-23T11:38:37.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:37.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:37.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:37.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:38.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:38.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:38.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:38.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:39.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:39.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:39.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:39.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:40.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:40.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:40.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:40.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:41.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:41.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:41.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:41.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:42.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:38:42.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:42.045840+0000) 2019-10-23T11:38:42.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:42.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:42.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:42.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:43.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:43.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:43.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:43.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:44.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:38:44.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:44.525550+0000) 2019-10-23T11:38:44.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:44.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:44.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:44.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:45.528 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:38:45.524+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:45.525995+0000) 2019-10-23T11:38:45.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:38:45.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:45.542579+0000) 2019-10-23T11:38:45.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:45.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:45.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:45.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:46.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:38:46.504+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:46.506152+0000) 2019-10-23T11:38:46.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:46.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:46.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:46.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:47.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:38:47.537+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:47.539218+0000) 2019-10-23T11:38:47.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:47.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:47.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:47.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:48.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:48.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:48.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:48.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:49.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:49.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:49.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:49.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:50.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:50.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:50.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:50.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:51.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:51.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:51.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:51.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:52.048 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:38:52.044+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:52.045954+0000) 2019-10-23T11:38:52.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:52.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:52.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:52.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:53.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:53.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:53.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:53.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:54.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:38:54.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:54.525648+0000) 2019-10-23T11:38:54.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:54.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:54.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:54.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:55.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:38:55.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:55.526092+0000) 2019-10-23T11:38:55.548 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:38:55.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:55.542693+0000) 2019-10-23T11:38:55.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:55.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:55.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:55.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:56.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:38:56.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:56.506243+0000) 2019-10-23T11:38:56.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:56.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:56.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:56.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:57.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:38:57.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:38:57.539321+0000) 2019-10-23T11:38:57.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:57.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:57.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:57.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:58.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:58.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:58.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:58.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:38:59.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:59.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:38:59.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:38:59.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:00.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:00.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:00.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:00.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:01.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:01.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:01.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:01.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:02.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:39:02.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:02.046071+0000) 2019-10-23T11:39:02.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:02.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:02.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:02.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:03.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:03.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:03.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:03.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:04.530 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:39:04.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:04.525746+0000) 2019-10-23T11:39:04.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:04.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:04.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:04.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:05.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:39:05.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:05.526189+0000) 2019-10-23T11:39:05.547 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:39:05.541+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:05.542848+0000) 2019-10-23T11:39:05.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:05.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:05.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:05.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:06.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:39:06.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:06.506340+0000) 2019-10-23T11:39:06.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:06.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:06.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:06.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:07.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:39:07.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:07.539427+0000) 2019-10-23T11:39:07.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:07.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:07.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:07.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:08.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:08.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:08.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:08.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:09.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:09.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:09.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:09.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:10.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:10.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:10.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:10.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:11.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:11.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:11.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:11.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:12.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:39:12.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:12.046187+0000) 2019-10-23T11:39:12.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:12.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:12.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:12.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:13.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:13.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:13.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:14.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:39:14.524+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:14.525886+0000) 2019-10-23T11:39:14.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:14.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:14.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:14.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:15.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:39:15.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:15.526298+0000) 2019-10-23T11:39:15.548 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:39:15.542+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:15.543085+0000) 2019-10-23T11:39:15.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:15.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:28:39.477981+0000 (oldest deadline 2019-10-23T11:28:59.477981+0000) 2019-10-23T11:39:15.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:15.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:16.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:39:16.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:16.506440+0000) 2019-10-23T11:39:16.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:16.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:17.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:39:17.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:17.539534+0000) 2019-10-23T11:39:17.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:17.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:18.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:18.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:19.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:19.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:20.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:20.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:21.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:21.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:22.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:39:22.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:22.046311+0000) 2019-10-23T11:39:22.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:22.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:23.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:23.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:24.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:39:24.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:24.526061+0000) 2019-10-23T11:39:24.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:24.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:25.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:39:25.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:25.526394+0000) 2019-10-23T11:39:25.548 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:39:25.542+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:25.543309+0000) 2019-10-23T11:39:25.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:25.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:26.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:39:26.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:26.506538+0000) 2019-10-23T11:39:26.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:26.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:27.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:39:27.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:27.539646+0000) 2019-10-23T11:39:27.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:27.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:28.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:28.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:29.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:29.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:30.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:30.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:31.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:31.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:32.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:39:32.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:32.046423+0000) 2019-10-23T11:39:32.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:32.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:33.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:33.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:34.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:39:34.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:34.526258+0000) 2019-10-23T11:39:34.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:34.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:35.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:39:35.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:35.526493+0000) 2019-10-23T11:39:35.548 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:39:35.542+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:35.543574+0000) 2019-10-23T11:39:35.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:35.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:36.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:39:36.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:36.506629+0000) 2019-10-23T11:39:36.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:36.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:37.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:39:37.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:37.539758+0000) 2019-10-23T11:39:37.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:37.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:38.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:38.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:39.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:39.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:40.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:40.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:40.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:40.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:41.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:41.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:41.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:41.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:42.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:39:42.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:42.046542+0000) 2019-10-23T11:39:42.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:42.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:42.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:42.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:43.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:43.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:43.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:43.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:44.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:39:44.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:44.526405+0000) 2019-10-23T11:39:44.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:44.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:44.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:44.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:45.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:39:45.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:45.526590+0000) 2019-10-23T11:39:45.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:39:45.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:45.543718+0000) 2019-10-23T11:39:45.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:45.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:45.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:45.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:46.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:39:46.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:46.506723+0000) 2019-10-23T11:39:46.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:46.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:46.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:46.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:47.542 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:39:47.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:47.539872+0000) 2019-10-23T11:39:47.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:47.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:47.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:47.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:48.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:48.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:48.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:48.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:49.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:49.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:49.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:49.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:50.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:50.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:50.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:50.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:51.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:51.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:51.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:51.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:52.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:39:52.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:52.046660+0000) 2019-10-23T11:39:52.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:52.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:52.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:52.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:53.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:53.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:53.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:53.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:54.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:39:54.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:54.526502+0000) 2019-10-23T11:39:54.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:54.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:54.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:54.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:55.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:39:55.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:55.526686+0000) 2019-10-23T11:39:55.548 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:39:55.542+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:55.543833+0000) 2019-10-23T11:39:55.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:55.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:55.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:55.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:56.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:39:56.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:56.506815+0000) 2019-10-23T11:39:56.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:56.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:56.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:56.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:57.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:39:57.538+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:39:57.539977+0000) 2019-10-23T11:39:57.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:57.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:57.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:57.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:58.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:58.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:58.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:58.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:39:59.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:59.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:39:59.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:39:59.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:00.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:00.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:00.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:00.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:01.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:01.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:01.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:01.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:02.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:40:02.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:02.046777+0000) 2019-10-23T11:40:02.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:02.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:02.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:02.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:03.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:03.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:03.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:03.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:04.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:40:04.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:04.526596+0000) 2019-10-23T11:40:04.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:04.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:04.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:04.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:05.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:40:05.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:05.526777+0000) 2019-10-23T11:40:05.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:40:05.542+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:05.543951+0000) 2019-10-23T11:40:05.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:05.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:05.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:05.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:06.509 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:40:06.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:06.506912+0000) 2019-10-23T11:40:06.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:06.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:06.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:06.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:07.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:40:07.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:07.540087+0000) 2019-10-23T11:40:07.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:07.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:07.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:07.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:08.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:08.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:08.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:08.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:09.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:09.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:09.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:09.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:10.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:10.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:10.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:10.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:11.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:11.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:11.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:11.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:12.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:40:12.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:12.046887+0000) 2019-10-23T11:40:12.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:12.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:12.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:12.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:13.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:13.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:13.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:13.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:14.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:40:14.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:14.526688+0000) 2019-10-23T11:40:14.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:14.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:14.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:14.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:15.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:40:15.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:15.526875+0000) 2019-10-23T11:40:15.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:40:15.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:15.544073+0000) 2019-10-23T11:40:15.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:15.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:15.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:15.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:16.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:40:16.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:16.507046+0000) 2019-10-23T11:40:16.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:16.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:16.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:16.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:17.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:40:17.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:17.540258+0000) 2019-10-23T11:40:17.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:17.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:17.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:17.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:18.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:18.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:18.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:18.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:19.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:19.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:19.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:19.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:20.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:20.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:20.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:20.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:21.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:21.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:21.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:21.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:22.049 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:40:22.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:22.047003+0000) 2019-10-23T11:40:22.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:22.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:22.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:22.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:23.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:23.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:23.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:23.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:24.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:40:24.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:24.526788+0000) 2019-10-23T11:40:24.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:24.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:24.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:24.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:25.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:40:25.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:25.526970+0000) 2019-10-23T11:40:25.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:40:25.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:25.544189+0000) 2019-10-23T11:40:25.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:25.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:25.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:25.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:26.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:40:26.505+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:26.507190+0000) 2019-10-23T11:40:26.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:26.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:26.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:26.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:27.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:40:27.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:27.540419+0000) 2019-10-23T11:40:27.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:27.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:27.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:27.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:28.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:28.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:28.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:28.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:29.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:29.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:29.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:29.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:30.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:30.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:30.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:30.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:31.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:31.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:31.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:31.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:32.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:40:32.045+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:32.047168+0000) 2019-10-23T11:40:32.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:32.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:32.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:32.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:33.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:33.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:33.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:33.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:34.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:40:34.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:34.526888+0000) 2019-10-23T11:40:34.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:34.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:34.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:34.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:35.529 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:40:35.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:35.527064+0000) 2019-10-23T11:40:35.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:40:35.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:35.544304+0000) 2019-10-23T11:40:35.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:35.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:35.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:35.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:36.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:40:36.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:36.507290+0000) 2019-10-23T11:40:36.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:36.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:36.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:36.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:37.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:40:37.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:37.540529+0000) 2019-10-23T11:40:37.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:37.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:37.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:37.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:38.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:38.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:38.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:38.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:39.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:39.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:39.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:39.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:40.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:40.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:40.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:40.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:41.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:41.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:41.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:41.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:42.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:40:42.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:42.047315+0000) 2019-10-23T11:40:42.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:42.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:42.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:42.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:43.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:43.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:43.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:43.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:44.531 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:40:44.525+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:44.526985+0000) 2019-10-23T11:40:44.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:44.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:44.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:44.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:45.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:40:45.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:45.527160+0000) 2019-10-23T11:40:45.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:40:45.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:45.544434+0000) 2019-10-23T11:40:45.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:45.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:45.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:45.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:46.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:40:46.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:46.507387+0000) 2019-10-23T11:40:46.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:46.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:46.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:46.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:47.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:40:47.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:47.540635+0000) 2019-10-23T11:40:47.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:47.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:47.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:47.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:48.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:48.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:48.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:48.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:49.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:49.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:49.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:49.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:50.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:50.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:50.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:50.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:51.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:51.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:52.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:40:52.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:52.047431+0000) 2019-10-23T11:40:52.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:52.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:52.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:52.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:53.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:53.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:53.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:53.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:54.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:40:54.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:54.527081+0000) 2019-10-23T11:40:54.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:54.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:54.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:54.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:55.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:40:55.525+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:55.527252+0000) 2019-10-23T11:40:55.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:40:55.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:55.544555+0000) 2019-10-23T11:40:55.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:55.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:55.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:55.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:56.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:40:56.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:56.507481+0000) 2019-10-23T11:40:56.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:56.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:56.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:56.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:57.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:40:57.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:40:57.540748+0000) 2019-10-23T11:40:57.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:57.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:57.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:57.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:58.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:58.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:58.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:58.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:40:59.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:59.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:40:59.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:40:59.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:00.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:00.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:00.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:00.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:01.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:01.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:01.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:01.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:02.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:41:02.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:02.047556+0000) 2019-10-23T11:41:02.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:02.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:02.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:02.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:03.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:03.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:03.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:03.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:04.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:41:04.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:04.527176+0000) 2019-10-23T11:41:04.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:04.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:04.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:04.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:05.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:41:05.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:05.527350+0000) 2019-10-23T11:41:05.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:41:05.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:05.544669+0000) 2019-10-23T11:41:05.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:05.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:05.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:05.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:06.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:41:06.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:06.507579+0000) 2019-10-23T11:41:06.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:06.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:06.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:06.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:07.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:41:07.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:07.540859+0000) 2019-10-23T11:41:07.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:07.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:07.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:07.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:08.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:08.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:08.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:08.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:09.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:09.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:09.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:09.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:10.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:10.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:10.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:10.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:11.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:11.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:11.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:11.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:12.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:41:12.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:12.047672+0000) 2019-10-23T11:41:12.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:12.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:12.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:12.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:13.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:13.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:13.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:13.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:14.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:41:14.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:14.527270+0000) 2019-10-23T11:41:14.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:14.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:14.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:14.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:15.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:41:15.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:15.527442+0000) 2019-10-23T11:41:15.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:41:15.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:15.544778+0000) 2019-10-23T11:41:15.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:15.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:15.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:15.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:16.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:41:16.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:16.507674+0000) 2019-10-23T11:41:16.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:16.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:16.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:16.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:17.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:41:17.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:17.540966+0000) 2019-10-23T11:41:17.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:17.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:17.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:17.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:18.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:18.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:18.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:18.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:19.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:19.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:19.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:19.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:20.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:20.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:20.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:20.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:21.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:21.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:21.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:21.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:22.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:41:22.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:22.047784+0000) 2019-10-23T11:41:22.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:22.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:22.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:22.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:23.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:23.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:23.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:23.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:24.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:41:24.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:24.527368+0000) 2019-10-23T11:41:24.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:24.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:24.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:24.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:25.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:41:25.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:25.527538+0000) 2019-10-23T11:41:25.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:41:25.543+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:25.544893+0000) 2019-10-23T11:41:25.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:25.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:25.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:25.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:26.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:41:26.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:26.507771+0000) 2019-10-23T11:41:26.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:26.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:26.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:26.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:27.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:27.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:27.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:27.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:27.543 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:41:27.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:27.541072+0000) 2019-10-23T11:41:28.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:28.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:28.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:28.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:29.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:29.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:29.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:29.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:30.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:30.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:30.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:30.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:31.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:31.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:31.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:31.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:32.050 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:41:32.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:32.047894+0000) 2019-10-23T11:41:32.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:32.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:32.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:32.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:33.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:33.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:33.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:33.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:34.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:41:34.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:34.527466+0000) 2019-10-23T11:41:34.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:34.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:34.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:34.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:35.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:41:35.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:35.527636+0000) 2019-10-23T11:41:35.549 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:41:35.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:35.545015+0000) 2019-10-23T11:41:35.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:35.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:35.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:35.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:36.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:41:36.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:36.507870+0000) 2019-10-23T11:41:36.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:36.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:36.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:36.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:37.544 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:41:37.539+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:37.541183+0000) 2019-10-23T11:41:37.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:37.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:37.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:37.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:38.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:38.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:38.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:38.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:39.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:39.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:39.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:39.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:40.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:40.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:40.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:40.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:41.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:41.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:41.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:41.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:42.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:41:42.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:42.048004+0000) 2019-10-23T11:41:42.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:42.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:42.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:42.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:43.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:43.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:43.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:43.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:44.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:41:44.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:44.527564+0000) 2019-10-23T11:41:44.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:44.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:44.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:44.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:45.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:41:45.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:45.527736+0000) 2019-10-23T11:41:45.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:41:45.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:45.545139+0000) 2019-10-23T11:41:45.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:45.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:45.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:45.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:46.510 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:41:46.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:46.507967+0000) 2019-10-23T11:41:46.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:46.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:46.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:46.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:47.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:41:47.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:47.541301+0000) 2019-10-23T11:41:47.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:47.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:47.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:47.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:48.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:48.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:48.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:48.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:49.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:49.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:49.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:49.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:50.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:50.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:50.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:50.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:51.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:51.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:51.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:51.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:52.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:41:52.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:52.048119+0000) 2019-10-23T11:41:52.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:52.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:52.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:52.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:53.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:53.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:53.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:53.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:54.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:41:54.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:54.527658+0000) 2019-10-23T11:41:54.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:54.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:54.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:54.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:55.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:41:55.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:55.527829+0000) 2019-10-23T11:41:55.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:41:55.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:55.545267+0000) 2019-10-23T11:41:55.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:55.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:55.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:55.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:56.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:41:56.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:56.508059+0000) 2019-10-23T11:41:56.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:56.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:56.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:56.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:57.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:57.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:57.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:57.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:57.546 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:41:57.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:41:57.541414+0000) 2019-10-23T11:41:58.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:58.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:58.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:58.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:41:59.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:59.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:41:59.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:41:59.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:00.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:00.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:00.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:00.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:01.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:01.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:01.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:01.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:02.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:42:02.046+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:02.048226+0000) 2019-10-23T11:42:02.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:02.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:02.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:02.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:03.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:03.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:03.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:03.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:04.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:04.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:04.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:04.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:04.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:42:04.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:04.527757+0000) 2019-10-23T11:42:05.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:05.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:05.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:05.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:05.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:42:05.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:05.527920+0000) 2019-10-23T11:42:05.553 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:42:05.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:05.545387+0000) 2019-10-23T11:42:06.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:06.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:06.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:06.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:06.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:42:06.506+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:06.508152+0000) 2019-10-23T11:42:07.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:07.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:07.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:07.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:07.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:42:07.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:07.541530+0000) 2019-10-23T11:42:08.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:08.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:08.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:08.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:09.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:09.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:09.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:09.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:10.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:10.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:10.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:10.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:11.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:11.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:11.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:11.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:12.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:42:12.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:12.048349+0000) 2019-10-23T11:42:12.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:12.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:12.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:12.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:13.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:13.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:13.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:13.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:14.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:14.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:14.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:14.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:14.532 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:42:14.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:14.527855+0000) 2019-10-23T11:42:15.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:15.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:15.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:15.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:15.530 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:42:15.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:15.528016+0000) 2019-10-23T11:42:15.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:42:15.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:15.545506+0000) 2019-10-23T11:42:16.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:16.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:16.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:16.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:16.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:42:16.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:16.508248+0000) 2019-10-23T11:42:17.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:17.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:17.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:17.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:17.544 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:42:17.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:17.541647+0000) 2019-10-23T11:42:18.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:18.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:18.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:18.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:19.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:19.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:19.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:19.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:20.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:20.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:20.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:20.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:21.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:21.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:21.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:21.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:22.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:42:22.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:22.048467+0000) 2019-10-23T11:42:22.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:22.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:22.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:22.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:23.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:23.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:23.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:23.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:24.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:24.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:24.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:24.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:24.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:42:24.526+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:24.527955+0000) 2019-10-23T11:42:25.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:25.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:25.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:25.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:25.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:42:25.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:25.528112+0000) 2019-10-23T11:42:25.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:42:25.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:25.545619+0000) 2019-10-23T11:42:26.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:26.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:26.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:26.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:26.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:42:26.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:26.508297+0000) 2019-10-23T11:42:27.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:27.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:27.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:27.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:27.544 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:42:27.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:27.541761+0000) 2019-10-23T11:42:28.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:28.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:28.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:28.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:29.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:29.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:29.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:29.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:30.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:30.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:30.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:30.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:31.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:31.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:31.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:31.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:32.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:42:32.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:32.048585+0000) 2019-10-23T11:42:32.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:32.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:32.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:32.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:33.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:33.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:33.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:33.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:34.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:34.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:34.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:34.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:34.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:42:34.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:34.528051+0000) 2019-10-23T11:42:35.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:35.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:35.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:35.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:35.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:42:35.526+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:35.528208+0000) 2019-10-23T11:42:35.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:42:35.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:35.545738+0000) 2019-10-23T11:42:36.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:36.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:36.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:36.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:36.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:42:36.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:36.508387+0000) 2019-10-23T11:42:37.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:37.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:37.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:37.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:37.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:42:37.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:37.541875+0000) 2019-10-23T11:42:38.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:38.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:38.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:38.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:39.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:39.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:39.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:39.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:40.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:40.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:40.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:40.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:41.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:41.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:41.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:41.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:42.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:42:42.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:42.048700+0000) 2019-10-23T11:42:42.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:42.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:42.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:42.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:43.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:43.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:43.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:43.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:44.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:44.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:44.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:44.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:44.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:42:44.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:44.528150+0000) 2019-10-23T11:42:45.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:45.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:45.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:45.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:45.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:42:45.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:45.528305+0000) 2019-10-23T11:42:45.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:42:45.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:45.545852+0000) 2019-10-23T11:42:46.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:46.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:46.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:46.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:46.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:42:46.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:46.508486+0000) 2019-10-23T11:42:47.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:47.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:47.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:47.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:47.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:42:47.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:47.541987+0000) 2019-10-23T11:42:48.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:48.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:48.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:48.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:49.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:49.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:49.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:49.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:50.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:50.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:50.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:50.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:51.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:51.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:51.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:51.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:52.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:42:52.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:52.048809+0000) 2019-10-23T11:42:52.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:52.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:52.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:52.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:53.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:53.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:53.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:53.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:54.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:54.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:54.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:54.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:54.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:42:54.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:54.528245+0000) 2019-10-23T11:42:55.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:55.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:55.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:55.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:55.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:42:55.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:55.528405+0000) 2019-10-23T11:42:55.550 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:42:55.544+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:55.545970+0000) 2019-10-23T11:42:56.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:56.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:56.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:56.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:56.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:42:56.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:56.508580+0000) 2019-10-23T11:42:57.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:57.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:57.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:57.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:57.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:42:57.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:42:57.542099+0000) 2019-10-23T11:42:58.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:58.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:58.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:58.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:42:59.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:59.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:42:59.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:42:59.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:00.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:00.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:00.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:00.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:01.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:01.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:01.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:01.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:02.051 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:43:02.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:02.048923+0000) 2019-10-23T11:43:02.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:02.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:02.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:02.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:03.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:03.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:03.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:03.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:04.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:04.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:04.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:04.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:04.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:43:04.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:04.528344+0000) 2019-10-23T11:43:05.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:05.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:05.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:05.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:05.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:43:05.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:05.528503+0000) 2019-10-23T11:43:05.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:43:05.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:05.546090+0000) 2019-10-23T11:43:06.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:06.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:06.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:06.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:06.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:43:06.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:06.508703+0000) 2019-10-23T11:43:07.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:07.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:07.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:07.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:07.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:43:07.540+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:07.542224+0000) 2019-10-23T11:43:08.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:08.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:08.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:08.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:09.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:09.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:09.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:09.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:10.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:10.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:10.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:10.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:11.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:11.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:11.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:11.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:12.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:43:12.047+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:12.049040+0000) 2019-10-23T11:43:12.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:12.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:12.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:12.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:13.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:13.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:13.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:13.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:14.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:14.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:14.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:14.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:14.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:43:14.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:14.528442+0000) 2019-10-23T11:43:15.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:15.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:15.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:15.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:15.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:43:15.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:15.528600+0000) 2019-10-23T11:43:15.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:43:15.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:15.546207+0000) 2019-10-23T11:43:16.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:16.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:16.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:16.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:16.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:43:16.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:16.508795+0000) 2019-10-23T11:43:17.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:17.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:17.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:17.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:17.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:43:17.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:17.542335+0000) 2019-10-23T11:43:18.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:18.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:18.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:18.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:19.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:19.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:19.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:19.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:20.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:20.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:20.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:20.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:21.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:21.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:21.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:21.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:22.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:43:22.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:22.049152+0000) 2019-10-23T11:43:22.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:22.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:22.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:22.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:23.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:23.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:23.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:23.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:24.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:24.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:24.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:24.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:24.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:43:24.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:24.528539+0000) 2019-10-23T11:43:25.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:25.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:25.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:25.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:25.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:43:25.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:25.528699+0000) 2019-10-23T11:43:25.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:43:25.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:25.546320+0000) 2019-10-23T11:43:26.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:26.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:26.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:26.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:26.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:43:26.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:26.508889+0000) 2019-10-23T11:43:27.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:27.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:27.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:27.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:27.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:43:27.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:27.542447+0000) 2019-10-23T11:43:28.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:28.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:28.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:28.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:29.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:29.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:29.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:29.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:30.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:30.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:30.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:30.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:31.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:31.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:31.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:31.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:32.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:43:32.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:32.049262+0000) 2019-10-23T11:43:32.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:32.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:32.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:32.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:33.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:33.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:33.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:33.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:34.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:34.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:34.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:34.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:34.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:43:34.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:34.528636+0000) 2019-10-23T11:43:35.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:35.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:35.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:35.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:35.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:43:35.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:35.528796+0000) 2019-10-23T11:43:35.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:43:35.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:35.546441+0000) 2019-10-23T11:43:36.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:36.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:36.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:36.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:36.511 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:43:36.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:36.508984+0000) 2019-10-23T11:43:37.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:37.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:37.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:37.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:37.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:43:37.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:37.542555+0000) 2019-10-23T11:43:38.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:38.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:38.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:38.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:39.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:39.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:39.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:39.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:40.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:40.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:40.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:40.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:41.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:41.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:41.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:41.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:42.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:43:42.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:42.049381+0000) 2019-10-23T11:43:42.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:42.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:42.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:42.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:43.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:43.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:44.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:44.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:44.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:44.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:44.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:43:44.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:44.528734+0000) 2019-10-23T11:43:45.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:45.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:45.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:45.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:45.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:43:45.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:45.528890+0000) 2019-10-23T11:43:45.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:43:45.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:45.546554+0000) 2019-10-23T11:43:46.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:46.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:46.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:46.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:46.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:43:46.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:46.509080+0000) 2019-10-23T11:43:47.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:47.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:47.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:47.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:47.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:43:47.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:47.542660+0000) 2019-10-23T11:43:48.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:48.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:48.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:48.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:49.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:49.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:49.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:49.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:50.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:50.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:50.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:50.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:51.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:51.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:51.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:51.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:52.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:43:52.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:52.049491+0000) 2019-10-23T11:43:52.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:52.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:52.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:52.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:53.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:53.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:53.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:53.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:54.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:54.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:54.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:54.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:54.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:43:54.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:54.528830+0000) 2019-10-23T11:43:55.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:55.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:55.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:55.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:55.531 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:43:55.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:55.528979+0000) 2019-10-23T11:43:55.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:43:55.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:55.546670+0000) 2019-10-23T11:43:56.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:56.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:56.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:56.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:56.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:43:56.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:56.509172+0000) 2019-10-23T11:43:57.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:57.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:57.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:57.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:57.546 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:43:57.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:43:57.542767+0000) 2019-10-23T11:43:58.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:58.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:58.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:58.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:43:59.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:59.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:43:59.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:43:59.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:00.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:00.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:00.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:00.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:01.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:01.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:01.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:01.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:02.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:44:02.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:02.049605+0000) 2019-10-23T11:44:02.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:02.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:02.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:02.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:03.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:03.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:03.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:03.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:04.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:04.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:04.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:04.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:04.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:44:04.527+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:04.528930+0000) 2019-10-23T11:44:05.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:05.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:05.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:05.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:05.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:44:05.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:05.529074+0000) 2019-10-23T11:44:05.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:44:05.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:05.546793+0000) 2019-10-23T11:44:06.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:06.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:06.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:06.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:06.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:44:06.507+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:06.509266+0000) 2019-10-23T11:44:07.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:07.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:07.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:07.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:07.545 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:44:07.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:07.542875+0000) 2019-10-23T11:44:08.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:08.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:08.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:08.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:09.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:09.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:09.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:09.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:10.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:10.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:10.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:10.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:11.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:11.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:11.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:11.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:12.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:44:12.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:12.049721+0000) 2019-10-23T11:44:12.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:12.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:12.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:12.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:13.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:13.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:13.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:13.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:14.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:14.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:14.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:14.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:14.533 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:44:14.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:14.529028+0000) 2019-10-23T11:44:15.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:15.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:15.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:15.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:15.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:44:15.527+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:15.529167+0000) 2019-10-23T11:44:15.551 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:44:15.545+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:15.546911+0000) 2019-10-23T11:44:16.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:16.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:16.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:16.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:16.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:44:16.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:16.509365+0000) 2019-10-23T11:44:17.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:17.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:17.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:17.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:17.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:44:17.541+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:17.542985+0000) 2019-10-23T11:44:18.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:18.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:18.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:18.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:19.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:19.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:19.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:19.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:20.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:20.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:20.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:20.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:21.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:21.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:21.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:21.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:22.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:44:22.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:22.049834+0000) 2019-10-23T11:44:22.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:22.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:22.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:22.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:23.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:23.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:23.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:23.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:24.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:24.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:24.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:24.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:24.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:44:24.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:24.529128+0000) 2019-10-23T11:44:25.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:25.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:25.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:25.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:25.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:44:25.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:25.529265+0000) 2019-10-23T11:44:25.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:44:25.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:25.547037+0000) 2019-10-23T11:44:26.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:26.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:26.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:26.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:26.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:44:26.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:26.509459+0000) 2019-10-23T11:44:27.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:27.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:27.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:27.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:27.546 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:44:27.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:27.543090+0000) 2019-10-23T11:44:28.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:28.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:28.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:28.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:29.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:29.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:29.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:29.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:30.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:30.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:30.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:30.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:31.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:31.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:31.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:31.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:32.052 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:44:32.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:32.049947+0000) 2019-10-23T11:44:32.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:32.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:32.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:32.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:33.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:33.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:33.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:33.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:34.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:34.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:34.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:34.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:34.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:44:34.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:34.529227+0000) 2019-10-23T11:44:35.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:35.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:35.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:35.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:35.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:44:35.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:35.529366+0000) 2019-10-23T11:44:35.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:44:35.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:35.547153+0000) 2019-10-23T11:44:36.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:36.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:36.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:36.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:36.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:44:36.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:36.509593+0000) 2019-10-23T11:44:37.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:37.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:37.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:37.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:37.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:44:37.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:37.543253+0000) 2019-10-23T11:44:38.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:38.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:38.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:38.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:39.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:39.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:39.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:39.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:40.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:40.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:40.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:40.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:41.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:41.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:41.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:41.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:42.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:44:42.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:42.050058+0000) 2019-10-23T11:44:42.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:42.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:42.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:42.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:43.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:43.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:43.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:43.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:44.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:44.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:44.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:44.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:44.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:44:44.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:44.529319+0000) 2019-10-23T11:44:45.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:45.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:45.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:45.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:45.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:44:45.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:45.529461+0000) 2019-10-23T11:44:45.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:44:45.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:45.547267+0000) 2019-10-23T11:44:46.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:46.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:46.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:46.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:46.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:44:46.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:46.509739+0000) 2019-10-23T11:44:47.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:47.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:47.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:47.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:47.546 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:44:47.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:47.543402+0000) 2019-10-23T11:44:48.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:48.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:48.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:48.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:49.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:49.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:49.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:49.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:50.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:50.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:50.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:50.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:51.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:51.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:51.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:51.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:52.053 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:44:52.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:52.050164+0000) 2019-10-23T11:44:52.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:52.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:52.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:52.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:53.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:53.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:53.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:53.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:54.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:54.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:54.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:54.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:54.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:44:54.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:54.529415+0000) 2019-10-23T11:44:55.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:55.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:55.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:55.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:55.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:44:55.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:55.529558+0000) 2019-10-23T11:44:55.553 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:44:55.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:55.547386+0000) 2019-10-23T11:44:56.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:56.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:56.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:56.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:56.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:44:56.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:56.509834+0000) 2019-10-23T11:44:57.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:57.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:57.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:57.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:57.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:44:57.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:44:57.543516+0000) 2019-10-23T11:44:58.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:58.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:58.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:58.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:44:59.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:59.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:44:59.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:44:59.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:00.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:00.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:00.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:00.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:01.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:01.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:01.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:01.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:02.053 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:45:02.048+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:02.050274+0000) 2019-10-23T11:45:02.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:02.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:02.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:02.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:03.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:03.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:03.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:03.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:04.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:04.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:04.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:04.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:04.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:45:04.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:04.529511+0000) 2019-10-23T11:45:05.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:05.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:05.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:05.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:05.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:45:05.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:05.529657+0000) 2019-10-23T11:45:05.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:45:05.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:05.547502+0000) 2019-10-23T11:45:06.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:06.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:06.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:06.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:06.512 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:45:06.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:06.509924+0000) 2019-10-23T11:45:07.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:07.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:07.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:07.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:07.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:45:07.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:07.543632+0000) 2019-10-23T11:45:08.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:08.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:08.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:08.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:09.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:09.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:09.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:09.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:10.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:10.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:10.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:10.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:11.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:11.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:11.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:11.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:12.053 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:45:12.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:12.050392+0000) 2019-10-23T11:45:12.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:12.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:12.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:12.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:13.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:13.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:13.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:13.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:14.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:14.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:14.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:14.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:14.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:45:14.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:14.529606+0000) 2019-10-23T11:45:15.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:15.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:15.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:15.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:15.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:45:15.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:15.529748+0000) 2019-10-23T11:45:15.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:45:15.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:15.547624+0000) 2019-10-23T11:45:16.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:16.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:16.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:16.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:16.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:45:16.508+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:16.510020+0000) 2019-10-23T11:45:17.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:17.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:17.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:17.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:17.546 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:45:17.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:17.543742+0000) 2019-10-23T11:45:18.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:18.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:18.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:18.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:19.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:19.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:19.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:19.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:20.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:20.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:20.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:20.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:21.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:21.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:21.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:21.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:22.053 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:45:22.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:22.050508+0000) 2019-10-23T11:45:22.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:22.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:22.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:22.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:23.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:23.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:23.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:23.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:24.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:24.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:24.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:24.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:24.534 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:45:24.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:24.529705+0000) 2019-10-23T11:45:25.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:25.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:25.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:25.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:25.532 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:45:25.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:25.529888+0000) 2019-10-23T11:45:25.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:45:25.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:25.547740+0000) 2019-10-23T11:45:26.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:26.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:26.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:26.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:26.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:45:26.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:26.510148+0000) 2019-10-23T11:45:27.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:27.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:27.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:27.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:27.546 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:45:27.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:27.543921+0000) 2019-10-23T11:45:28.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:28.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:28.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:28.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:29.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:29.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:29.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:29.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:30.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:30.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:30.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:30.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:31.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:31.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:31.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:31.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:32.053 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:45:32.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:32.050661+0000) 2019-10-23T11:45:32.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:32.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:32.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:32.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:33.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:33.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:33.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:33.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:34.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:34.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:34.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:34.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:34.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:45:34.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:34.529805+0000) 2019-10-23T11:45:35.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:35.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:35.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:35.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:35.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:45:35.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:35.530037+0000) 2019-10-23T11:45:35.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:45:35.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:35.547858+0000) 2019-10-23T11:45:36.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:36.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:36.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:36.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:36.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:45:36.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:36.510276+0000) 2019-10-23T11:45:37.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:37.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:37.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:37.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:37.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:45:37.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:37.544067+0000) 2019-10-23T11:45:38.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:38.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:38.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:38.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:39.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:39.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:39.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:39.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:40.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:40.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:40.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:40.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:41.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:41.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:41.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:41.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:42.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:45:42.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:42.050805+0000) 2019-10-23T11:45:42.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:42.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:42.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:42.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:43.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:43.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:43.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:43.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:44.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:44.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:44.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:44.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:44.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:45:44.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:44.529899+0000) 2019-10-23T11:45:45.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:45.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:45.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:45.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:45.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:45:45.528+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:45.530136+0000) 2019-10-23T11:45:45.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:45:45.546+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:45.547987+0000) 2019-10-23T11:45:46.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:46.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:46.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:46.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:46.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:45:46.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:46.510375+0000) 2019-10-23T11:45:47.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:47.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:47.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:47.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:47.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:45:47.542+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:47.544173+0000) 2019-10-23T11:45:48.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:48.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:48.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:48.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:49.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:49.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:49.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:49.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:50.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:50.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:50.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:50.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:51.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:51.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:51.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:51.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:52.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:45:52.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:52.050916+0000) 2019-10-23T11:45:52.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:52.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:52.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:52.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:53.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:53.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:53.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:53.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:54.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:54.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:54.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:54.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:54.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:45:54.528+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:54.529994+0000) 2019-10-23T11:45:55.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:55.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:55.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:55.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:55.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:45:55.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:55.530276+0000) 2019-10-23T11:45:55.552 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:45:55.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:55.548105+0000) 2019-10-23T11:45:56.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:56.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:56.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:56.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:56.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:45:56.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:56.510467+0000) 2019-10-23T11:45:57.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:57.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:57.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:57.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:57.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:45:57.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:45:57.544280+0000) 2019-10-23T11:45:58.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:58.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:58.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:58.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:45:59.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:59.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:45:59.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:45:59.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:00.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:00.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:00.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:00.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:01.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:01.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:01.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:01.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:02.054 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:46:02.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:02.051028+0000) 2019-10-23T11:46:02.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:02.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:02.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:02.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:03.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:03.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:03.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:03.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:04.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:04.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:04.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:04.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:04.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:46:04.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:04.530096+0000) 2019-10-23T11:46:05.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:05.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:05.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:05.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:05.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:46:05.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:05.530426+0000) 2019-10-23T11:46:05.553 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:46:05.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:05.548226+0000) 2019-10-23T11:46:06.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:06.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:06.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:06.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:06.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:46:06.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:06.510564+0000) 2019-10-23T11:46:07.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:07.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:07.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:07.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:07.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:46:07.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:07.544401+0000) 2019-10-23T11:46:08.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:08.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:08.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:08.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:09.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:09.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:09.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:09.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:10.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:10.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:10.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:10.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:11.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:11.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:11.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:11.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:12.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:46:12.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:12.051145+0000) 2019-10-23T11:46:12.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:12.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:12.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:12.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:13.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:13.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:13.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:13.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:14.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:14.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:14.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:46:14.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:14.530192+0000) 2019-10-23T11:46:15.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:15.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:15.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:15.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:15.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:46:15.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:15.530527+0000) 2019-10-23T11:46:15.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:46:15.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:15.548340+0000) 2019-10-23T11:46:16.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:16.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:16.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:16.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:16.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:46:16.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:16.510664+0000) 2019-10-23T11:46:17.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:17.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:17.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:17.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:17.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:46:17.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:17.544514+0000) 2019-10-23T11:46:18.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:18.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:18.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:18.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:19.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:19.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:19.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:19.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:20.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:20.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:20.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:20.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:21.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:21.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:21.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:21.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:22.054 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:46:22.049+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:22.051261+0000) 2019-10-23T11:46:22.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:22.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:22.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:22.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:23.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:23.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:23.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:23.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:24.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:24.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:24.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:24.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:24.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:46:24.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:24.530289+0000) 2019-10-23T11:46:25.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:25.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:25.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:25.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:25.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:46:25.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:25.530622+0000) 2019-10-23T11:46:25.553 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:46:25.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:25.548451+0000) 2019-10-23T11:46:26.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:26.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:26.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:26.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:26.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:46:26.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:26.510758+0000) 2019-10-23T11:46:27.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:27.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:27.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:27.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:27.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:46:27.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:27.544630+0000) 2019-10-23T11:46:28.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:28.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:28.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:28.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:29.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:29.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:29.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:29.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:30.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:30.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:30.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:30.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:31.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:31.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:31.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:31.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:32.054 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:46:32.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:32.051372+0000) 2019-10-23T11:46:32.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:32.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:32.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:32.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:33.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:33.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:33.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:33.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:34.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:34.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:34.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:34.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:34.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:46:34.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:34.530385+0000) 2019-10-23T11:46:35.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:35.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:35.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:35.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:35.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:46:35.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:35.530718+0000) 2019-10-23T11:46:35.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:46:35.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:35.548569+0000) 2019-10-23T11:46:36.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:36.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:36.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:36.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:36.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:46:36.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:36.510854+0000) 2019-10-23T11:46:37.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:37.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:37.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:37.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:37.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:46:37.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:37.544810+0000) 2019-10-23T11:46:38.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:38.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:38.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:38.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:39.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:39.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:39.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:39.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:40.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:40.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:40.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:40.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:41.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:41.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:41.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:41.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:42.054 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:46:42.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:42.051483+0000) 2019-10-23T11:46:42.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:42.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:42.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:42.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:43.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:43.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:43.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:43.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:44.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:44.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:44.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:44.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:44.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:46:44.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:44.530477+0000) 2019-10-23T11:46:45.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:45.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:45.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:45.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:45.533 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:46:45.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:45.530815+0000) 2019-10-23T11:46:45.553 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:46:45.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:45.548686+0000) 2019-10-23T11:46:46.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:46.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:46.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:46.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:46.513 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:46:46.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:46.510952+0000) 2019-10-23T11:46:47.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:47.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:47.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:47.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:47.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:46:47.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:47.544946+0000) 2019-10-23T11:46:48.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:48.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:48.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:48.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:49.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:49.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:49.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:49.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:50.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:50.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:50.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:50.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:51.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:51.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:51.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:51.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:52.054 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:46:52.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:52.051601+0000) 2019-10-23T11:46:52.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:52.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:52.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:52.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:53.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:53.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:53.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:53.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:54.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:54.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:54.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:54.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:54.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:46:54.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:54.530573+0000) 2019-10-23T11:46:55.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:55.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:55.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:55.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:55.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:46:55.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:55.530914+0000) 2019-10-23T11:46:55.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:46:55.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:55.548815+0000) 2019-10-23T11:46:56.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:46:56.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:56.511046+0000) 2019-10-23T11:46:56.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:56.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:56.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:56.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:57.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:57.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:57.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:57.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:57.547 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:46:57.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:46:57.545056+0000) 2019-10-23T11:46:58.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:58.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:58.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:58.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:46:59.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:59.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:46:59.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:46:59.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:00.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:00.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:00.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:00.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:01.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:01.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:01.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:01.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:02.054 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:47:02.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:02.051716+0000) 2019-10-23T11:47:02.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:02.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:02.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:02.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:03.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:03.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:03.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:03.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:04.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:47:04.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:04.530672+0000) 2019-10-23T11:47:04.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:04.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:04.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:04.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:05.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:47:05.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:05.531016+0000) 2019-10-23T11:47:05.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:47:05.547+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:05.548928+0000) 2019-10-23T11:47:05.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:05.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:05.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:05.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:06.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:47:06.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:06.511144+0000) 2019-10-23T11:47:06.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:06.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:06.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:06.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:07.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:47:07.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:07.545171+0000) 2019-10-23T11:47:07.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:07.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:07.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:07.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:08.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:08.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:08.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:08.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:09.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:09.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:09.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:09.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:10.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:10.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:10.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:10.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:11.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:11.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:11.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:11.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:12.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:47:12.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:12.051841+0000) 2019-10-23T11:47:12.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:12.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:12.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:12.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:13.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:13.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:13.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:13.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:14.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:14.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:14.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:14.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:14.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:47:14.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:14.530768+0000) 2019-10-23T11:47:15.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:15.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:15.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:15.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:15.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:47:15.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:15.531113+0000) 2019-10-23T11:47:15.553 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:47:15.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:15.549047+0000) 2019-10-23T11:47:16.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:16.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:16.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:16.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:16.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:47:16.509+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:16.511243+0000) 2019-10-23T11:47:17.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:17.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:17.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:17.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:17.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:47:17.543+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:17.545277+0000) 2019-10-23T11:47:18.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:18.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:18.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:18.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:19.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:19.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:19.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:19.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:20.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:20.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:20.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:20.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:21.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:21.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:21.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:21.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:22.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:47:22.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:22.052024+0000) 2019-10-23T11:47:22.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:22.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:22.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:22.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:23.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:23.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:23.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:23.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:24.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:24.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:24.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:24.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:24.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:47:24.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:24.530866+0000) 2019-10-23T11:47:25.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:25.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:25.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:25.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:25.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:47:25.529+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:25.531209+0000) 2019-10-23T11:47:25.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:47:25.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:25.549166+0000) 2019-10-23T11:47:26.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:26.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:26.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:26.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:26.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:47:26.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:26.511336+0000) 2019-10-23T11:47:27.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:27.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:27.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:27.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:27.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:47:27.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:27.545391+0000) 2019-10-23T11:47:28.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:28.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:28.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:28.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:29.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:29.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:29.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:29.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:30.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:30.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:30.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:30.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:31.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:31.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:31.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:31.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:32.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:47:32.050+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:32.052183+0000) 2019-10-23T11:47:32.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:32.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:32.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:32.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:33.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:33.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:33.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:33.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:34.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:34.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:34.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:34.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:34.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:47:34.529+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:34.530965+0000) 2019-10-23T11:47:35.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:35.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:35.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:35.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:35.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:47:35.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:35.531298+0000) 2019-10-23T11:47:35.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:47:35.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:35.549285+0000) 2019-10-23T11:47:36.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:36.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:36.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:36.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:36.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:47:36.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:36.511432+0000) 2019-10-23T11:47:37.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:37.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:37.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:37.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:37.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:47:37.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:37.545511+0000) 2019-10-23T11:47:38.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:38.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:38.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:38.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:39.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:39.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:39.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:39.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:40.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:40.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:40.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:40.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:41.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:41.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:41.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:41.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:42.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:47:42.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:42.052305+0000) 2019-10-23T11:47:42.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:42.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:42.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:42.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:43.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:43.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:43.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:43.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:44.535 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:47:44.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:44.531063+0000) 2019-10-23T11:47:44.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:44.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:44.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:44.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:45.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:47:45.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:45.531394+0000) 2019-10-23T11:47:45.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:47:45.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:45.549405+0000) 2019-10-23T11:47:45.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:45.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:45.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:45.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:46.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:47:46.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:46.511526+0000) 2019-10-23T11:47:46.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:46.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:46.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:46.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:47.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:47:47.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:47.545619+0000) 2019-10-23T11:47:47.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:47.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:47.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:47.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:48.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:48.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:48.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:48.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:49.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:49.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:49.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:49.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:50.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:50.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:50.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:50.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:51.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:51.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:51.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:51.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:52.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:47:52.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:52.052424+0000) 2019-10-23T11:47:52.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:52.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:52.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:52.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:53.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:53.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:53.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:53.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:54.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:54.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:54.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:54.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:54.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:47:54.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:54.531161+0000) 2019-10-23T11:47:55.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:55.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:55.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:55.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:55.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:47:55.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:55.531494+0000) 2019-10-23T11:47:55.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:47:55.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:55.549522+0000) 2019-10-23T11:47:56.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:47:56.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:56.511621+0000) 2019-10-23T11:47:56.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:56.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:56.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:56.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:57.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:57.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:57.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:57.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:57.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:47:57.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:47:57.545729+0000) 2019-10-23T11:47:58.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:58.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:58.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:58.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:47:59.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:59.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:47:59.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:47:59.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:00.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:00.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:00.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:00.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:01.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:01.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:01.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:01.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:02.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:48:02.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:02.052538+0000) 2019-10-23T11:48:02.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:02.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:02.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:02.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:03.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:03.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:03.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:03.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:04.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:04.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:04.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:04.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:04.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:48:04.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:04.531261+0000) 2019-10-23T11:48:05.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:05.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:05.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:05.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:05.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:48:05.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:05.531590+0000) 2019-10-23T11:48:05.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:48:05.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:05.549648+0000) 2019-10-23T11:48:06.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:06.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:06.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:06.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:06.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:48:06.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:06.511755+0000) 2019-10-23T11:48:07.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:07.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:07.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:07.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:07.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:48:07.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:07.545855+0000) 2019-10-23T11:48:08.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:08.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:08.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:08.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:09.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:09.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:09.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:09.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:10.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:10.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:10.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:10.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:11.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:11.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:11.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:11.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:12.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:48:12.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:12.052653+0000) 2019-10-23T11:48:12.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:12.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:12.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:12.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:13.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:13.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:13.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:13.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:14.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:14.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:14.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:14.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:14.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:48:14.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:14.531359+0000) 2019-10-23T11:48:15.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:15.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:15.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:15.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:15.534 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:48:15.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:15.531688+0000) 2019-10-23T11:48:15.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:48:15.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:15.549765+0000) 2019-10-23T11:48:16.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:16.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:16.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:16.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:16.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:48:16.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:16.511890+0000) 2019-10-23T11:48:17.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:17.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:17.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:17.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:17.548 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:48:17.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:17.545974+0000) 2019-10-23T11:48:18.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:18.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:18.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:18.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:19.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:19.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:19.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:19.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:20.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:20.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:20.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:20.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:21.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:21.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:21.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:21.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:22.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:48:22.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:22.052768+0000) 2019-10-23T11:48:22.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:22.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:22.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:22.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:23.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:23.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:23.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:23.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:24.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:48:24.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:24.531458+0000) 2019-10-23T11:48:24.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:24.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:24.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:24.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:25.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:48:25.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:25.531788+0000) 2019-10-23T11:48:25.554 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:48:25.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:25.549883+0000) 2019-10-23T11:48:25.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:25.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:25.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:25.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:26.514 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:48:26.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:26.511985+0000) 2019-10-23T11:48:26.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:26.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:26.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:26.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:27.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:27.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:27.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:27.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:27.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:48:27.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:27.546089+0000) 2019-10-23T11:48:28.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:28.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:28.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:28.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:29.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:29.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:29.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:29.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:30.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:30.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:30.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:30.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:31.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:31.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:31.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:31.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:32.055 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:48:32.051+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:32.052880+0000) 2019-10-23T11:48:32.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:32.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:32.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:32.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:33.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:33.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:33.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:33.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:34.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:34.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:34.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:34.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:34.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:48:34.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:34.531555+0000) 2019-10-23T11:48:35.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:48:35.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:35.531887+0000) 2019-10-23T11:48:35.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:48:35.548+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:35.550001+0000) 2019-10-23T11:48:35.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:35.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:35.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:35.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:36.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:48:36.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:36.512078+0000) 2019-10-23T11:48:36.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:36.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:36.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:36.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:37.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:48:37.544+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:37.546203+0000) 2019-10-23T11:48:37.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:37.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:37.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:37.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:38.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:38.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:38.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:38.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:39.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:39.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:39.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:39.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:40.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:40.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:40.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:40.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:41.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:41.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:41.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:41.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:42.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:48:42.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:42.052989+0000) 2019-10-23T11:48:42.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:42.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:42.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:42.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:43.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:43.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:43.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:43.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:44.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:48:44.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:44.531651+0000) 2019-10-23T11:48:44.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:44.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:44.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:44.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:45.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:48:45.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:45.531980+0000) 2019-10-23T11:48:45.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:48:45.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:45.550119+0000) 2019-10-23T11:48:45.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:45.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:45.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:45.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:46.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:48:46.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:46.512173+0000) 2019-10-23T11:48:46.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:46.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:46.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:46.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:47.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:48:47.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:47.546322+0000) 2019-10-23T11:48:47.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:47.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:47.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:47.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:48.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:48.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:48.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:48.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:49.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:49.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:49.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:49.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:50.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:50.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:50.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:50.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:51.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:51.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:51.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:51.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:52.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:48:52.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:52.053103+0000) 2019-10-23T11:48:52.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:52.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:52.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:52.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:53.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:53.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:53.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:53.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:54.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:48:54.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:54.531749+0000) 2019-10-23T11:48:54.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:54.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:54.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:54.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:55.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:48:55.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:55.532077+0000) 2019-10-23T11:48:55.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:48:55.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:55.550237+0000) 2019-10-23T11:48:55.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:55.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:55.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:55.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:56.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:48:56.510+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:56.512269+0000) 2019-10-23T11:48:56.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:56.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:56.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:56.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:57.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:48:57.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:48:57.546437+0000) 2019-10-23T11:48:57.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:57.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:57.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:57.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:58.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:58.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:58.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:58.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:48:59.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:59.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:48:59.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:48:59.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:00.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:00.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:00.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:00.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:01.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:01.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:01.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:01.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:02.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:49:02.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:02.053301+0000) 2019-10-23T11:49:02.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:02.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:02.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:02.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:03.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:03.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:03.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:03.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:04.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:49:04.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:04.531845+0000) 2019-10-23T11:49:04.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:04.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:04.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:04.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:05.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:49:05.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:05.532176+0000) 2019-10-23T11:49:05.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:49:05.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:05.550354+0000) 2019-10-23T11:49:05.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:05.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:05.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:05.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:06.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:49:06.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:06.512369+0000) 2019-10-23T11:49:06.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:06.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:06.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:06.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:07.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:49:07.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:07.546560+0000) 2019-10-23T11:49:07.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:07.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:07.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:07.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:08.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:08.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:08.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:08.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:09.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:09.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:09.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:09.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:10.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:10.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:10.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:10.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:11.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:11.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:11.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:11.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:12.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:49:12.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:12.053460+0000) 2019-10-23T11:49:12.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:12.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:12.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:12.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:13.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:13.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:13.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:13.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:14.536 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:49:14.530+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:14.531943+0000) 2019-10-23T11:49:14.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:14.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:14.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:14.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:15.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:49:15.530+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:15.532275+0000) 2019-10-23T11:49:15.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:49:15.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:15.550481+0000) 2019-10-23T11:49:15.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:15.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:15.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:15.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:16.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:49:16.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:16.512466+0000) 2019-10-23T11:49:16.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:16.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:16.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:16.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:17.549 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:49:17.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:17.546676+0000) 2019-10-23T11:49:17.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:17.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:17.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:17.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:18.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:18.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:18.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:18.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:19.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:19.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:19.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:19.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:20.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:20.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:20.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:20.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:21.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:21.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:21.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:22.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:49:22.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:22.053573+0000) 2019-10-23T11:49:22.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:22.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:22.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:22.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:23.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:23.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:23.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:23.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:24.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:49:24.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:24.532038+0000) 2019-10-23T11:49:24.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:24.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:24.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:24.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:25.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:49:25.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:25.532375+0000) 2019-10-23T11:49:25.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:49:25.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:25.550598+0000) 2019-10-23T11:49:25.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:25.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:25.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:25.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:26.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:49:26.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:26.512560+0000) 2019-10-23T11:49:26.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:26.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:26.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:26.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:27.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:49:27.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:27.546783+0000) 2019-10-23T11:49:27.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:27.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:27.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:27.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:28.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:28.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:28.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:28.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:29.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:29.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:29.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:29.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:30.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:30.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:30.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:30.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:31.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:31.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:31.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:31.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:32.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:49:32.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:32.053763+0000) 2019-10-23T11:49:32.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:32.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:32.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:32.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:33.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:33.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:33.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:33.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:34.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:49:34.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:34.532136+0000) 2019-10-23T11:49:34.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:34.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:34.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:34.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:35.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:49:35.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:35.532472+0000) 2019-10-23T11:49:35.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:49:35.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:35.550719+0000) 2019-10-23T11:49:35.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:35.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:35.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:35.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:36.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:49:36.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:36.512656+0000) 2019-10-23T11:49:36.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:36.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:36.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:36.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:37.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:49:37.545+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:37.546966+0000) 2019-10-23T11:49:37.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:37.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:37.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:37.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:38.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:38.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:38.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:38.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:39.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:39.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:39.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:39.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:40.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:40.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:40.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:40.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:41.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:41.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:41.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:41.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:42.056 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:49:42.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:42.053925+0000) 2019-10-23T11:49:42.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:42.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:42.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:42.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:43.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:43.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:43.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:43.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:44.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:49:44.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:44.532232+0000) 2019-10-23T11:49:44.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:44.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:44.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:44.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:45.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:49:45.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:45.532571+0000) 2019-10-23T11:49:45.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:49:45.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:45.550838+0000) 2019-10-23T11:49:45.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:45.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:45.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:45.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:46.515 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:49:46.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:46.512749+0000) 2019-10-23T11:49:46.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:46.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:46.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:46.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:47.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:49:47.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:47.547111+0000) 2019-10-23T11:49:47.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:47.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:47.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:47.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:48.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:48.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:48.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:48.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:49.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:49.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:49.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:49.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:50.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:50.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:50.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:50.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:51.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:51.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:39:20.707130+0000 (oldest deadline 2019-10-23T11:39:40.707130+0000) 2019-10-23T11:49:51.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:51.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:52.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:49:52.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:52.054039+0000) 2019-10-23T11:49:52.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:52.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:53.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:53.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:54.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:49:54.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:54.532328+0000) 2019-10-23T11:49:54.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:54.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:55.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:49:55.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:55.532670+0000) 2019-10-23T11:49:55.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:49:55.549+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:55.550955+0000) 2019-10-23T11:49:55.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:55.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:56.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:49:56.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:56.512841+0000) 2019-10-23T11:49:56.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:56.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:57.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:49:57.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:49:57.547228+0000) 2019-10-23T11:49:57.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:57.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:58.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:58.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:49:59.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:49:59.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:00.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:00.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:01.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:01.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:02.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:50:02.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:02.054156+0000) 2019-10-23T11:50:02.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:02.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:03.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:03.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:04.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:50:04.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:04.532427+0000) 2019-10-23T11:50:04.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:04.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:05.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:50:05.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:05.532768+0000) 2019-10-23T11:50:05.555 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:50:05.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:05.551065+0000) 2019-10-23T11:50:05.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:05.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:06.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:50:06.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:06.512938+0000) 2019-10-23T11:50:06.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:06.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:07.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:50:07.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:07.547324+0000) 2019-10-23T11:50:07.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:07.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:08.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:08.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:09.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:09.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:10.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:10.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:11.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:11.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:12.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:50:12.052+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:12.054271+0000) 2019-10-23T11:50:12.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:12.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:13.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:13.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:13.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:13.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:14.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:50:14.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:14.532516+0000) 2019-10-23T11:50:14.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:14.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:14.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:14.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:15.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:50:15.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:15.532866+0000) 2019-10-23T11:50:15.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:50:15.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:15.551178+0000) 2019-10-23T11:50:15.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:15.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:15.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:15.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:16.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:50:16.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:16.513034+0000) 2019-10-23T11:50:16.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:16.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:16.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:16.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:17.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:50:17.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:17.547437+0000) 2019-10-23T11:50:17.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:17.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:17.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:17.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:18.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:18.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:18.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:18.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:19.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:19.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:19.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:19.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:20.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:20.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:20.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:20.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:21.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:21.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:21.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:21.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:22.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:50:22.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:22.054385+0000) 2019-10-23T11:50:22.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:22.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:22.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:22.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:23.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:23.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:23.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:23.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:24.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:50:24.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:24.532609+0000) 2019-10-23T11:50:24.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:24.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:24.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:24.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:25.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:50:25.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:25.532963+0000) 2019-10-23T11:50:25.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:25.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:25.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:25.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:25.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:50:25.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:25.551296+0000) 2019-10-23T11:50:26.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:50:26.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:26.513137+0000) 2019-10-23T11:50:26.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:26.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:26.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:26.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:27.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:27.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:27.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:27.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:27.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:50:27.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:27.547552+0000) 2019-10-23T11:50:28.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:28.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:28.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:28.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:29.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:29.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:29.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:29.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:30.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:30.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:30.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:30.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:31.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:31.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:31.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:31.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:32.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:50:32.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:32.054496+0000) 2019-10-23T11:50:32.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:32.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:32.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:32.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:33.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:33.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:33.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:33.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:34.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:34.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:34.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:34.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:34.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:50:34.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:34.532703+0000) 2019-10-23T11:50:35.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:35.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:35.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:35.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:35.535 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:50:35.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:35.533056+0000) 2019-10-23T11:50:35.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:50:35.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:35.551409+0000) 2019-10-23T11:50:36.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:36.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:36.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:36.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:36.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:50:36.511+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:36.513231+0000) 2019-10-23T11:50:37.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:37.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:37.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:37.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:37.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:50:37.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:37.547666+0000) 2019-10-23T11:50:38.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:38.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:38.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:38.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:39.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:39.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:39.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:39.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:40.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:40.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:40.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:40.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:41.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:41.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:41.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:41.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:42.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:50:42.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:42.054609+0000) 2019-10-23T11:50:42.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:42.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:42.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:42.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:43.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:43.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:43.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:43.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:44.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:44.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:44.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:44.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:44.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:50:44.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:44.532795+0000) 2019-10-23T11:50:45.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:45.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:45.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:45.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:45.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:50:45.531+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:45.533156+0000) 2019-10-23T11:50:45.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:50:45.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:45.551526+0000) 2019-10-23T11:50:46.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:46.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:46.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:46.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:46.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:50:46.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:46.513325+0000) 2019-10-23T11:50:47.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:47.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:47.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:47.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:47.550 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:50:47.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:47.547788+0000) 2019-10-23T11:50:48.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:48.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:48.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:48.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:49.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:49.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:49.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:49.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:50.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:50.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:50.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:50.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:51.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:51.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:51.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:51.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:52.057 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:50:52.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:52.054723+0000) 2019-10-23T11:50:52.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:52.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:52.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:52.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:53.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:53.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:53.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:53.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:54.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:54.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:54.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:54.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:54.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:50:54.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:54.532892+0000) 2019-10-23T11:50:55.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:55.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:55.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:55.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:55.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:50:55.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:55.533252+0000) 2019-10-23T11:50:55.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:50:55.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:55.551645+0000) 2019-10-23T11:50:56.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:56.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:56.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:56.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:56.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:50:56.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:56.513416+0000) 2019-10-23T11:50:57.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:57.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:57.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:57.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:57.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:50:57.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:50:57.547896+0000) 2019-10-23T11:50:58.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:58.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:58.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:58.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:50:59.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:59.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:50:59.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:50:59.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:00.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:00.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:00.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:00.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:01.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:01.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:01.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:01.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:02.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:51:02.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:02.054835+0000) 2019-10-23T11:51:02.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:02.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:02.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:02.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:03.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:03.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:03.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:03.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:04.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:04.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:04.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:04.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:04.537 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:51:04.531+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:04.532989+0000) 2019-10-23T11:51:05.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:05.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:05.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:05.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:05.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:51:05.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:05.533351+0000) 2019-10-23T11:51:05.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:51:05.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:05.551762+0000) 2019-10-23T11:51:06.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:06.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:06.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:06.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:06.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:51:06.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:06.513510+0000) 2019-10-23T11:51:07.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:07.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:07.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:07.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:07.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:51:07.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:07.548010+0000) 2019-10-23T11:51:08.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:08.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:08.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:08.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:09.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:09.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:09.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:09.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:10.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:10.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:10.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:10.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:11.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:11.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:11.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:11.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:12.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:51:12.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:12.054942+0000) 2019-10-23T11:51:12.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:12.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:12.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:12.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:13.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:13.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:13.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:13.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:14.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:14.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:14.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:14.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:14.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:51:14.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:14.533091+0000) 2019-10-23T11:51:15.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:15.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:15.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:15.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:15.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:51:15.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:15.533453+0000) 2019-10-23T11:51:15.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:51:15.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:15.551874+0000) 2019-10-23T11:51:16.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:16.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:16.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:16.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:16.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:51:16.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:16.513605+0000) 2019-10-23T11:51:17.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:17.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:17.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:17.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:17.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:51:17.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:17.548117+0000) 2019-10-23T11:51:18.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:18.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:18.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:18.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:19.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:19.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:19.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:19.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:20.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:20.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:20.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:20.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:21.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:21.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:21.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:21.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:22.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:51:22.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:22.055053+0000) 2019-10-23T11:51:22.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:22.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:22.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:22.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:23.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:23.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:23.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:23.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:24.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:24.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:24.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:24.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:24.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:51:24.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:24.533187+0000) 2019-10-23T11:51:25.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:25.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:25.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:25.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:25.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:51:25.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:25.533550+0000) 2019-10-23T11:51:25.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:51:25.550+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:25.551986+0000) 2019-10-23T11:51:26.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:26.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:26.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:26.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:26.516 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:51:26.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:26.513702+0000) 2019-10-23T11:51:27.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:27.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:27.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:27.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:27.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:51:27.546+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:27.548227+0000) 2019-10-23T11:51:28.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:28.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:28.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:28.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:29.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:29.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:29.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:29.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:30.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:30.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:30.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:30.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:31.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:31.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:31.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:31.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:32.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:51:32.053+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:32.055165+0000) 2019-10-23T11:51:32.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:32.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:32.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:32.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:33.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:33.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:33.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:33.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:34.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:34.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:34.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:34.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:34.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:51:34.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:34.533285+0000) 2019-10-23T11:51:35.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:35.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:35.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:35.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:35.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:51:35.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:35.533640+0000) 2019-10-23T11:51:35.556 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:51:35.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:35.552104+0000) 2019-10-23T11:51:36.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:36.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:36.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:36.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:36.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:51:36.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:36.513797+0000) 2019-10-23T11:51:37.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:37.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:37.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:37.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:37.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:51:37.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:37.548323+0000) 2019-10-23T11:51:38.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:38.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:38.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:38.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:39.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:39.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:39.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:39.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:40.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:40.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:40.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:40.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:41.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:41.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:41.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:41.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:42.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:51:42.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:42.055280+0000) 2019-10-23T11:51:42.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:42.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:42.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:42.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:43.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:43.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:43.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:43.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:44.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:44.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:44.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:44.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:44.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:51:44.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:44.533381+0000) 2019-10-23T11:51:45.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:45.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:45.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:45.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:45.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:51:45.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:45.533737+0000) 2019-10-23T11:51:45.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:51:45.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:45.552215+0000) 2019-10-23T11:51:46.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:46.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:46.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:46.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:46.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:51:46.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:46.513888+0000) 2019-10-23T11:51:47.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:47.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:47.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:47.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:47.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:51:47.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:47.548438+0000) 2019-10-23T11:51:48.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:48.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:48.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:48.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:49.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:49.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:49.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:49.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:50.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:50.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:50.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:50.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:51.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:51.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:51.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:51.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:52.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:51:52.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:52.055401+0000) 2019-10-23T11:51:52.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:52.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:52.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:52.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:53.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:53.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:53.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:53.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:54.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:54.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:54.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:54.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:54.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:51:54.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:54.533478+0000) 2019-10-23T11:51:55.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:55.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:55.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:55.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:55.536 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:51:55.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:55.533835+0000) 2019-10-23T11:51:55.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:51:55.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:55.552332+0000) 2019-10-23T11:51:56.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:56.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:56.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:56.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:56.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:51:56.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:56.513987+0000) 2019-10-23T11:51:57.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:57.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:57.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:57.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:57.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:51:57.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:51:57.548554+0000) 2019-10-23T11:51:58.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:58.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:58.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:58.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:51:59.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:59.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:51:59.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:51:59.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:00.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:00.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:00.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:00.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:01.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:01.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:01.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:01.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:02.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:52:02.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:02.055511+0000) 2019-10-23T11:52:02.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:02.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:02.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:02.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:03.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:03.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:03.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:03.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:03.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:03.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:03.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:03.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:04.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:52:04.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:04.533574+0000) 2019-10-23T11:52:05.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:05.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:05.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:05.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:05.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:52:05.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:05.533934+0000) 2019-10-23T11:52:05.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:52:05.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:05.552451+0000) 2019-10-23T11:52:06.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:06.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:06.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:06.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:06.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:52:06.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:06.514081+0000) 2019-10-23T11:52:07.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:07.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:07.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:07.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:07.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:52:07.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:07.548672+0000) 2019-10-23T11:52:08.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:08.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:08.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:08.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:09.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:09.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:09.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:09.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:10.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:10.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:10.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:10.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:11.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:11.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:11.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:11.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:12.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:12.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:12.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:12.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:12.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:52:12.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:12.055624+0000) 2019-10-23T11:52:13.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:13.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:13.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:13.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:14.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:14.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:14.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:14.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:14.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:52:14.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:14.533672+0000) 2019-10-23T11:52:15.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:15.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:15.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:15.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:15.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:52:15.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:15.534029+0000) 2019-10-23T11:52:15.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:52:15.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:15.552563+0000) 2019-10-23T11:52:16.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:16.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:16.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:16.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:16.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:52:16.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:16.514176+0000) 2019-10-23T11:52:17.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:17.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:17.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:17.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:17.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:52:17.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:17.548803+0000) 2019-10-23T11:52:18.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:18.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:18.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:18.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 108 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:19.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:19.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:19.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:19.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:20.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:20.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:20.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:20.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:21.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:21.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:21.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:21.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:22.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:22.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:22.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:22.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:22.058 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:52:22.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:22.055743+0000) 2019-10-23T11:52:23.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:23.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:23.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:23.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:24.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:24.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:24.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:24.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:24.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:52:24.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:24.533769+0000) 2019-10-23T11:52:25.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:25.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:25.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:25.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:25.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:52:25.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:25.534125+0000) 2019-10-23T11:52:25.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:52:25.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:25.552676+0000) 2019-10-23T11:52:26.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:26.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:26.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:26.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:26.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:52:26.512+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:26.514270+0000) 2019-10-23T11:52:26.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:26.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:26.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:26.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:27.551 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:52:27.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:27.548923+0000) 2019-10-23T11:52:28.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:28.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:28.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:28.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:29.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:29.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:29.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:29.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:29.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:29.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:29.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:29.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:31.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:31.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:31.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:31.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:32.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:52:32.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:32.055858+0000) 2019-10-23T11:52:32.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:32.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:32.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:32.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:33.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:33.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:33.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:33.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:34.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:34.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:34.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:34.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:34.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:52:34.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:34.533866+0000) 2019-10-23T11:52:35.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:35.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:35.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:35.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:35.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:52:35.532+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:35.534224+0000) 2019-10-23T11:52:35.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:52:35.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:35.552797+0000) 2019-10-23T11:52:36.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:36.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:36.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:36.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:36.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:52:36.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:36.514368+0000) 2019-10-23T11:52:37.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:37.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:37.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:37.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:37.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:52:37.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:37.549034+0000) 2019-10-23T11:52:38.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:38.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:38.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:38.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:39.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:39.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:39.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:39.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:40.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:40.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:40.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:40.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:41.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:41.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:41.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:41.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:42.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:52:42.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:42.055969+0000) 2019-10-23T11:52:42.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:42.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:42.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:42.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:43.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:43.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:44.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:44.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:44.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:44.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:44.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:52:44.532+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:44.533965+0000) 2019-10-23T11:52:45.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:45.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:45.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:45.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:45.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:52:45.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:45.534322+0000) 2019-10-23T11:52:45.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:52:45.551+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:45.552910+0000) 2019-10-23T11:52:46.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:46.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:46.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:46.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:46.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:52:46.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:46.514466+0000) 2019-10-23T11:52:47.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:47.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:47.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:47.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:47.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:52:47.547+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:47.549150+0000) 2019-10-23T11:52:48.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:48.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:48.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:48.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:49.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:49.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:49.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:49.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:50.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:50.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:50.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:50.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:51.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:51.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:51.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:51.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:52.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:52:52.054+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:52.056083+0000) 2019-10-23T11:52:52.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:52.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:52.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:52.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:53.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:53.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:53.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:53.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:54.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:54.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:54.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:54.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:54.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:52:54.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:54.534062+0000) 2019-10-23T11:52:55.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:55.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:55.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:55.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:55.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:52:55.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:55.534422+0000) 2019-10-23T11:52:55.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:52:55.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:55.553027+0000) 2019-10-23T11:52:56.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:56.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:56.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:56.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:56.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:52:56.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:56.514565+0000) 2019-10-23T11:52:57.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:57.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:57.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:57.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:57.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:52:57.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:52:57.549258+0000) 2019-10-23T11:52:58.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:58.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:58.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:58.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:52:59.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:59.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:52:59.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:52:59.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:00.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:00.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:00.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:00.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:01.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:01.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:01.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:01.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:02.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:53:02.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:02.056196+0000) 2019-10-23T11:53:02.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:02.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:02.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:02.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:03.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:03.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:03.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:03.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:04.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:04.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:04.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:04.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:04.538 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:53:04.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:04.534160+0000) 2019-10-23T11:53:05.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:05.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:05.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:05.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:05.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:53:05.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:05.534519+0000) 2019-10-23T11:53:05.557 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:53:05.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:05.553152+0000) 2019-10-23T11:53:06.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:06.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:06.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:06.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:06.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:53:06.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:06.514662+0000) 2019-10-23T11:53:07.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:07.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:07.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:07.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:07.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:53:07.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:07.549371+0000) 2019-10-23T11:53:08.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:08.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:08.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:08.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:09.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:09.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:09.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:09.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:10.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:10.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:10.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:10.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:11.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:11.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:11.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:11.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:12.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:53:12.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:12.056314+0000) 2019-10-23T11:53:12.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:12.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:12.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:12.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:13.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:13.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:13.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:13.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:14.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:14.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:14.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:14.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:53:14.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:14.534254+0000) 2019-10-23T11:53:15.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:15.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:15.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:15.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:15.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:53:15.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:15.534618+0000) 2019-10-23T11:53:15.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:53:15.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:15.553265+0000) 2019-10-23T11:53:16.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:16.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:16.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:16.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:16.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:53:16.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:16.514761+0000) 2019-10-23T11:53:17.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:17.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:17.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:17.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:17.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:53:17.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:17.549487+0000) 2019-10-23T11:53:18.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:18.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:18.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:18.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:19.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:19.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:19.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:19.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:20.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:20.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:20.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:20.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:21.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:21.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:21.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:21.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:22.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:53:22.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:22.056433+0000) 2019-10-23T11:53:22.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:22.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:22.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:22.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:23.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:23.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:23.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:23.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:24.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:24.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:24.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:24.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:24.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:53:24.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:24.534352+0000) 2019-10-23T11:53:25.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:25.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:25.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:25.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:25.537 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:53:25.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:25.534711+0000) 2019-10-23T11:53:25.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:53:25.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:25.553380+0000) 2019-10-23T11:53:26.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:26.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:26.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:26.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:26.517 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:53:26.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:26.514858+0000) 2019-10-23T11:53:27.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:27.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:27.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:27.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:27.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:53:27.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:27.549600+0000) 2019-10-23T11:53:28.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:28.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:28.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:28.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:29.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:29.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:29.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:29.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:30.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:30.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:30.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:30.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:31.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:31.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:31.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:31.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:32.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:53:32.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:32.056541+0000) 2019-10-23T11:53:32.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:32.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:32.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:32.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:33.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:33.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:33.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:33.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:34.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:34.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:34.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:34.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:34.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:53:34.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:34.534441+0000) 2019-10-23T11:53:35.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:35.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:35.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:35.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:35.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:53:35.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:35.534806+0000) 2019-10-23T11:53:35.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:53:35.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:35.553495+0000) 2019-10-23T11:53:36.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:36.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:36.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:36.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:36.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:53:36.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:36.514956+0000) 2019-10-23T11:53:37.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:37.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:37.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:37.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:37.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:53:37.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:37.549714+0000) 2019-10-23T11:53:38.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:38.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:38.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:38.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:39.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:39.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:39.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:39.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:40.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:40.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:40.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:40.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:41.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:41.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:41.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:41.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:42.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:53:42.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:42.056654+0000) 2019-10-23T11:53:42.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:42.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:42.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:42.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:43.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:43.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:43.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:43.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:44.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:44.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:44.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:44.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:44.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:53:44.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:44.534537+0000) 2019-10-23T11:53:45.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:45.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:45.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:45.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:45.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:53:45.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:45.534904+0000) 2019-10-23T11:53:45.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:53:45.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:45.553604+0000) 2019-10-23T11:53:46.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:46.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:46.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:46.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:46.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:53:46.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:46.515052+0000) 2019-10-23T11:53:47.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:47.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:47.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:47.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:47.552 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:53:47.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:47.549827+0000) 2019-10-23T11:53:48.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:48.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:48.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:48.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:49.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:49.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:49.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:49.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:50.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:50.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:50.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:50.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:51.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:51.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:51.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:51.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:52.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:53:52.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:52.056771+0000) 2019-10-23T11:53:52.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:52.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:52.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:52.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:53.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:53.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:53.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:53.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:54.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:54.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:54.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:54.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:54.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:53:54.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:54.534632+0000) 2019-10-23T11:53:55.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:55.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:55.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:55.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:55.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:53:55.533+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:55.535002+0000) 2019-10-23T11:53:55.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:53:55.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:55.553712+0000) 2019-10-23T11:53:56.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:56.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:56.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:56.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:56.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:53:56.513+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:56.515144+0000) 2019-10-23T11:53:57.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:57.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:57.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:57.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:57.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:53:57.548+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:53:57.549942+0000) 2019-10-23T11:53:58.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:58.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:58.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:58.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:53:58.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:58.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:53:58.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:53:58.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:00.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:00.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:00.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:00.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:01.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:01.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:01.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:01.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:02.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:02.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:02.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:02.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:02.059 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:54:02.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:02.056883+0000) 2019-10-23T11:54:03.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:03.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:03.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:03.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:04.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:04.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:04.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:04.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:04.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:54:04.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:04.534723+0000) 2019-10-23T11:54:05.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:05.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:05.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:05.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:05.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:54:05.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:05.535103+0000) 2019-10-23T11:54:05.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:54:05.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:05.553821+0000) 2019-10-23T11:54:06.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:06.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:06.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:06.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:06.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:54:06.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:06.515237+0000) 2019-10-23T11:54:07.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:07.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:07.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:07.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:07.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:54:07.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:07.550055+0000) 2019-10-23T11:54:08.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:07.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:08.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:07.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:08.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:08.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:08.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:08.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:10.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:10.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:10.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:10.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:11.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:10.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:11.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:10.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:11.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:11.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:11.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:11.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:12.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:54:12.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:12.056997+0000) 2019-10-23T11:54:12.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:12.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:12.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:12.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:14.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:14.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:14.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:14.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:14.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:54:14.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:14.534819+0000) 2019-10-23T11:54:15.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:15.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:15.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:15.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:15.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:54:15.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:15.535235+0000) 2019-10-23T11:54:15.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:54:15.552+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:15.553943+0000) 2019-10-23T11:54:16.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:16.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:16.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:16.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:16.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:54:16.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:16.515296+0000) 2019-10-23T11:54:17.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:17.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:17.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:17.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:17.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:54:17.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:17.550170+0000) 2019-10-23T11:54:18.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:18.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:18.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:18.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:19.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:19.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:19.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:19.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:20.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:20.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:20.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:20.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:21.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:21.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:21.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:21.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:22.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:54:22.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:22.057117+0000) 2019-10-23T11:54:22.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:22.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:22.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:22.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:23.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:23.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:23.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:23.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:24.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:24.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:24.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:24.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:24.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:54:24.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:24.534916+0000) 2019-10-23T11:54:25.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:25.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:25.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:25.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:25.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:54:25.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:25.535333+0000) 2019-10-23T11:54:25.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:54:25.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:25.554064+0000) 2019-10-23T11:54:26.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:26.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:26.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:26.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:26.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:54:26.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:26.515405+0000) 2019-10-23T11:54:27.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:27.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:27.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:27.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:27.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:54:27.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:27.550287+0000) 2019-10-23T11:54:28.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:28.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:28.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:28.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:29.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:29.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:29.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:29.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:30.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:30.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:30.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:30.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:31.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:31.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:31.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:31.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:32.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:32.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:32.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:32.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:32.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:54:32.055+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:32.057238+0000) 2019-10-23T11:54:32.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:32.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:32.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:32.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:34.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:33.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:34.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:33.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:34.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:54:34.533+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:34.535014+0000) 2019-10-23T11:54:35.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:34.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:35.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:34.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:35.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:54:35.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:35.535430+0000) 2019-10-23T11:54:35.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:54:35.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:35.554183+0000) 2019-10-23T11:54:35.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:35.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:35.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:35.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:36.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:54:36.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:36.515501+0000) 2019-10-23T11:54:37.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:37.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:37.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:37.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:37.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:54:37.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:37.550419+0000) 2019-10-23T11:54:37.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:37.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:37.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:37.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:39.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:39.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:39.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:39.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:40.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:40.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:40.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:40.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:41.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:41.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:41.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:41.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:42.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:54:42.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:42.057323+0000) 2019-10-23T11:54:42.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:42.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:42.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:42.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:43.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:43.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:43.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:43.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:44.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:44.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:44.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:44.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:44.539 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:54:44.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:44.535115+0000) 2019-10-23T11:54:45.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:45.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:45.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:45.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:45.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:54:45.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:45.535528+0000) 2019-10-23T11:54:45.558 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:54:45.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:45.554301+0000) 2019-10-23T11:54:45.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:45.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:45.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:45.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:46.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:54:46.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:46.515597+0000) 2019-10-23T11:54:46.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:46.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:46.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:46.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:47.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:54:47.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:47.550553+0000) 2019-10-23T11:54:47.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:47.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:47.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:47.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:48.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:48.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:48.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:48.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:49.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:49.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:49.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:49.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:50.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:50.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:50.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:50.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:51.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:51.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:51.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:51.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:52.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:54:52.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:52.057442+0000) 2019-10-23T11:54:52.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:52.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:52.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:52.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:53.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:53.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:53.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:53.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:54.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:54:54.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:54.535203+0000) 2019-10-23T11:54:54.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:54.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:54.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:54.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:55.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:54:55.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:55.535623+0000) 2019-10-23T11:54:55.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:54:55.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:55.554416+0000) 2019-10-23T11:54:55.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:55.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:55.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:55.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:56.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:54:56.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:56.515691+0000) 2019-10-23T11:54:56.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:56.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:56.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:56.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:57.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:54:57.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:54:57.550660+0000) 2019-10-23T11:54:57.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:57.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:57.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:57.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:58.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:58.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:58.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:58.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:54:59.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:59.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:54:59.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:54:59.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:00.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:00.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:00.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:00.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:01.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:01.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:01.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:01.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:02.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:55:02.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:02.057554+0000) 2019-10-23T11:55:02.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:02.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:02.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:02.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:03.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:03.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:03.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:03.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:04.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:55:04.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:04.535298+0000) 2019-10-23T11:55:04.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:04.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:04.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:04.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:05.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:55:05.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:05.535718+0000) 2019-10-23T11:55:05.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:55:05.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:05.554531+0000) 2019-10-23T11:55:05.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:05.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:05.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:05.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:06.518 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:55:06.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:06.515784+0000) 2019-10-23T11:55:06.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:06.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:06.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:06.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:07.553 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:55:07.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:07.550768+0000) 2019-10-23T11:55:07.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:07.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:07.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:07.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:08.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:08.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:08.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:08.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:09.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:09.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:09.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:09.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:10.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:10.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:10.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:10.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:11.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:11.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:11.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:11.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:12.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:55:12.057+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:12.057663+0000) 2019-10-23T11:55:12.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:12.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:12.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:12.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:13.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:13.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:13.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:13.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:14.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:55:14.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:14.535395+0000) 2019-10-23T11:55:14.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:14.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:14.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:14.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:15.538 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:55:15.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:15.535816+0000) 2019-10-23T11:55:15.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:55:15.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:15.554653+0000) 2019-10-23T11:55:15.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:15.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:15.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:15.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:16.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:55:16.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:16.515880+0000) 2019-10-23T11:55:16.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:16.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:16.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:16.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:17.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:55:17.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:17.550883+0000) 2019-10-23T11:55:17.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:17.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:17.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:17.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:18.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:18.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:18.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:18.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:19.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:19.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:19.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:19.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:20.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:20.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:20.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:20.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:21.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:21.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:22.060 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:55:22.057+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:22.057775+0000) 2019-10-23T11:55:22.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:22.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:22.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:22.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:23.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:23.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:23.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:23.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:24.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:55:24.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:24.535495+0000) 2019-10-23T11:55:24.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:24.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:24.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:24.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:25.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:55:25.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:25.535914+0000) 2019-10-23T11:55:25.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:55:25.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:25.554780+0000) 2019-10-23T11:55:25.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:25.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:25.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:25.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:26.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:55:26.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:26.515978+0000) 2019-10-23T11:55:26.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:26.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:26.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:26.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:27.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:55:27.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:27.550994+0000) 2019-10-23T11:55:27.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:27.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:27.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:27.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:28.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:28.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:28.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:28.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:29.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:29.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:29.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:29.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:30.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:30.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:30.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:30.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:31.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:31.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:31.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:31.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:32.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:55:32.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:32.057888+0000) 2019-10-23T11:55:32.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:32.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:32.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:32.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:33.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:33.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:33.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:33.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:34.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:55:34.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:34.535595+0000) 2019-10-23T11:55:34.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:34.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:34.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:34.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:35.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:55:35.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:35.536014+0000) 2019-10-23T11:55:35.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:55:35.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:35.554896+0000) 2019-10-23T11:55:35.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:35.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:35.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:35.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:36.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:55:36.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:36.516069+0000) 2019-10-23T11:55:36.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:36.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:36.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:36.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:37.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:55:37.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:37.551104+0000) 2019-10-23T11:55:37.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:37.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:37.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:37.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:38.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:38.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:38.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:38.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:39.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:39.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:39.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:39.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:40.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:40.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:40.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:40.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:41.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:41.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:41.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:41.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:42.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:55:42.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:42.058005+0000) 2019-10-23T11:55:42.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:42.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:42.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:42.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:43.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:43.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:43.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:43.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:44.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:55:44.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:44.535696+0000) 2019-10-23T11:55:44.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:44.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:44.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:44.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:45.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:55:45.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:45.536112+0000) 2019-10-23T11:55:45.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:55:45.553+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:45.555008+0000) 2019-10-23T11:55:45.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:45.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:45.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:45.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:46.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:55:46.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:46.516164+0000) 2019-10-23T11:55:46.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:46.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:46.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:46.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:47.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:55:47.549+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:47.551220+0000) 2019-10-23T11:55:47.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:47.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:47.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:47.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:48.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:48.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:48.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:48.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:49.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:49.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:49.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:49.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:50.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:50.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:50.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:50.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:51.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:51.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:51.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:51.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:52.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:55:52.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:52.058122+0000) 2019-10-23T11:55:52.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:52.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:52.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:52.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:53.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:53.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:53.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:53.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:54.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:55:54.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:54.535796+0000) 2019-10-23T11:55:54.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:54.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:54.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:54.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:55.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:55:55.534+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:55.536207+0000) 2019-10-23T11:55:55.559 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:55:55.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:55.555124+0000) 2019-10-23T11:55:55.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:55.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:55.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:55.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:56.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:55:56.514+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:56.516260+0000) 2019-10-23T11:55:56.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:56.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:56.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:56.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:57.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:55:57.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:55:57.551335+0000) 2019-10-23T11:55:57.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:57.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:57.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:57.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:58.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:58.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:58.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:58.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:55:59.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:59.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:55:59.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:55:59.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:00.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:00.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:00.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:00.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:01.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:01.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:01.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:01.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:02.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:02.056+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:02.058239+0000) 2019-10-23T11:56:02.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:02.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:02.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:02.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:03.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:03.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:03.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:03.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:04.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:56:04.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:04.535895+0000) 2019-10-23T11:56:04.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:04.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:04.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:04.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:05.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:56:05.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:05.536305+0000) 2019-10-23T11:56:05.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:56:05.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:05.555242+0000) 2019-10-23T11:56:05.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:05.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:05.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:05.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:06.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:56:06.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:06.516361+0000) 2019-10-23T11:56:06.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:06.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:06.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:06.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:07.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:56:07.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:07.551446+0000) 2019-10-23T11:56:07.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:07.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:07.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:07.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:08.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:08.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:08.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:08.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:09.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:09.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:09.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:09.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:10.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:10.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:10.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:10.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:11.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:11.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:11.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:11.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:12.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:12.057+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:12.058401+0000) 2019-10-23T11:56:12.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:12.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:12.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:12.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:13.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:13.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:13.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:13.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:14.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:56:14.534+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:14.535992+0000) 2019-10-23T11:56:14.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:14.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:14.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:14.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:15.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:56:15.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:15.536407+0000) 2019-10-23T11:56:15.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:56:15.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:15.555360+0000) 2019-10-23T11:56:15.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:15.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:15.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:15.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:16.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:56:16.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:16.516460+0000) 2019-10-23T11:56:16.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:16.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:16.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:16.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:17.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:56:17.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:17.551554+0000) 2019-10-23T11:56:17.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:17.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:17.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:17.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:18.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:18.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:18.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:18.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:19.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:19.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:19.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:19.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:20.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:20.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:20.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:20.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:21.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:21.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:21.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:21.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:22.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:22.058+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:22.058530+0000) 2019-10-23T11:56:22.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:22.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:22.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:22.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:23.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:23.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:23.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:23.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:24.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:24.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:24.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:24.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:24.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:56:24.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:24.536094+0000) 2019-10-23T11:56:25.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:25.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:25.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:25.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:25.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:56:25.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:25.536505+0000) 2019-10-23T11:56:25.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:56:25.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:25.555478+0000) 2019-10-23T11:56:26.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:56:26.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:26.516556+0000) 2019-10-23T11:56:26.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:26.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:26.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:26.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:27.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:27.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:27.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:27.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:27.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:56:27.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:27.551740+0000) 2019-10-23T11:56:28.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:28.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:28.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:28.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:29.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:29.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:29.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:29.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:30.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:30.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:30.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:30.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:31.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:31.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:31.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:31.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:32.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:32.058+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:32.058637+0000) 2019-10-23T11:56:32.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:32.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:32.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:32.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:33.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:33.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:33.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:33.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:34.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:34.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:34.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:34.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:34.540 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:56:34.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:34.536191+0000) 2019-10-23T11:56:35.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:35.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:35.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:35.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:35.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:56:35.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:35.536608+0000) 2019-10-23T11:56:35.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:56:35.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:35.555597+0000) 2019-10-23T11:56:36.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:36.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:36.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:36.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:36.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:56:36.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:36.516673+0000) 2019-10-23T11:56:37.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:37.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:37.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:37.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:37.554 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:56:37.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:37.551894+0000) 2019-10-23T11:56:38.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:38.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:38.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:38.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:39.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:39.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:39.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:39.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:40.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:40.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:40.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:40.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:41.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:41.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:41.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:41.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:42.061 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:42.057+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:42.058746+0000) 2019-10-23T11:56:42.062 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:42.058+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:42.059366+0000) 2019-10-23T11:56:42.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:42.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:42.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:42.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:43.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:43.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:43.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:43.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:44.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:44.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:44.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:44.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:44.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:56:44.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:44.536286+0000) 2019-10-23T11:56:45.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:45.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:45.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:45.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:45.539 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:56:45.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:45.536705+0000) 2019-10-23T11:56:45.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:56:45.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:45.555710+0000) 2019-10-23T11:56:46.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:46.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:46.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:46.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:46.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:56:46.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:46.516772+0000) 2019-10-23T11:56:46.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:46.557+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:46.558923+0000) 2019-10-23T11:56:47.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:47.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:47.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:47.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:47.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:56:47.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:47.552005+0000) 2019-10-23T11:56:48.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:48.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:48.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:48.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:49.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:49.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:49.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:49.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:50.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:50.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:50.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:50.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:51.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:51.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:51.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:51.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:52.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:52.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:52.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:52.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:53.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:53.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:53.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:53.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:54.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:54.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:54.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:54.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:54.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:56:54.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:54.536378+0000) 2019-10-23T11:56:55.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:55.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:55.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:55.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:55.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:56:55.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:55.536801+0000) 2019-10-23T11:56:55.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:56:55.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:55.555826+0000) 2019-10-23T11:56:56.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:56.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:56.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:56.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:56.519 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:56:56.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:56.516868+0000) 2019-10-23T11:56:56.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:56:56.557+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:56.559015+0000) 2019-10-23T11:56:57.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:57.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:57.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:57.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:57.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:56:57.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:56:57.552120+0000) 2019-10-23T11:56:58.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:58.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:58.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:58.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:56:59.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:59.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:56:59.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:56:59.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:00.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:00.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:00.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:00.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:01.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:01.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:01.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:01.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:02.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:02.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:02.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:02.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:03.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:03.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:03.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:03.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:04.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:04.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:04.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:04.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:04.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:57:04.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:04.536474+0000) 2019-10-23T11:57:05.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:05.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:05.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:05.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:05.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:57:05.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:05.536902+0000) 2019-10-23T11:57:05.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:57:05.554+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:05.555935+0000) 2019-10-23T11:57:06.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:06.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:06.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:06.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:06.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:57:06.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:06.516965+0000) 2019-10-23T11:57:06.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:57:06.557+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:06.559107+0000) 2019-10-23T11:57:07.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:07.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:07.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:07.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:07.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:57:07.550+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:07.552235+0000) 2019-10-23T11:57:08.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:08.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:08.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:08.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:09.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:09.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:09.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:09.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:10.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:10.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:10.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:10.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:11.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:11.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:11.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:11.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:12.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:12.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:12.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:12.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:13.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:13.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:13.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:13.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:14.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:14.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:14.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:14.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:14.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:57:14.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:14.536568+0000) 2019-10-23T11:57:15.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:15.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:15.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:15.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:15.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:57:15.535+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:15.537000+0000) 2019-10-23T11:57:15.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:57:15.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:15.556054+0000) 2019-10-23T11:57:16.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:16.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:16.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:16.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:16.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:57:16.515+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:16.517060+0000) 2019-10-23T11:57:16.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:57:16.557+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:16.559197+0000) 2019-10-23T11:57:17.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:17.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:17.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:17.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:17.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:57:17.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:17.552345+0000) 2019-10-23T11:57:18.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:18.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:18.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:18.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:19.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:19.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:19.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:19.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:20.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:20.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:20.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:20.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:21.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:21.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:21.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:21.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:22.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:22.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:22.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:22.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:23.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:23.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:23.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:23.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:24.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:24.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:24.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:24.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:24.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:57:24.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:24.536661+0000) 2019-10-23T11:57:25.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:25.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:25.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:25.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:25.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:57:25.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:25.537097+0000) 2019-10-23T11:57:25.560 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:57:25.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:25.556173+0000) 2019-10-23T11:57:26.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:26.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:26.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:26.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:26.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:57:26.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:26.517153+0000) 2019-10-23T11:57:26.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:57:26.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:26.559295+0000) 2019-10-23T11:57:27.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:27.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:27.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:27.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:27.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:57:27.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:27.552457+0000) 2019-10-23T11:57:28.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:28.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:28.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:28.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:29.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:29.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:29.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:29.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:30.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:30.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:30.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:30.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:31.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:31.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:31.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:31.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:32.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:32.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:32.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:32.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:33.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:33.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:33.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:33.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:34.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:34.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:34.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:34.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:34.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:57:34.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:34.536758+0000) 2019-10-23T11:57:35.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:35.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:35.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:35.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:35.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:57:35.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:35.537209+0000) 2019-10-23T11:57:35.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:57:35.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:35.556295+0000) 2019-10-23T11:57:36.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:36.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:36.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:36.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:36.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:57:36.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:36.517250+0000) 2019-10-23T11:57:36.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:57:36.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:36.559386+0000) 2019-10-23T11:57:37.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:37.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:37.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:37.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:37.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:57:37.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:37.552565+0000) 2019-10-23T11:57:38.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:38.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:38.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:38.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:39.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:39.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:39.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:39.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:40.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:40.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:40.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:40.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:41.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:41.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:41.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:41.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:42.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:42.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:42.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:42.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:43.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:43.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:43.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:43.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:44.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:44.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:44.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:44.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:44.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:57:44.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:44.536855+0000) 2019-10-23T11:57:45.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:45.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:45.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:45.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:45.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:57:45.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:45.537297+0000) 2019-10-23T11:57:45.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:57:45.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:45.556422+0000) 2019-10-23T11:57:46.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:57:46.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:46.517349+0000) 2019-10-23T11:57:46.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:46.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:46.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:46.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:46.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:57:46.558+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:46.559482+0000) 2019-10-23T11:57:47.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:47.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:47.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:47.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:47.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:57:47.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:47.552675+0000) 2019-10-23T11:57:48.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:48.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:48.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:48.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:49.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:49.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:49.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:49.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:50.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:50.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:50.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:50.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:51.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:51.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:51.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:51.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:52.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:52.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:52.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:52.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:53.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:53.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:53.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:53.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:54.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:54.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:54.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:54.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:54.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:57:54.535+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:54.536946+0000) 2019-10-23T11:57:55.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:55.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:55.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:55.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:55.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:57:55.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:55.537393+0000) 2019-10-23T11:57:55.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:57:55.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:55.556535+0000) 2019-10-23T11:57:56.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:56.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:56.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:56.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:56.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:57:56.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:56.517442+0000) 2019-10-23T11:57:56.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:57:56.558+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:56.559575+0000) 2019-10-23T11:57:57.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:57.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:57.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:57.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:57.555 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:57:57.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:57:57.552791+0000) 2019-10-23T11:57:58.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:58.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:58.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:58.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:57:59.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:59.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:57:59.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:57:59.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:00.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:00.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:00.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:00.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:01.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:01.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:01.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:01.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:02.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:02.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:02.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:02.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:03.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:03.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:03.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:03.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:04.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:58:04.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:04.537044+0000) 2019-10-23T11:58:04.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:04.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:04.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:04.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:05.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:58:05.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:05.537490+0000) 2019-10-23T11:58:05.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:58:05.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:05.556657+0000) 2019-10-23T11:58:05.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:05.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:05.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:05.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:06.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:58:06.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:06.517540+0000) 2019-10-23T11:58:06.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:58:06.558+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:06.559668+0000) 2019-10-23T11:58:06.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:06.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:06.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:06.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:07.556 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:58:07.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:07.552907+0000) 2019-10-23T11:58:07.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:07.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:07.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:07.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:08.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:08.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:08.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:08.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:09.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:09.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:09.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:09.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:10.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:10.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:10.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:10.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:11.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:11.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:11.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:11.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:12.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:12.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:12.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:12.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:13.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:13.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:13.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:13.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:14.541 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:58:14.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:14.537142+0000) 2019-10-23T11:58:14.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:14.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:14.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:14.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:15.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:58:15.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:15.537589+0000) 2019-10-23T11:58:15.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:58:15.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:15.556775+0000) 2019-10-23T11:58:15.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:15.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:15.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:15.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:16.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:58:16.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:16.517634+0000) 2019-10-23T11:58:16.562 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:58:16.558+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:16.559760+0000) 2019-10-23T11:58:16.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:16.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:16.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:16.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:17.556 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:58:17.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:17.553015+0000) 2019-10-23T11:58:17.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:17.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:17.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:17.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:18.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:18.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:18.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:18.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:19.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:19.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:19.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:19.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:20.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:20.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:20.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:20.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:21.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:21.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:21.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:21.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:22.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:22.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:22.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:22.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:23.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:23.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:23.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:23.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:24.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:58:24.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:24.537235+0000) 2019-10-23T11:58:24.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:24.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:24.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:24.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:25.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:58:25.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:25.537683+0000) 2019-10-23T11:58:25.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:58:25.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:25.556895+0000) 2019-10-23T11:58:25.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:25.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:25.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:25.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:26.520 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:58:26.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:26.517729+0000) 2019-10-23T11:58:26.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:26.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:26.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:26.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:26.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:58:26.558+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:26.559853+0000) 2019-10-23T11:58:27.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:27.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:27.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:27.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:27.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:58:27.551+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:27.553126+0000) 2019-10-23T11:58:28.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:28.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:28.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:28.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:29.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:29.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:29.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:29.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:30.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:30.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:30.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:30.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:31.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:31.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:31.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:31.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:32.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:32.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:32.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:32.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:33.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:33.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:33.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:33.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:34.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:34.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:34.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:34.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:34.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:58:34.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:34.537365+0000) 2019-10-23T11:58:35.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:35.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:35.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:35.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:35.540 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:58:35.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:35.537814+0000) 2019-10-23T11:58:35.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:58:35.555+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:35.557013+0000) 2019-10-23T11:58:36.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:36.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:36.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:36.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:36.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:58:36.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:36.517871+0000) 2019-10-23T11:58:36.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:58:36.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:36.559982+0000) 2019-10-23T11:58:37.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:37.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:37.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:37.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:37.556 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:58:37.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:37.553328+0000) 2019-10-23T11:58:38.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:38.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:38.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:38.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:39.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:39.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:39.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:39.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:40.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:40.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:40.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:40.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:41.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:41.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:41.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:41.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:42.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:42.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:42.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:42.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:43.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:43.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:43.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:43.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:44.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:44.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:44.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:44.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:44.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:58:44.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:44.537483+0000) 2019-10-23T11:58:45.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:45.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:45.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:45.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:45.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:58:45.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:45.537969+0000) 2019-10-23T11:58:45.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:58:45.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:45.557130+0000) 2019-10-23T11:58:46.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:46.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:46.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:46.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:46.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:58:46.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:46.518022+0000) 2019-10-23T11:58:46.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:58:46.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:46.560101+0000) 2019-10-23T11:58:47.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:47.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:47.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:47.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:47.556 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:58:47.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:47.553452+0000) 2019-10-23T11:58:48.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:48.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:48.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:48.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:49.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:49.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:49.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:49.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:50.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:50.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:50.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:50.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:51.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:51.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:51.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:51.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:52.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:52.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:52.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:52.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:53.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:53.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:53.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:53.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:54.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:54.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:54.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:54.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:54.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:58:54.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:54.537595+0000) 2019-10-23T11:58:55.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:55.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:55.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:55.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:55.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:58:55.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:55.538069+0000) 2019-10-23T11:58:55.561 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:58:55.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:55.557251+0000) 2019-10-23T11:58:56.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:56.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:56.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:56.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:56.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:58:56.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:56.518115+0000) 2019-10-23T11:58:56.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:58:56.558+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:56.560193+0000) 2019-10-23T11:58:57.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:57.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:57.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:57.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:57.556 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:58:57.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:58:57.553561+0000) 2019-10-23T11:58:58.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:58.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:58.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:58.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:58:59.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:59.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:58:59.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:58:59.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:00.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:00.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:00.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:00.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:01.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:01.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:01.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:01.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:02.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:02.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:02.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:02.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:03.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:03.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:03.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:03.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:04.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:59:04.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:04.537708+0000) 2019-10-23T11:59:04.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:04.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:04.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:04.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:05.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:59:05.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:05.538169+0000) 2019-10-23T11:59:05.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:05.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:05.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:05.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:05.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:59:05.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:05.557359+0000) 2019-10-23T11:59:06.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:59:06.516+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:06.518211+0000) 2019-10-23T11:59:06.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:06.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:06.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:06.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:06.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:59:06.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:06.560292+0000) 2019-10-23T11:59:07.556 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:59:07.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:07.553671+0000) 2019-10-23T11:59:07.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:07.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:07.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:07.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:08.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:08.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:08.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:08.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:09.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:09.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:09.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:09.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:10.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:10.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:10.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:10.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:11.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:11.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:11.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:11.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:12.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:12.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:12.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:12.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:13.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:13.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:13.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:13.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:14.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:59:14.536+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:14.537821+0000) 2019-10-23T11:59:14.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:14.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:14.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:14.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:15.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:59:15.536+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:15.538267+0000) 2019-10-23T11:59:15.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:59:15.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:15.557470+0000) 2019-10-23T11:59:15.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:15.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:15.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:15.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:16.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:59:16.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:16.518297+0000) 2019-10-23T11:59:16.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:59:16.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:16.560392+0000) 2019-10-23T11:59:16.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:16.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:16.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:16.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:17.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:59:17.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:17.553786+0000) 2019-10-23T11:59:17.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:17.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:17.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:17.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:18.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:18.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:18.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:18.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:19.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:19.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:19.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:19.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:20.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:20.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:20.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:20.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:21.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:21.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:21.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:21.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:22.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:22.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:22.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:22.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:23.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:23.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:23.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:23.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:24.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:59:24.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:24.537938+0000) 2019-10-23T11:59:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:24.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:24.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:25.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:59:25.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:25.538364+0000) 2019-10-23T11:59:25.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:59:25.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:25.557582+0000) 2019-10-23T11:59:25.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:25.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:25.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:25.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:26.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:59:26.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:26.518394+0000) 2019-10-23T11:59:26.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:59:26.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:26.560485+0000) 2019-10-23T11:59:26.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:26.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:26.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:26.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:27.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:59:27.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:27.553902+0000) 2019-10-23T11:59:27.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:27.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:27.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:27.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:28.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:28.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:28.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:28.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:29.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:29.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:29.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:29.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:30.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:30.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:30.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:30.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:31.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:31.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:31.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:31.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:32.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:32.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:32.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:32.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:33.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:33.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:33.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:33.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:34.542 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:59:34.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:34.538063+0000) 2019-10-23T11:59:34.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:34.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:34.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:34.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:35.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:59:35.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:35.538464+0000) 2019-10-23T11:59:35.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:59:35.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:35.557700+0000) 2019-10-23T11:59:35.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:35.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:35.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:35.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:36.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:59:36.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:36.518491+0000) 2019-10-23T11:59:36.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:59:36.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:36.560583+0000) 2019-10-23T11:59:36.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:36.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:36.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:36.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:37.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:59:37.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:37.554008+0000) 2019-10-23T11:59:37.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:37.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:37.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:37.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:38.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:38.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:38.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:38.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:39.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:39.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:39.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:39.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:40.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:40.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:40.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:40.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:41.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:41.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:41.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:41.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:42.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:42.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:42.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:42.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:43.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:43.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:43.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:43.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:44.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:59:44.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:44.538180+0000) 2019-10-23T11:59:44.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:44.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:44.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:44.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:45.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:59:45.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:45.538568+0000) 2019-10-23T11:59:45.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:59:45.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:45.557813+0000) 2019-10-23T11:59:45.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:45.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:45.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:45.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:46.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:59:46.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:46.518585+0000) 2019-10-23T11:59:46.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:59:46.560+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:46.560681+0000) 2019-10-23T11:59:46.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:46.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:46.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:46.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:47.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:59:47.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:47.554117+0000) 2019-10-23T11:59:47.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:47.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:47.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:47.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:48.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:48.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:48.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:48.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:49.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:49.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:49.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:49.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:50.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:50.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:50.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:50.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:51.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:51.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:51.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:51.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:52.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:52.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:52.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:52.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:53.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:53.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:53.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:53.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:54.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T11:59:54.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:54.538294+0000) 2019-10-23T11:59:54.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:54.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:54.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:54.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:55.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T11:59:55.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:55.538670+0000) 2019-10-23T11:59:55.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T11:59:55.556+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:55.557926+0000) 2019-10-23T11:59:55.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:55.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:55.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:55.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:56.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T11:59:56.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:56.518680+0000) 2019-10-23T11:59:56.563 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T11:59:56.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:56.560776+0000) 2019-10-23T11:59:56.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:56.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:56.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:56.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:57.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T11:59:57.552+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T10:59:57.554221+0000) 2019-10-23T11:59:57.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:57.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:57.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:57.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:58.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:58.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:58.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:58.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T11:59:59.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:59.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T11:59:59.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T11:59:59.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:00.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:00.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:00.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:00.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:01.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:01.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:01.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:01.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:02.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:02.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:02.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:02.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:03.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:03.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:03.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:03.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:04.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:00:04.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:04.538406+0000) 2019-10-23T12:00:04.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:04.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:04.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:04.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:05.541 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:00:05.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:05.538771+0000) 2019-10-23T12:00:05.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:00:05.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:05.558053+0000) 2019-10-23T12:00:05.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:05.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:05.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:05.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:06.521 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:00:06.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:06.518776+0000) 2019-10-23T12:00:06.564 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:06.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:06.560869+0000) 2019-10-23T12:00:06.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:06.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:06.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:06.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:07.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:00:07.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:07.554329+0000) 2019-10-23T12:00:07.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:07.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:07.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:07.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:08.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:08.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:08.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:08.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:09.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:09.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:09.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:09.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:10.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:10.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:10.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:10.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:11.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:11.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:11.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:11.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:12.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:12.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:12.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:12.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:13.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:13.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:13.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:13.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:14.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:00:14.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:14.538590+0000) 2019-10-23T12:00:14.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:14.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:14.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:14.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:15.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:00:15.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:15.538870+0000) 2019-10-23T12:00:15.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:15.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:15.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:15.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:15.562 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:00:15.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:15.558248+0000) 2019-10-23T12:00:16.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:00:16.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:16.518893+0000) 2019-10-23T12:00:16.564 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:16.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:16.560991+0000) 2019-10-23T12:00:16.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:16.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:16.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:16.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:17.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:00:17.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:17.554497+0000) 2019-10-23T12:00:17.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:17.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:17.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:17.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:18.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:18.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:18.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:18.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:19.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:19.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:19.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:19.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:20.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:20.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:20.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:20.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:21.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:21.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:21.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:21.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:22.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:22.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:22.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:22.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:23.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:23.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:23.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:23.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:24.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:24.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:24.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:24.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:24.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:00:24.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:24.538744+0000) 2019-10-23T12:00:25.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:25.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:25.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:25.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:25.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:00:25.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:25.538970+0000) 2019-10-23T12:00:25.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:00:25.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:25.558387+0000) 2019-10-23T12:00:26.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:26.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:26.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:26.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:26.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:00:26.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:26.519006+0000) 2019-10-23T12:00:26.564 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:26.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:26.561085+0000) 2019-10-23T12:00:27.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:27.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:27.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:27.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:27.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:00:27.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:27.554629+0000) 2019-10-23T12:00:28.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:28.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T11:49:52.736408+0000 (oldest deadline 2019-10-23T11:50:12.736408+0000) 2019-10-23T12:00:28.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:28.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:29.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:29.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:30.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:30.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:31.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:31.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:32.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:32.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:33.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:33.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:34.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:00:34.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:34.538858+0000) 2019-10-23T12:00:34.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:34.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:35.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:00:35.537+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:35.539068+0000) 2019-10-23T12:00:35.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:00:35.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:35.558531+0000) 2019-10-23T12:00:35.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:35.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:36.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:00:36.517+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:36.519098+0000) 2019-10-23T12:00:36.564 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:36.559+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:36.561182+0000) 2019-10-23T12:00:36.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:36.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:37.557 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:00:37.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:37.554739+0000) 2019-10-23T12:00:37.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:37.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:38.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:38.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:39.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:39.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:40.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:40.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:41.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:41.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:42.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:42.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:43.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:43.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:44.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:00:44.537+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:44.538969+0000) 2019-10-23T12:00:44.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:44.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:45.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:00:45.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:45.539168+0000) 2019-10-23T12:00:45.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:00:45.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:45.558670+0000) 2019-10-23T12:00:45.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:45.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:46.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:00:46.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:46.519229+0000) 2019-10-23T12:00:46.564 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:46.561+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:46.561280+0000) 2019-10-23T12:00:46.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:46.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:47.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:00:47.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:47.554908+0000) 2019-10-23T12:00:47.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:47.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:48.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:48.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:49.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:49.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:50.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:50.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:50.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:50.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:51.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:51.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:51.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:51.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:52.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:52.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:52.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:52.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:53.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:53.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:53.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:53.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:54.543 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:00:54.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:54.539081+0000) 2019-10-23T12:00:54.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:54.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:54.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:54.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:55.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:00:55.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:55.539266+0000) 2019-10-23T12:00:55.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:00:55.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:55.558786+0000) 2019-10-23T12:00:55.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:55.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:55.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:55.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:56.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:00:56.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:56.519367+0000) 2019-10-23T12:00:56.564 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:56.561+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:56.561427+0000) 2019-10-23T12:00:56.565 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:00:56.561+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:56.561980+0000) 2019-10-23T12:00:56.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:56.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:56.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:56.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:57.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:00:57.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:00:57.555053+0000) 2019-10-23T12:00:57.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:57.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:57.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:57.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:58.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:58.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:58.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:58.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:00:59.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:59.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:00:59.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:00:59.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:00.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:00.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:00.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:00.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:01.064 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:01:01.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:01.061629+0000) 2019-10-23T12:01:01.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:01.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:01.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:01.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:02.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:02.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:02.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:02.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:03.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:03.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:03.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:03.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:04.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:01:04.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:04.539193+0000) 2019-10-23T12:01:04.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:04.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:04.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:04.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:05.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:01:05.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:05.539366+0000) 2019-10-23T12:01:05.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:01:05.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:05.558904+0000) 2019-10-23T12:01:05.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:05.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:05.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:05.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:06.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:01:06.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:06.519464+0000) 2019-10-23T12:01:06.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:06.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:06.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:06.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:07.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:07.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:07.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:07.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:07.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:01:07.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:07.555163+0000) 2019-10-23T12:01:08.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:08.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:08.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:08.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:09.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:09.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:09.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:09.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:10.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:10.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:10.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:10.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:11.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:01:11.060+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:11.061726+0000) 2019-10-23T12:01:11.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:11.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:11.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:11.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:12.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:12.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:12.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:12.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:13.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:13.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:13.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:13.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:14.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:01:14.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:14.539303+0000) 2019-10-23T12:01:14.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:14.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:14.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:14.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:15.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:15.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:15.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:15.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:15.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:01:15.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:15.539460+0000) 2019-10-23T12:01:15.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:01:15.557+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:15.559014+0000) 2019-10-23T12:01:16.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:16.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:16.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:16.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:16.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:01:16.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:16.519564+0000) 2019-10-23T12:01:17.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:17.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:17.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:17.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:17.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:01:17.553+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:17.555275+0000) 2019-10-23T12:01:18.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:18.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:18.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:18.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:19.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:19.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:19.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:19.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:20.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:20.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:20.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:20.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:21.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:01:21.060+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:21.061824+0000) 2019-10-23T12:01:21.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:21.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:21.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:21.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:22.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:22.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:22.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:22.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:23.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:23.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:23.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:23.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:24.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:01:24.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:24.539418+0000) 2019-10-23T12:01:24.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:24.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:24.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:24.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:25.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:01:25.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:25.539558+0000) 2019-10-23T12:01:25.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:01:25.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:25.559130+0000) 2019-10-23T12:01:25.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:25.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:25.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:25.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:26.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:01:26.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:26.519674+0000) 2019-10-23T12:01:26.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:26.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:26.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:26.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:27.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:01:27.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:27.555392+0000) 2019-10-23T12:01:27.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:27.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:27.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:27.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:28.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:28.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:28.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:28.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:29.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:29.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:29.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:29.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:30.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:30.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:30.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:30.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:31.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:01:31.060+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:31.061923+0000) 2019-10-23T12:01:31.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:31.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:31.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:31.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:32.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:32.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:32.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:32.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:33.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:33.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:33.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:33.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:34.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:01:34.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:34.539554+0000) 2019-10-23T12:01:34.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:34.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:34.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:34.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:35.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:01:35.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:35.539657+0000) 2019-10-23T12:01:35.563 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:01:35.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:35.559245+0000) 2019-10-23T12:01:35.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:35.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:35.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:35.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:36.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:01:36.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:36.519769+0000) 2019-10-23T12:01:36.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:36.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:36.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:36.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:37.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:01:37.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:37.555509+0000) 2019-10-23T12:01:37.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:37.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:37.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:37.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:38.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:38.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:38.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:38.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:39.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:39.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:39.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:39.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:40.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:40.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:40.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:40.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:41.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:01:41.060+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:41.062019+0000) 2019-10-23T12:01:41.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:41.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:41.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:41.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:42.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:42.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:42.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:42.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:43.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:43.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:43.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:43.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:44.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:01:44.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:44.539672+0000) 2019-10-23T12:01:44.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:44.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:44.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:44.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:45.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:01:45.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:45.539748+0000) 2019-10-23T12:01:45.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:01:45.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:45.559358+0000) 2019-10-23T12:01:45.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:45.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:45.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:45.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:46.522 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:01:46.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:46.519863+0000) 2019-10-23T12:01:46.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:46.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:46.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:46.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:47.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:01:47.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:47.555622+0000) 2019-10-23T12:01:47.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:47.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:47.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:47.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:48.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:48.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:48.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:48.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:49.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:49.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:49.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:49.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:50.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:50.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:50.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:50.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:51.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:01:51.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:51.062115+0000) 2019-10-23T12:01:51.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:51.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:51.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:51.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:52.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:52.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:52.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:52.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:53.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:53.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:53.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:53.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:54.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:54.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:54.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:54.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:54.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:01:54.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:54.539792+0000) 2019-10-23T12:01:55.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:55.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:55.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:55.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:55.542 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:01:55.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:55.539843+0000) 2019-10-23T12:01:55.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:01:55.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:55.559465+0000) 2019-10-23T12:01:56.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:56.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:56.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:56.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:56.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:01:56.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:56.519958+0000) 2019-10-23T12:01:57.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:57.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:57.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:57.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:57.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:01:57.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:01:57.555728+0000) 2019-10-23T12:01:58.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:58.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:58.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:58.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:01:59.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:59.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:01:59.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:01:59.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:00.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:00.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:00.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:00.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:01.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:02:01.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:01.062213+0000) 2019-10-23T12:02:01.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:01.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:01.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:01.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:02.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:02.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:02.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:02.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:03.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:03.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:03.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:03.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:04.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:04.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:04.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:04.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:04.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:02:04.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:04.539902+0000) 2019-10-23T12:02:05.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:05.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:05.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:05.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:05.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:02:05.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:05.539965+0000) 2019-10-23T12:02:05.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:02:05.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:05.559577+0000) 2019-10-23T12:02:06.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:06.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:06.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:06.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:06.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:02:06.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:06.520050+0000) 2019-10-23T12:02:07.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:07.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:07.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:07.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:07.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:02:07.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:07.555837+0000) 2019-10-23T12:02:08.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:08.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:08.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:08.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:09.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:09.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:09.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:09.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:10.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:10.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:10.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:10.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:11.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:02:11.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:11.062298+0000) 2019-10-23T12:02:11.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:11.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:11.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:11.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:12.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:12.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:12.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:12.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:13.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:13.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:13.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:13.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:14.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:02:14.538+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:14.540007+0000) 2019-10-23T12:02:14.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:14.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:14.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:14.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:15.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:15.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:15.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:15.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:15.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:02:15.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:15.540081+0000) 2019-10-23T12:02:15.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:02:15.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:15.559693+0000) 2019-10-23T12:02:16.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:16.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:16.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:16.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:16.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:02:16.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:16.520144+0000) 2019-10-23T12:02:17.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:17.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:17.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:17.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:17.558 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:02:17.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:17.555950+0000) 2019-10-23T12:02:18.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:18.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:18.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:18.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:19.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:19.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:19.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:19.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:20.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:20.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:20.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:20.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:21.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:02:21.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:21.062396+0000) 2019-10-23T12:02:21.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:21.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:21.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:21.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:22.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:22.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:22.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:22.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:23.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:23.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:23.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:23.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:24.544 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:02:24.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:24.540123+0000) 2019-10-23T12:02:24.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:24.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:24.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:24.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:25.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:02:25.538+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:25.540197+0000) 2019-10-23T12:02:25.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:02:25.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:25.559809+0000) 2019-10-23T12:02:25.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:25.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:25.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:25.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:26.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:02:26.518+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:26.520241+0000) 2019-10-23T12:02:26.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:26.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:26.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:26.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:27.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:02:27.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:27.556131+0000) 2019-10-23T12:02:27.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:27.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:27.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:27.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:28.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:28.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:28.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:28.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:29.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:29.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:29.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:29.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:30.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:30.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:30.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:30.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:31.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:02:31.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:31.062488+0000) 2019-10-23T12:02:31.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:31.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:31.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:31.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:32.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:32.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:32.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:32.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:33.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:33.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:33.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:33.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:34.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:34.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:34.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:34.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:34.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:02:34.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:34.540229+0000) 2019-10-23T12:02:35.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:35.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:35.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:35.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:35.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:02:35.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:35.540316+0000) 2019-10-23T12:02:35.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:02:35.558+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:35.559922+0000) 2019-10-23T12:02:36.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:36.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:36.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:36.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:36.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:02:36.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:36.520297+0000) 2019-10-23T12:02:37.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:37.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:37.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:37.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:37.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:02:37.554+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:37.556267+0000) 2019-10-23T12:02:38.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:38.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:38.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:38.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:39.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:39.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:39.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:39.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:40.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:40.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:40.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:40.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:41.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:02:41.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:41.062586+0000) 2019-10-23T12:02:41.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:41.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:41.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:41.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:42.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:42.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:42.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:42.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:43.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:43.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:43.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:43.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:44.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:44.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:44.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:44.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:44.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:02:44.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:44.540337+0000) 2019-10-23T12:02:45.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:45.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:45.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:45.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:45.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:02:45.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:45.540431+0000) 2019-10-23T12:02:45.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:02:45.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:45.560042+0000) 2019-10-23T12:02:46.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:46.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:46.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:46.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:46.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:02:46.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:46.520392+0000) 2019-10-23T12:02:47.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:47.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:47.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:47.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:47.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:02:47.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:47.556377+0000) 2019-10-23T12:02:48.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:48.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:48.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:48.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:49.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:49.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:49.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:49.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:50.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:50.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:50.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:50.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:51.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:02:51.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:51.062681+0000) 2019-10-23T12:02:51.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:51.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:51.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:51.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:52.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:52.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:52.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:52.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:53.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:53.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:53.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:53.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:54.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:54.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:54.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:54.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:54.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:02:54.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:54.540445+0000) 2019-10-23T12:02:55.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:55.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:55.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:55.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:55.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:02:55.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:55.540545+0000) 2019-10-23T12:02:55.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:02:55.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:55.560157+0000) 2019-10-23T12:02:56.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:56.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:56.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:56.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:56.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:02:56.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:56.520489+0000) 2019-10-23T12:02:57.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:57.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:57.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:57.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:57.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:02:57.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:02:57.556485+0000) 2019-10-23T12:02:58.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:58.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:58.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:58.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:02:59.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:59.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:02:59.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:02:59.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:00.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:00.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:00.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:00.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:01.065 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:01.062+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:01.062773+0000) 2019-10-23T12:03:01.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:01.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:01.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:01.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:02.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:02.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:02.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:02.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:03.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:03.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:03.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:03.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:04.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:04.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:04.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:04.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:04.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:04.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:04.540555+0000) 2019-10-23T12:03:05.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:05.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:05.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:05.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:05.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:03:05.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:05.540666+0000) 2019-10-23T12:03:05.564 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:03:05.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:05.560273+0000) 2019-10-23T12:03:06.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:06.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:06.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:06.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:06.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:03:06.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:06.520585+0000) 2019-10-23T12:03:07.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:07.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:07.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:07.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:07.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:03:07.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:07.556595+0000) 2019-10-23T12:03:08.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:08.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:08.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:08.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:09.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:09.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:09.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:09.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:10.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:10.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:10.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:10.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:11.066 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:11.062+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:11.062866+0000) 2019-10-23T12:03:11.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:11.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:11.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:11.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:12.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:12.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:12.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:12.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:13.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:13.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:13.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:13.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:14.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:14.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:14.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:14.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:14.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:14.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:14.540668+0000) 2019-10-23T12:03:15.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:15.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:15.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:15.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:15.543 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:03:15.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:15.540782+0000) 2019-10-23T12:03:15.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:03:15.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:15.560387+0000) 2019-10-23T12:03:16.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:16.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:16.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:16.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:16.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:03:16.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:16.520681+0000) 2019-10-23T12:03:17.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:17.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:17.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:17.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:17.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:03:17.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:17.556709+0000) 2019-10-23T12:03:18.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:18.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:18.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:18.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:19.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:19.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:19.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:19.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:20.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:20.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:20.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:20.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:21.066 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:21.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:21.062962+0000) 2019-10-23T12:03:21.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:21.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:21.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:21.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:22.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:22.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:22.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:22.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:23.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:23.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:23.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:23.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:24.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:24.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:24.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:24.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:24.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:24.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:24.540782+0000) 2019-10-23T12:03:25.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:25.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:25.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:25.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:25.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:03:25.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:25.540902+0000) 2019-10-23T12:03:25.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:03:25.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:25.560501+0000) 2019-10-23T12:03:26.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:26.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:26.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:26.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:26.523 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:03:26.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:26.520777+0000) 2019-10-23T12:03:27.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:27.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:27.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:27.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:27.559 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:03:27.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:27.556823+0000) 2019-10-23T12:03:28.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:28.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:28.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:28.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:29.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:29.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:29.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:29.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:30.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:30.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:30.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:30.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:31.066 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:31.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:31.063058+0000) 2019-10-23T12:03:31.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:31.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:31.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:31.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:32.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:32.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:32.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:32.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:33.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:33.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:33.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:33.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:34.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:34.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:34.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:34.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:34.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:34.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:34.540891+0000) 2019-10-23T12:03:35.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:35.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:35.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:35.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:35.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:03:35.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:35.541019+0000) 2019-10-23T12:03:35.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:03:35.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:35.560614+0000) 2019-10-23T12:03:36.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:36.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:36.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:36.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:36.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:03:36.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:36.520874+0000) 2019-10-23T12:03:37.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:37.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:37.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:37.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:37.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:03:37.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:37.556932+0000) 2019-10-23T12:03:38.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:38.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:38.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:38.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:39.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:39.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:39.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:39.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:40.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:40.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:40.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:40.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:41.066 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:41.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:41.063150+0000) 2019-10-23T12:03:41.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:41.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:41.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:41.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:42.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:42.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:42.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:42.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:43.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:43.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:43.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:43.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:44.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:44.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:44.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:44.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:44.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:44.539+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:44.541001+0000) 2019-10-23T12:03:45.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:45.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:45.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:45.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:45.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:03:45.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:45.541136+0000) 2019-10-23T12:03:45.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:03:45.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:45.560723+0000) 2019-10-23T12:03:46.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:46.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:46.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:46.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:46.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:03:46.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:46.520970+0000) 2019-10-23T12:03:47.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:47.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:47.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:47.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:47.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:03:47.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:47.557045+0000) 2019-10-23T12:03:48.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:48.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:48.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:48.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:49.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:49.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:49.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:49.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:50.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:50.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:50.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:50.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:51.066 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:51.061+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:51.063244+0000) 2019-10-23T12:03:51.066 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:51.062+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:51.063835+0000) 2019-10-23T12:03:51.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:51.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:51.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:51.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:52.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:52.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:52.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:52.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:53.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:53.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:53.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:53.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:54.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:54.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:54.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:54.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:54.545 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:54.540+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:54.541118+0000) 2019-10-23T12:03:54.546 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:54.540+0000 7f2d2295b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:54.541683+0000) 2019-10-23T12:03:55.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:55.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:55.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:55.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:55.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:03:55.539+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:55.541256+0000) 2019-10-23T12:03:55.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:03:55.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:55.560849+0000) 2019-10-23T12:03:55.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:03:55.562+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:55.563432+0000) 2019-10-23T12:03:56.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:56.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:56.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:56.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:56.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:03:56.519+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:56.521069+0000) 2019-10-23T12:03:57.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:57.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:57.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:57.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:57.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:03:57.555+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:57.557158+0000) 2019-10-23T12:03:58.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:58.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:58.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:58.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:03:59.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:03:59.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:03:59.041298+0000) 2019-10-23T12:03:59.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:59.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:03:59.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:03:59.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:00.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:00.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:00.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:00.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:01.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:01.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:01.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:01.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:02.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:02.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:02.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:02.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:03.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:03.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:03.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:03.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:04.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:04.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:04.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:04.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:05.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:05.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:05.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:05.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:05.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:04:05.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:05.541372+0000) 2019-10-23T12:04:05.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:04:05.559+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:05.560963+0000) 2019-10-23T12:04:05.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:04:05.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:05.563525+0000) 2019-10-23T12:04:06.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:06.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:06.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:06.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:06.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:04:06.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:06.521165+0000) 2019-10-23T12:04:07.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:07.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:07.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:07.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:07.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:04:07.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:07.557268+0000) 2019-10-23T12:04:08.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:08.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:08.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:08.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:09.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:04:09.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:09.041391+0000) 2019-10-23T12:04:09.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:09.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:09.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:09.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:10.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:10.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:10.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:10.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:11.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:11.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:11.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:11.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:12.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:12.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:12.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:12.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:13.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:13.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:13.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:13.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:14.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:14.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:14.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:14.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:15.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:15.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:15.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:15.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:15.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:04:15.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:15.541485+0000) 2019-10-23T12:04:15.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:04:15.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:15.561082+0000) 2019-10-23T12:04:15.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:04:15.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:15.563620+0000) 2019-10-23T12:04:16.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:16.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:16.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:16.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:16.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:04:16.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:16.521266+0000) 2019-10-23T12:04:17.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:17.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:17.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:17.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:17.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:04:17.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:17.557383+0000) 2019-10-23T12:04:18.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:18.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:18.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:18.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:19.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:04:19.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:19.041487+0000) 2019-10-23T12:04:19.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:19.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:19.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:19.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:20.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:20.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:20.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:20.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:21.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:21.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:21.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:21.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:22.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:22.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:22.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:22.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:23.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:23.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:23.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:23.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:24.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:24.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:24.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:24.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:25.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:25.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:25.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:25.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:25.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:04:25.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:25.541601+0000) 2019-10-23T12:04:25.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:04:25.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:25.561196+0000) 2019-10-23T12:04:25.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:04:25.562+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:25.563717+0000) 2019-10-23T12:04:26.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:26.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:26.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:26.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:26.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:04:26.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:26.521369+0000) 2019-10-23T12:04:27.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:27.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:27.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:27.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:27.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:04:27.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:27.557495+0000) 2019-10-23T12:04:28.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:28.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:28.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:28.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:29.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:04:29.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:29.041586+0000) 2019-10-23T12:04:29.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:29.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:29.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:29.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:30.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:30.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:30.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:30.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:31.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:31.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:31.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:31.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:32.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:32.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:32.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:32.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:33.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:33.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:33.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:33.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:34.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:34.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:34.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:34.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:35.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:35.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:35.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:35.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:35.544 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:04:35.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:35.541714+0000) 2019-10-23T12:04:35.565 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:04:35.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:35.561314+0000) 2019-10-23T12:04:35.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:04:35.562+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:35.563810+0000) 2019-10-23T12:04:36.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:36.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:36.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:36.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:36.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:04:36.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:36.521467+0000) 2019-10-23T12:04:37.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:37.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:37.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:37.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:37.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:04:37.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:37.557604+0000) 2019-10-23T12:04:38.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:38.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:38.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:38.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:39.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:04:39.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:39.041680+0000) 2019-10-23T12:04:39.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:39.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:39.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:39.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:40.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:40.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:40.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:40.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:41.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:41.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:41.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:41.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:42.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:42.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:42.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:42.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:43.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:43.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:43.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:43.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:44.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:44.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:44.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:44.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:45.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:45.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:45.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:45.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:45.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:04:45.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:45.541834+0000) 2019-10-23T12:04:45.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:04:45.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:45.561434+0000) 2019-10-23T12:04:45.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:04:45.562+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:45.563906+0000) 2019-10-23T12:04:46.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:46.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:46.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:46.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:46.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:04:46.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:46.521563+0000) 2019-10-23T12:04:47.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:47.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:47.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:47.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:47.560 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:04:47.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:47.557713+0000) 2019-10-23T12:04:48.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:48.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:48.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:48.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:49.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:04:49.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:49.041772+0000) 2019-10-23T12:04:49.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:49.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:49.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:49.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:50.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:50.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:50.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:50.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:51.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:51.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:51.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:51.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:52.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:52.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:52.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:52.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:53.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:53.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:53.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:53.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:54.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:54.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:54.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:54.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:55.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:55.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:55.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:55.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:55.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:04:55.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:55.541951+0000) 2019-10-23T12:04:55.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:04:55.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:55.561552+0000) 2019-10-23T12:04:55.566 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:04:55.562+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:55.564003+0000) 2019-10-23T12:04:56.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:56.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:56.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:56.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:56.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:04:56.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:56.521656+0000) 2019-10-23T12:04:57.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:57.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:57.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:57.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:57.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:04:57.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:57.557820+0000) 2019-10-23T12:04:58.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:58.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:58.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:58.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:04:59.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:04:59.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:04:59.041871+0000) 2019-10-23T12:04:59.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:59.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:04:59.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:04:59.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:00.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:00.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:00.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:00.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:01.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:01.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:01.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:01.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:02.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:02.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:02.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:02.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:03.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:03.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:03.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:03.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:04.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:04.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:04.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:04.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:05.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:05.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:05.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:05.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:05.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:05:05.540+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:05.542060+0000) 2019-10-23T12:05:05.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:05:05.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:05.561685+0000) 2019-10-23T12:05:05.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:05:05.562+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:05.564098+0000) 2019-10-23T12:05:06.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:06.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:06.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:06.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:06.524 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:05:06.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:06.521750+0000) 2019-10-23T12:05:07.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:07.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:07.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:07.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:07.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:05:07.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:07.557927+0000) 2019-10-23T12:05:08.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:08.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:08.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:08.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:09.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:05:09.040+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:09.041967+0000) 2019-10-23T12:05:09.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:09.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:09.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:09.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:10.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:10.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:10.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:10.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:11.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:11.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:11.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:11.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:12.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:12.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:12.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:12.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:13.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:13.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:13.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:13.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:14.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:14.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:14.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:14.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:15.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:15.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:15.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:15.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:15.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:05:15.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:15.542176+0000) 2019-10-23T12:05:15.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:05:15.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:15.561807+0000) 2019-10-23T12:05:15.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:05:15.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:15.564190+0000) 2019-10-23T12:05:16.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:16.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:16.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:16.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:16.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:05:16.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:16.521845+0000) 2019-10-23T12:05:17.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:17.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:17.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:17.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:17.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:05:17.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:17.558034+0000) 2019-10-23T12:05:18.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:18.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:18.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:18.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:19.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:05:19.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:19.042063+0000) 2019-10-23T12:05:19.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:19.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:19.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:19.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:20.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:20.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:20.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:20.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:21.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:21.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:21.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:21.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:22.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:22.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:22.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:22.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:23.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:23.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:23.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:23.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:24.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:24.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:24.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:24.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:25.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:25.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:25.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:25.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:25.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:05:25.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:25.542297+0000) 2019-10-23T12:05:25.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:05:25.560+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:25.561925+0000) 2019-10-23T12:05:25.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:05:25.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:25.564288+0000) 2019-10-23T12:05:26.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:26.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:26.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:26.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:26.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:05:26.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:26.521943+0000) 2019-10-23T12:05:27.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:27.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:27.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:27.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:27.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:05:27.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:27.558144+0000) 2019-10-23T12:05:28.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:28.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:28.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:28.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:29.046 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:05:29.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:29.042160+0000) 2019-10-23T12:05:29.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:29.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:29.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:29.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:30.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:30.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:30.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:30.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:31.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:31.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:31.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:31.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:32.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:32.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:32.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:32.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:33.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:33.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:33.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:33.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:34.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:34.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:34.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:34.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:35.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:35.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:35.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:35.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:35.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:05:35.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:35.542418+0000) 2019-10-23T12:05:35.566 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:05:35.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:35.562048+0000) 2019-10-23T12:05:35.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:05:35.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:35.564383+0000) 2019-10-23T12:05:36.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:36.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:36.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:36.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:36.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:05:36.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:36.522041+0000) 2019-10-23T12:05:37.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:37.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:37.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:37.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:37.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:05:37.556+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:37.558257+0000) 2019-10-23T12:05:38.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:38.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:38.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:38.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:39.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:05:39.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:39.042255+0000) 2019-10-23T12:05:39.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:39.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:39.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:39.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:40.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:40.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:40.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:40.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:41.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:41.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:41.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:41.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:42.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:42.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:42.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:42.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:43.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:43.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:43.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:43.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:44.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:44.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:44.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:44.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:45.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:45.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:45.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:45.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:45.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:05:45.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:45.542532+0000) 2019-10-23T12:05:45.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:05:45.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:45.564484+0000) 2019-10-23T12:05:45.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:05:45.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:45.562165+0000) 2019-10-23T12:05:46.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:46.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:46.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:46.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:46.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:05:46.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:46.522138+0000) 2019-10-23T12:05:47.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:47.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:47.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:47.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:47.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:05:47.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:47.558380+0000) 2019-10-23T12:05:48.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:48.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:48.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:48.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:49.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:05:49.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:49.042353+0000) 2019-10-23T12:05:49.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:49.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:49.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:49.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:50.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:50.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:50.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:50.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:51.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:51.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:51.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:51.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:52.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:52.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:52.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:52.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:53.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:53.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:53.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:53.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:54.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:54.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:54.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:54.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:55.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:55.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:55.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:55.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:55.545 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:05:55.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:55.542641+0000) 2019-10-23T12:05:55.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:05:55.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:55.562280+0000) 2019-10-23T12:05:55.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:05:55.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:55.564574+0000) 2019-10-23T12:05:56.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:56.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:56.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:56.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:56.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:05:56.520+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:56.522233+0000) 2019-10-23T12:05:57.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:57.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:57.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:57.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:57.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:05:57.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:57.558497+0000) 2019-10-23T12:05:58.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:58.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:58.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:58.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:05:59.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:05:59.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:05:59.042449+0000) 2019-10-23T12:05:59.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:59.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:05:59.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:05:59.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:00.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:00.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:00.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:00.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:01.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:01.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:01.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:01.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:02.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:02.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:02.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:02.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:03.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:03.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:03.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:03.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:04.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:04.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:04.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:04.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:05.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:05.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:05.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:05.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:05.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:06:05.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:05.542758+0000) 2019-10-23T12:06:05.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:06:05.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:05.562396+0000) 2019-10-23T12:06:05.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:06:05.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:05.564667+0000) 2019-10-23T12:06:06.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:06:06.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:06.522331+0000) 2019-10-23T12:06:06.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:06.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:06.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:06.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:07.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:06:07.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:07.558610+0000) 2019-10-23T12:06:07.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:07.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:07.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:07.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:08.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:08.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:08.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:08.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:09.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:06:09.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:09.042548+0000) 2019-10-23T12:06:09.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:09.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:09.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:09.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:10.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:10.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:10.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:10.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:11.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:11.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:11.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:11.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:12.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:12.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:12.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:12.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:13.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:13.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:13.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:13.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:14.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:14.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:14.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:14.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:15.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:15.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:15.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:15.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:15.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:06:15.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:15.542873+0000) 2019-10-23T12:06:15.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:06:15.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:15.562524+0000) 2019-10-23T12:06:15.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:06:15.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:15.564759+0000) 2019-10-23T12:06:16.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:16.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:16.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:16.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:16.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:06:16.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:16.522426+0000) 2019-10-23T12:06:17.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:17.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:17.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:17.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:17.561 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:06:17.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:17.558718+0000) 2019-10-23T12:06:18.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:18.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:18.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:18.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:19.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:06:19.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:19.042642+0000) 2019-10-23T12:06:19.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:19.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:19.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:19.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:20.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:20.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:20.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:20.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:21.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:21.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:21.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:21.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:22.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:22.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:22.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:22.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:23.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:23.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:23.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:23.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:24.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:24.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:24.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:24.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:25.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:25.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:25.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:25.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:25.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:06:25.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:25.542980+0000) 2019-10-23T12:06:25.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:06:25.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:25.562641+0000) 2019-10-23T12:06:25.567 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:06:25.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:25.564854+0000) 2019-10-23T12:06:26.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:06:26.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:26.522519+0000) 2019-10-23T12:06:26.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:26.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:26.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:26.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:27.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:06:27.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:27.558827+0000) 2019-10-23T12:06:27.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:27.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:27.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:27.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:28.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:28.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:28.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:28.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:29.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:06:29.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:29.042742+0000) 2019-10-23T12:06:29.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:29.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:29.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:29.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:30.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:30.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:30.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:30.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:31.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:31.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:31.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:31.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:32.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:32.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:32.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:32.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:33.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:33.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:33.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:33.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:34.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:34.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:34.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:34.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:35.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:06:35.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:35.543091+0000) 2019-10-23T12:06:35.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:06:35.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:35.562753+0000) 2019-10-23T12:06:35.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:06:35.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:35.564950+0000) 2019-10-23T12:06:35.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:35.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:35.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:35.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:36.525 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:06:36.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:36.522608+0000) 2019-10-23T12:06:36.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:36.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:36.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:36.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:37.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:06:37.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:37.558942+0000) 2019-10-23T12:06:37.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:37.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:37.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:37.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:38.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:38.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:38.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:38.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:39.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:06:39.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:39.042836+0000) 2019-10-23T12:06:39.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:39.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:39.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:39.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:40.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:40.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:40.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:40.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:41.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:41.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:41.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:41.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:42.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:42.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:42.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:42.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:43.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:43.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:43.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:43.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:44.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:44.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:44.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:44.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:45.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:06:45.541+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:45.543211+0000) 2019-10-23T12:06:45.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:06:45.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:45.562868+0000) 2019-10-23T12:06:45.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:06:45.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:45.565047+0000) 2019-10-23T12:06:45.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:45.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:45.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:45.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:46.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:06:46.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:46.522696+0000) 2019-10-23T12:06:46.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:46.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:46.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:46.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:47.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:06:47.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:47.559052+0000) 2019-10-23T12:06:47.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:47.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:47.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:47.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:48.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:48.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:48.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:48.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:49.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:06:49.041+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:49.042936+0000) 2019-10-23T12:06:49.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:49.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:49.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:49.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:50.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:50.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:50.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:50.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:51.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:51.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:51.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:51.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:52.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:52.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:52.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:52.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:53.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:53.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:53.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:53.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:54.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:54.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:54.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:54.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:55.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:06:55.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:55.543326+0000) 2019-10-23T12:06:55.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:06:55.561+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:55.562980+0000) 2019-10-23T12:06:55.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:06:55.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:55.565143+0000) 2019-10-23T12:06:55.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:55.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:55.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:55.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:56.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:06:56.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:56.522792+0000) 2019-10-23T12:06:56.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:56.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:56.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:56.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:57.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:06:57.557+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:57.559169+0000) 2019-10-23T12:06:57.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:57.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:57.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:57.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:58.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:58.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:58.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:58.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:06:59.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:06:59.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:06:59.043035+0000) 2019-10-23T12:06:59.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:59.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:06:59.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:06:59.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:00.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:00.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:00.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:00.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:01.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:01.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:01.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:01.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:02.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:02.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:02.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:02.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:03.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:03.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:03.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:03.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:04.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:04.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:04.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:04.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:05.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:07:05.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:05.543443+0000) 2019-10-23T12:07:05.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:07:05.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:05.563063+0000) 2019-10-23T12:07:05.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:07:05.563+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:05.565240+0000) 2019-10-23T12:07:05.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:05.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:05.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:05.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:06.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:07:06.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:06.522886+0000) 2019-10-23T12:07:06.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:06.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:06.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:06.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:07.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:07:07.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:07.559281+0000) 2019-10-23T12:07:07.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:07.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:07.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:07.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:08.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:08.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:08.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:08.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:09.047 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:07:09.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:09.043133+0000) 2019-10-23T12:07:09.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:09.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:09.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:09.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:10.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:10.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:10.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:10.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:11.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:11.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:11.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:11.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:12.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:12.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:12.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:12.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:13.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:13.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:13.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:13.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:14.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:14.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:14.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:14.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:15.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:07:15.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:15.543559+0000) 2019-10-23T12:07:15.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:07:15.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:15.563175+0000) 2019-10-23T12:07:15.570 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:07:15.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:15.565338+0000) 2019-10-23T12:07:15.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:15.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:15.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:15.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:16.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:07:16.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:16.522980+0000) 2019-10-23T12:07:16.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:16.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:16.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:16.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:17.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:07:17.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:17.559394+0000) 2019-10-23T12:07:17.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:17.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:17.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:17.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:18.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:18.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:18.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:18.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:19.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:07:19.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:19.043231+0000) 2019-10-23T12:07:19.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:19.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:19.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:19.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:20.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:20.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:20.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:20.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:21.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:21.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:21.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:21.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:22.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:22.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:22.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:22.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:23.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:23.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:23.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:23.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:24.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:24.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:24.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:24.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:25.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:07:25.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:25.543679+0000) 2019-10-23T12:07:25.567 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:07:25.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:25.563288+0000) 2019-10-23T12:07:25.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:07:25.565+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:25.565432+0000) 2019-10-23T12:07:25.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:25.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:25.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:25.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:26.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:07:26.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:26.523073+0000) 2019-10-23T12:07:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:26.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:26.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:26.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:27.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:07:27.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:27.559503+0000) 2019-10-23T12:07:27.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:27.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:27.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:27.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:28.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:28.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:28.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:28.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:29.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:07:29.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:29.043325+0000) 2019-10-23T12:07:29.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:29.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:29.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:29.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:30.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:30.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:30.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:30.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:31.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:31.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:31.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:31.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:32.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:32.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:32.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:32.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:33.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:33.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:33.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:33.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:34.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:34.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:34.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:34.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:35.546 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:07:35.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:35.543798+0000) 2019-10-23T12:07:35.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:07:35.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:35.563406+0000) 2019-10-23T12:07:35.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:07:35.565+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:35.565528+0000) 2019-10-23T12:07:35.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:35.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:35.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:35.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:36.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:07:36.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:36.523169+0000) 2019-10-23T12:07:36.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:36.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:36.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:36.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:37.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:07:37.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:37.559610+0000) 2019-10-23T12:07:37.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:37.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:37.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:37.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:38.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:38.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:38.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:38.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:39.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:07:39.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:39.043424+0000) 2019-10-23T12:07:39.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:39.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:39.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:39.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:40.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:40.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:40.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:40.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:41.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:41.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:41.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:41.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:42.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:42.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:42.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:42.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:44.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:44.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:44.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:44.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:45.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:44.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:45.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:44.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:45.547 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:07:45.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:45.543911+0000) 2019-10-23T12:07:45.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:07:45.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:45.563520+0000) 2019-10-23T12:07:45.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:07:45.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:45.565626+0000) 2019-10-23T12:07:45.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:45.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:45.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:45.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:46.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:07:46.521+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:46.523266+0000) 2019-10-23T12:07:46.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:46.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:46.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:46.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:47.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:07:47.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:47.559721+0000) 2019-10-23T12:07:47.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:47.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:47.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:47.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:48.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:48.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:48.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:48.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:49.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:07:49.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:49.043525+0000) 2019-10-23T12:07:49.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:49.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:49.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:49.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:50.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:50.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:50.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:50.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:51.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:51.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:51.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:51.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:52.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:52.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:52.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:52.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:53.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:53.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:53.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:53.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:54.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:54.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:54.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:54.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:55.547 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:07:55.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:55.544027+0000) 2019-10-23T12:07:55.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:07:55.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:55.563631+0000) 2019-10-23T12:07:55.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:07:55.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:55.565722+0000) 2019-10-23T12:07:55.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:55.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:55.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:55.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:56.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:07:56.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:56.523367+0000) 2019-10-23T12:07:56.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:56.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:56.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:56.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:57.562 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:07:57.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:57.559832+0000) 2019-10-23T12:07:57.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:57.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:57.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:57.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:58.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:58.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:58.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:58.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:07:59.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:07:59.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:07:59.043619+0000) 2019-10-23T12:07:59.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:59.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:07:59.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:07:59.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:00.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:00.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:00.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:00.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:01.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:01.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:01.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:01.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:02.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:02.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:02.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:02.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:03.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:03.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:03.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:03.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:04.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:04.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:04.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:04.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:05.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:08:05.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:05.544145+0000) 2019-10-23T12:08:05.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:08:05.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:05.563750+0000) 2019-10-23T12:08:05.568 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:05.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:05.565818+0000) 2019-10-23T12:08:05.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:05.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:05.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:05.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:06.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:08:06.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:06.523457+0000) 2019-10-23T12:08:06.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:06.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:06.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:06.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:07.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:08:07.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:07.559958+0000) 2019-10-23T12:08:07.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:07.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:07.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:07.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:08.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:08.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:08.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:08.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:09.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:08:09.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:09.043715+0000) 2019-10-23T12:08:09.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:09.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:09.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:09.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:10.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:10.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:10.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:10.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:11.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:11.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:11.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:11.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:12.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:12.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:12.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:12.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:13.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:13.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:13.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:13.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:14.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:14.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:14.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:14.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:15.547 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:08:15.542+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:15.544260+0000) 2019-10-23T12:08:15.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:08:15.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:15.563868+0000) 2019-10-23T12:08:15.569 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:15.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:15.565914+0000) 2019-10-23T12:08:16.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:16.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:16.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:16.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:16.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:08:16.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:16.523553+0000) 2019-10-23T12:08:17.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:17.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:17.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:17.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:17.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:08:17.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:17.560068+0000) 2019-10-23T12:08:18.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:18.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:18.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:18.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:19.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:08:19.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:19.043807+0000) 2019-10-23T12:08:19.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:19.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:19.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:19.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:20.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:20.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:20.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:20.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:21.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:21.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:21.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:21.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:22.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:22.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:22.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:22.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:23.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:23.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:23.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:23.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:23.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:23.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:23.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:23.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:24.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:24.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:24.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:24.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:25.547 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:08:25.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:25.544376+0000) 2019-10-23T12:08:25.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:08:25.562+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:25.563987+0000) 2019-10-23T12:08:25.569 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:25.564+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:25.566011+0000) 2019-10-23T12:08:25.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:25.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:25.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:25.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:26.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:08:26.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:26.523646+0000) 2019-10-23T12:08:26.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:26.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:26.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:26.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:27.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:08:27.558+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:27.560256+0000) 2019-10-23T12:08:27.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:27.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:27.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:27.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:28.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:28.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:28.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:28.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:29.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:08:29.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:29.043902+0000) 2019-10-23T12:08:30.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:29.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:30.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:29.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:30.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:30.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:30.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:30.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:31.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:31.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:31.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:31.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:32.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:32.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:32.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:32.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:33.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:33.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:33.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:33.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:34.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:34.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:34.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:34.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:35.547 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:08:35.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:35.544567+0000) 2019-10-23T12:08:35.568 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:08:35.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:35.564099+0000) 2019-10-23T12:08:35.569 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:35.565+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:35.566112+0000) 2019-10-23T12:08:36.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:36.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:36.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:36.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:36.526 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:08:36.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:36.523741+0000) 2019-10-23T12:08:37.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:37.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:37.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:37.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:37.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:08:37.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:37.560411+0000) 2019-10-23T12:08:37.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:37.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:37.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:37.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:38.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:38.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:38.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:38.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:39.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:08:39.042+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:39.043997+0000) 2019-10-23T12:08:39.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:39.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:39.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:39.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:40.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:40.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:40.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:40.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:41.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:41.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:41.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:41.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:42.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:42.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:42.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:42.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:44.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:43.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:44.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:43.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:44.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:44.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:44.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:44.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:45.547 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:08:45.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:45.544716+0000) 2019-10-23T12:08:45.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:08:45.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:45.564214+0000) 2019-10-23T12:08:45.569 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:45.565+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:45.566249+0000) 2019-10-23T12:08:45.570 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:45.566+0000 7fc3e1e86700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:45.566862+0000) 2019-10-23T12:08:45.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:45.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:45.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:45.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:46.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:08:46.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:46.523835+0000) 2019-10-23T12:08:46.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:46.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:46.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:46.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:47.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:08:47.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:47.560520+0000) 2019-10-23T12:08:47.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:47.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:47.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:47.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:48.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:48.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:48.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:48.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:49.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:08:49.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:49.044100+0000) 2019-10-23T12:08:49.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:49.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:49.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:49.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:50.069 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:08:50.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:50.066451+0000) 2019-10-23T12:08:50.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:50.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:50.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:50.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:51.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:51.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:51.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:51.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:52.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:52.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:52.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:52.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:53.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:53.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:53.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:53.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:54.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:54.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:54.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:54.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:55.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:08:55.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:55.544839+0000) 2019-10-23T12:08:55.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:08:55.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:55.564332+0000) 2019-10-23T12:08:55.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:55.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:55.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:55.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:56.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:08:56.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:56.523929+0000) 2019-10-23T12:08:56.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:56.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:56.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:56.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:57.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:08:57.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:57.560627+0000) 2019-10-23T12:08:58.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:58.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:58.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:58.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:59.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:59.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:08:59.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:08:59.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:08:59.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:08:59.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:08:59.044196+0000) 2019-10-23T12:09:00.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:00.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:00.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:00.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:00.069 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:09:00.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:00.066545+0000) 2019-10-23T12:09:01.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:01.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:01.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:01.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:02.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:02.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:02.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:02.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:03.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:03.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:03.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:03.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:03.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:03.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:03.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:03.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:04.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:04.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:04.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:04.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:05.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:09:05.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:05.544955+0000) 2019-10-23T12:09:05.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:09:05.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:05.564448+0000) 2019-10-23T12:09:06.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:06.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:06.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:06.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:06.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:09:06.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:06.524001+0000) 2019-10-23T12:09:07.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:07.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:07.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:07.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:07.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:09:07.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:07.560741+0000) 2019-10-23T12:09:08.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:08.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:08.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:08.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:09.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:08.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:09.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:08.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:09.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:09:09.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:09.044297+0000) 2019-10-23T12:09:10.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:10.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:10.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:10.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:10.069 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:09:10.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:10.066642+0000) 2019-10-23T12:09:11.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:11.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:11.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:11.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:12.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:12.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:12.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:12.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:13.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:13.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:13.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:13.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:14.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:14.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:14.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:14.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:15.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:15.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:15.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:15.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:15.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:09:15.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:15.545074+0000) 2019-10-23T12:09:15.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:09:15.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:15.564563+0000) 2019-10-23T12:09:16.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:16.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:16.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:16.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:16.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:09:16.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:16.524099+0000) 2019-10-23T12:09:17.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:17.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:17.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:17.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:17.563 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:09:17.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:17.560848+0000) 2019-10-23T12:09:17.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:17.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:17.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:17.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:19.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:19.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:19.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:19.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:19.048 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:09:19.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:19.044404+0000) 2019-10-23T12:09:20.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:20.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:20.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:20.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:20.069 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:09:20.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:20.066734+0000) 2019-10-23T12:09:21.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:21.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:21.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:21.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:22.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:22.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:22.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:22.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:23.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:23.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:23.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:23.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:24.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:24.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:24.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:24.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:25.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:25.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:25.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:25.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:25.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:09:25.543+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:25.545189+0000) 2019-10-23T12:09:25.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:09:25.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:25.564678+0000) 2019-10-23T12:09:26.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:26.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:26.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:26.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:26.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:09:26.522+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:26.524194+0000) 2019-10-23T12:09:27.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:27.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:27.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:27.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:27.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:09:27.559+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:27.560956+0000) 2019-10-23T12:09:28.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:28.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:28.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:28.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:29.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:09:29.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:29.044504+0000) 2019-10-23T12:09:29.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:29.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:29.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:29.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:30.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:09:30.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:30.066826+0000) 2019-10-23T12:09:30.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:30.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:30.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:30.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:31.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:31.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:31.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:31.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:32.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:32.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:32.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:32.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:33.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:33.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:33.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:33.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:34.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:34.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:34.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:34.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:35.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:35.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:35.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:35.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:35.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:09:35.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:35.545306+0000) 2019-10-23T12:09:35.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:09:35.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:35.564788+0000) 2019-10-23T12:09:36.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:36.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:36.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:36.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:36.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:09:36.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:36.524292+0000) 2019-10-23T12:09:37.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:37.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:37.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:37.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:37.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:09:37.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:37.561064+0000) 2019-10-23T12:09:38.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:38.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:38.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:38.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:39.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:09:39.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:39.044609+0000) 2019-10-23T12:09:39.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:39.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:39.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:39.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:40.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:09:40.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:40.066920+0000) 2019-10-23T12:09:40.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:40.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:40.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:40.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:41.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:41.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:41.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:41.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:42.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:42.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:42.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:42.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:43.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:43.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:43.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:43.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:44.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:44.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:44.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:44.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:45.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:45.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:45.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:45.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:45.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:09:45.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:45.545421+0000) 2019-10-23T12:09:45.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:09:45.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:45.564896+0000) 2019-10-23T12:09:46.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:46.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:46.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:46.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:46.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:09:46.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:46.524387+0000) 2019-10-23T12:09:47.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:47.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:47.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:47.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:47.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:09:47.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:47.561180+0000) 2019-10-23T12:09:48.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:48.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:48.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:48.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:49.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:09:49.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:49.044719+0000) 2019-10-23T12:09:49.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:49.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:49.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:49.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:50.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:09:50.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:50.067017+0000) 2019-10-23T12:09:50.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:50.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:50.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:50.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:51.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:51.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:51.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:51.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:52.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:52.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:52.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:52.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:53.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:53.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:53.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:53.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:54.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:54.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:54.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:54.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:55.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:55.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:55.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:55.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:55.548 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:09:55.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:55.545536+0000) 2019-10-23T12:09:55.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:09:55.563+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:55.565007+0000) 2019-10-23T12:09:56.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:56.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:56.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:56.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:56.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:09:56.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:56.524478+0000) 2019-10-23T12:09:57.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:57.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:57.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:57.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:57.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:09:57.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:57.561298+0000) 2019-10-23T12:09:58.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:58.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:58.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:58.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:09:59.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:09:59.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:09:59.044816+0000) 2019-10-23T12:09:59.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:59.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:09:59.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:09:59.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:00.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:10:00.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:00.067118+0000) 2019-10-23T12:10:00.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:00.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:00.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:00.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:01.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:01.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:01.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:01.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:02.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:02.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:02.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:02.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:03.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:03.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:03.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:03.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:04.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:04.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:04.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:04.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:05.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:05.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:05.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:05.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:05.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:10:05.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:05.545651+0000) 2019-10-23T12:10:05.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:10:05.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:05.565132+0000) 2019-10-23T12:10:06.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:06.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:06.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:06.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:06.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:10:06.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:06.524575+0000) 2019-10-23T12:10:07.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:07.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:07.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:07.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:07.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:10:07.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:07.561419+0000) 2019-10-23T12:10:08.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:08.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:08.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:08.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:09.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:10:09.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:09.044911+0000) 2019-10-23T12:10:09.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:09.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:09.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:09.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:10.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:10:10.065+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:10.067216+0000) 2019-10-23T12:10:10.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:10.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:10.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:10.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:11.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:11.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:11.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:11.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:12.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:12.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:12.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:12.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:13.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:13.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:13.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:13.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:14.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:14.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:14.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:14.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:15.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:15.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:15.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:15.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:15.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:10:15.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:15.545771+0000) 2019-10-23T12:10:15.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:10:15.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:15.565251+0000) 2019-10-23T12:10:16.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:16.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:16.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:16.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:16.527 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:10:16.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:16.524675+0000) 2019-10-23T12:10:17.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:17.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:17.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:17.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:17.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:10:17.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:17.561534+0000) 2019-10-23T12:10:18.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:18.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:18.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:18.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:19.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:10:19.043+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:19.045006+0000) 2019-10-23T12:10:19.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:19.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:19.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:19.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:20.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:10:20.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:20.067296+0000) 2019-10-23T12:10:20.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:20.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:20.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:20.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:21.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:21.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:21.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:21.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:22.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:22.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:22.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:22.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:23.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:23.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:23.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:23.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:24.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:24.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:24.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:24.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:25.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:25.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:25.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:25.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:25.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:10:25.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:25.545927+0000) 2019-10-23T12:10:25.569 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:10:25.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:25.565372+0000) 2019-10-23T12:10:26.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:26.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:26.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:26.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:26.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:10:26.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:26.524807+0000) 2019-10-23T12:10:27.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:27.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:27.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:27.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:27.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:10:27.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:27.561649+0000) 2019-10-23T12:10:28.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:28.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:28.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:28.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:29.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:10:29.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:29.045106+0000) 2019-10-23T12:10:29.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:29.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:29.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:29.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:30.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:10:30.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:30.067429+0000) 2019-10-23T12:10:30.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:30.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:30.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:30.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:31.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:31.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:31.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:31.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:32.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:32.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:32.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:32.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:33.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:33.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:33.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:33.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:34.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:34.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:34.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:34.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:35.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:35.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:35.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:35.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:35.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:10:35.544+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:35.546092+0000) 2019-10-23T12:10:35.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:10:35.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:35.565486+0000) 2019-10-23T12:10:36.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:36.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:36.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:36.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:36.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:10:36.523+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:36.524938+0000) 2019-10-23T12:10:37.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:37.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:37.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:37.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:37.564 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:10:37.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:37.561753+0000) 2019-10-23T12:10:38.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:38.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:38.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:38.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:39.049 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:10:39.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:39.045203+0000) 2019-10-23T12:10:39.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:39.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:39.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:39.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:40.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:10:40.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:40.067565+0000) 2019-10-23T12:10:40.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:40.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:40.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:40.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:41.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:41.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:41.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:41.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:42.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:42.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:42.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:42.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:43.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:43.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:43.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:43.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:44.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:44.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:44.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:44.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:45.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:45.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:45.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:45.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:45.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:10:45.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:45.546206+0000) 2019-10-23T12:10:45.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:10:45.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:45.565603+0000) 2019-10-23T12:10:46.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:46.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:46.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:46.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:46.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:10:46.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:46.525036+0000) 2019-10-23T12:10:47.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:47.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:47.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:47.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:47.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:10:47.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:47.561863+0000) 2019-10-23T12:10:48.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:48.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:48.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:48.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:49.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:10:49.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:49.045301+0000) 2019-10-23T12:10:49.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:49.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:49.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:49.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:50.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:10:50.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:50.067667+0000) 2019-10-23T12:10:50.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:50.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:50.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:50.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:51.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:51.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:51.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:51.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:52.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:52.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:52.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:52.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:53.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:53.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:53.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:53.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:54.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:54.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:54.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:54.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:55.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:55.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:55.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:55.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:55.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:10:55.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:55.546324+0000) 2019-10-23T12:10:55.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:10:55.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:55.565718+0000) 2019-10-23T12:10:56.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:56.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:56.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:56.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:56.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:10:56.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:56.525136+0000) 2019-10-23T12:10:57.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:57.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:57.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:57.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:57.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:10:57.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:57.561984+0000) 2019-10-23T12:10:58.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:58.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:58.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:58.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:10:59.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:10:59.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:10:59.045394+0000) 2019-10-23T12:10:59.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:59.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:10:59.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:10:59.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:00.070 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:11:00.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:00.067762+0000) 2019-10-23T12:11:00.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:00.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:11:00.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:00.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:01.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:01.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:11:01.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:01.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:02.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:02.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:00:30.564483+0000 (oldest deadline 2019-10-23T12:00:50.564483+0000) 2019-10-23T12:11:02.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:02.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:03.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:03.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:04.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:04.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:05.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:05.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:05.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:11:05.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:05.546439+0000) 2019-10-23T12:11:05.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:11:05.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:05.565837+0000) 2019-10-23T12:11:06.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:06.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:06.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:11:06.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:06.525303+0000) 2019-10-23T12:11:07.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:07.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:07.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:11:07.560+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:07.562153+0000) 2019-10-23T12:11:08.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:08.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:09.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:11:09.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:09.045491+0000) 2019-10-23T12:11:09.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:09.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:10.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:11:10.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:10.067860+0000) 2019-10-23T12:11:10.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:10.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:11.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:11.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:12.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:12.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:13.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:13.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:14.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:14.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:15.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:11:15.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:15.546558+0000) 2019-10-23T12:11:15.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:11:15.564+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:15.565961+0000) 2019-10-23T12:11:15.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:15.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:16.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:11:16.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:16.525399+0000) 2019-10-23T12:11:16.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:16.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:17.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:11:17.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:17.562294+0000) 2019-10-23T12:11:17.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:17.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:18.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:18.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:19.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:11:19.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:19.045588+0000) 2019-10-23T12:11:19.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:19.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:20.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:11:20.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:20.067958+0000) 2019-10-23T12:11:20.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:20.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:21.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:21.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:22.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:22.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:23.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:23.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:23.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:23.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:24.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:24.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:24.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:24.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:25.549 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:11:25.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:25.546677+0000) 2019-10-23T12:11:25.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:11:25.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:25.566078+0000) 2019-10-23T12:11:25.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:25.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:25.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:25.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:26.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:11:26.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:26.525499+0000) 2019-10-23T12:11:26.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:26.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:26.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:26.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:27.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:11:27.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:27.562412+0000) 2019-10-23T12:11:27.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:27.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:27.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:27.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:28.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:28.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:28.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:28.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:29.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:11:29.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:29.045683+0000) 2019-10-23T12:11:29.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:29.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:29.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:29.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:30.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:11:30.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:30.068057+0000) 2019-10-23T12:11:30.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:30.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:30.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:30.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:31.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:31.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:31.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:31.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:32.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:32.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:32.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:32.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:33.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:33.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:33.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:33.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:34.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:34.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:34.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:34.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:35.550 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:11:35.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:35.546787+0000) 2019-10-23T12:11:35.570 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:11:35.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:35.566197+0000) 2019-10-23T12:11:35.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:35.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:35.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:35.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:36.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:11:36.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:36.525595+0000) 2019-10-23T12:11:36.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:36.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:36.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:36.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:37.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:11:37.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:37.562522+0000) 2019-10-23T12:11:37.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:37.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:37.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:37.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:38.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:38.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:38.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:38.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:39.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:11:39.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:39.045781+0000) 2019-10-23T12:11:39.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:39.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:39.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:39.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:40.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:11:40.066+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:40.068155+0000) 2019-10-23T12:11:40.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:40.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:40.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:40.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:41.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:41.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:41.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:41.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:42.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:42.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:42.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:42.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:43.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:43.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:43.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:43.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:44.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:44.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:44.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:44.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:45.550 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:11:45.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:45.546906+0000) 2019-10-23T12:11:45.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:11:45.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:45.566309+0000) 2019-10-23T12:11:45.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:45.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:45.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:45.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:46.528 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:11:46.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:46.525690+0000) 2019-10-23T12:11:46.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:46.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:46.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:46.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:47.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:11:47.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:47.562638+0000) 2019-10-23T12:11:47.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:47.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:47.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:47.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:48.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:48.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:48.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:48.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:49.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:11:49.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:49.045879+0000) 2019-10-23T12:11:49.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:49.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:49.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:49.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:50.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:11:50.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:50.068252+0000) 2019-10-23T12:11:50.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:50.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:50.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:50.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:51.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:51.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:51.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:51.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:52.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:52.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:52.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:52.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:53.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:53.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:53.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:53.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:54.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:54.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:54.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:54.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:55.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:11:55.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:55.546993+0000) 2019-10-23T12:11:55.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:11:55.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:55.566415+0000) 2019-10-23T12:11:56.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:56.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:56.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:56.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:56.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:11:56.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:56.525785+0000) 2019-10-23T12:11:57.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:57.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:57.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:57.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:57.565 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:11:57.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:57.562764+0000) 2019-10-23T12:11:58.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:58.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:58.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:58.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:59.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:59.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:59.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:59.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:11:59.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:11:59.044+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:11:59.045972+0000) 2019-10-23T12:11:59.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:59.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:11:59.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:11:59.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:00.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:12:00.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:00.068346+0000) 2019-10-23T12:12:00.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:00.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:00.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:00.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:01.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:01.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:01.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:01.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:03.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:03.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:03.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:03.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:04.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:04.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:04.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:04.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:05.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:04.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:05.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:04.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:05.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:12:05.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:05.547107+0000) 2019-10-23T12:12:05.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:12:05.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:05.566531+0000) 2019-10-23T12:12:06.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:06.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:06.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:06.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:06.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:12:06.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:06.525878+0000) 2019-10-23T12:12:06.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:06.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:06.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:06.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:07.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:12:07.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:07.562878+0000) 2019-10-23T12:12:08.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:08.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:08.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:08.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:08.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:08.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:08.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:08.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:09.050 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:12:09.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:09.046065+0000) 2019-10-23T12:12:09.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:09.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:09.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:09.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:10.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:12:10.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:10.068444+0000) 2019-10-23T12:12:10.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:10.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:10.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:10.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:11.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:11.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:11.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:11.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:13.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:13.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:13.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:13.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:14.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:14.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:14.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:14.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:14.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:14.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:14.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:14.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:15.550 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:12:15.545+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:15.547222+0000) 2019-10-23T12:12:15.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:12:15.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:15.566651+0000) 2019-10-23T12:12:16.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:16.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:16.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:16.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:16.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:12:16.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:16.525973+0000) 2019-10-23T12:12:17.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:17.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:17.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:17.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:17.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:12:17.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:17.562993+0000) 2019-10-23T12:12:18.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:18.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:18.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:18.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:19.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:12:19.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:19.046164+0000) 2019-10-23T12:12:19.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:19.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:19.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:19.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:20.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:20.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:20.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:20.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:20.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:12:20.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:20.068541+0000) 2019-10-23T12:12:21.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:21.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:21.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:21.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:22.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:22.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:22.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:22.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:23.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:23.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:23.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:23.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:24.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:24.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:24.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:24.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:25.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:25.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:25.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:25.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:25.550 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:12:25.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:25.547339+0000) 2019-10-23T12:12:25.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:12:25.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:25.566779+0000) 2019-10-23T12:12:25.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:25.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:25.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:25.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:26.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:12:26.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:26.526070+0000) 2019-10-23T12:12:27.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:27.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:27.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:27.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:27.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:12:27.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:27.563107+0000) 2019-10-23T12:12:28.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:28.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:28.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:28.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:29.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:12:29.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:29.046265+0000) 2019-10-23T12:12:29.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:29.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:29.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:29.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:30.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:12:30.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:30.068635+0000) 2019-10-23T12:12:30.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:30.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:30.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:30.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:31.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:31.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:31.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:31.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:32.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:32.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:32.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:32.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:33.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:33.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:33.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:33.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:34.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:34.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:34.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:34.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:35.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:35.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:35.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:35.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:35.550 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:12:35.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:35.547454+0000) 2019-10-23T12:12:35.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:12:35.565+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:35.566891+0000) 2019-10-23T12:12:36.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:36.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:36.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:36.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:36.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:12:36.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:36.526170+0000) 2019-10-23T12:12:37.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:37.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:37.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:37.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:37.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:12:37.561+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:37.563221+0000) 2019-10-23T12:12:38.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:38.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:38.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:38.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:39.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:12:39.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:39.046364+0000) 2019-10-23T12:12:39.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:39.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:39.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:39.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:40.071 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:12:40.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:40.068732+0000) 2019-10-23T12:12:40.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:40.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:40.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:40.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:41.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:41.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:41.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:41.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:42.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:42.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:42.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:42.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:43.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:43.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:43.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:43.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:44.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:44.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:44.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:44.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:45.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:45.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:45.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:45.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:45.550 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:12:45.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:45.547571+0000) 2019-10-23T12:12:45.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:12:45.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:45.567004+0000) 2019-10-23T12:12:46.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:46.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:46.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:46.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:46.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:12:46.524+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:46.526273+0000) 2019-10-23T12:12:47.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:47.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:47.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:47.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:47.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:12:47.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:47.563325+0000) 2019-10-23T12:12:48.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:48.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:48.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:48.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:49.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:12:49.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:49.046464+0000) 2019-10-23T12:12:49.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:49.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:49.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:49.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:50.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:12:50.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:50.068831+0000) 2019-10-23T12:12:50.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:50.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:50.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:50.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:51.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:51.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:51.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:51.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:52.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:52.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:52.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:52.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:53.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:53.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:53.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:53.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:54.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:54.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:54.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:54.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:55.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:55.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:55.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:55.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:55.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:12:55.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:55.547687+0000) 2019-10-23T12:12:55.571 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:12:55.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:55.567122+0000) 2019-10-23T12:12:56.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:56.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:56.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:56.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:56.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:12:56.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:56.526371+0000) 2019-10-23T12:12:57.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:57.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:57.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:57.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:57.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:12:57.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:57.563435+0000) 2019-10-23T12:12:58.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:58.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:58.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:58.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:12:59.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:12:59.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:12:59.046565+0000) 2019-10-23T12:12:59.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:59.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:12:59.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:12:59.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:00.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:13:00.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:00.068930+0000) 2019-10-23T12:13:00.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:00.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:00.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:00.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:01.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:01.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:01.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:01.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:02.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:02.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:02.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:02.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:03.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:03.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:03.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:03.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:04.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:04.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:04.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:04.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:05.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:05.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:05.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:05.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:05.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:13:05.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:05.547801+0000) 2019-10-23T12:13:05.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:13:05.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:05.567231+0000) 2019-10-23T12:13:06.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:06.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:06.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:06.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:06.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:13:06.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:06.526468+0000) 2019-10-23T12:13:07.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:07.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:07.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:07.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:07.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:13:07.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:07.563548+0000) 2019-10-23T12:13:08.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:08.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:08.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:08.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:09.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:09.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:09.046659+0000) 2019-10-23T12:13:09.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:09.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:09.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:09.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:10.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:13:10.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:10.069027+0000) 2019-10-23T12:13:10.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:10.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:10.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:10.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:11.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:11.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:11.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:11.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:12.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:12.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:12.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:12.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:13.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:13.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:13.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:13.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:14.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:14.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:14.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:14.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:15.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:15.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:15.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:15.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:15.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:13:15.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:15.547915+0000) 2019-10-23T12:13:15.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:13:15.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:15.567340+0000) 2019-10-23T12:13:16.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:16.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:16.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:16.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:16.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:13:16.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:16.526564+0000) 2019-10-23T12:13:17.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:17.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:17.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:17.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:17.566 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:13:17.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:17.563665+0000) 2019-10-23T12:13:18.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:18.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:18.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:18.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:19.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:19.045+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:19.046753+0000) 2019-10-23T12:13:19.051 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:19.046+0000 7f2d2215a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:19.047360+0000) 2019-10-23T12:13:19.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:19.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:19.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:19.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:20.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:13:20.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:20.069128+0000) 2019-10-23T12:13:20.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:20.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:20.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:20.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:21.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:21.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:21.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:21.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:22.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:22.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:22.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:22.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:23.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:23.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:23.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:23.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:23.551 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:23.545+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:23.546947+0000) 2019-10-23T12:13:24.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:24.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:24.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:24.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:25.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:25.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:25.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:25.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:25.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:13:25.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:25.548030+0000) 2019-10-23T12:13:25.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:13:25.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:25.567450+0000) 2019-10-23T12:13:26.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:26.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:26.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:26.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:26.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:13:26.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:26.526654+0000) 2019-10-23T12:13:27.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:27.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:27.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:27.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:27.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:13:27.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:27.563783+0000) 2019-10-23T12:13:28.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:28.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:28.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:28.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:29.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:29.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:29.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:29.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:30.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:13:30.067+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:30.069224+0000) 2019-10-23T12:13:30.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:30.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:30.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:30.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:31.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:31.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:31.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:31.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:32.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:32.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:32.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:32.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:33.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:33.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:33.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:33.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:33.551 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:33.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:33.547044+0000) 2019-10-23T12:13:34.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:34.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:34.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:34.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:35.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:35.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:35.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:35.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:35.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:13:35.546+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:35.548148+0000) 2019-10-23T12:13:35.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:13:35.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:35.567567+0000) 2019-10-23T12:13:36.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:36.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:36.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:36.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:36.529 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:13:36.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:36.526748+0000) 2019-10-23T12:13:37.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:37.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:37.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:37.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:37.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:13:37.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:37.563888+0000) 2019-10-23T12:13:38.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:38.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:38.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:38.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:39.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:39.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:39.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:39.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:40.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:13:40.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:40.069300+0000) 2019-10-23T12:13:40.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:40.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:40.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:40.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:41.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:41.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:41.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:41.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:42.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:42.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:42.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:42.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:43.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:43.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:43.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:43.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:43.551 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:43.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:43.547145+0000) 2019-10-23T12:13:44.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:44.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:44.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:44.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:45.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:45.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:45.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:45.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:45.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:13:45.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:45.548333+0000) 2019-10-23T12:13:45.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:13:45.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:45.567678+0000) 2019-10-23T12:13:46.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:46.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:46.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:46.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:46.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:13:46.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:46.526887+0000) 2019-10-23T12:13:47.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:47.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:47.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:47.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:47.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:13:47.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:47.563998+0000) 2019-10-23T12:13:48.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:48.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:48.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:48.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:49.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:49.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:49.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:49.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:50.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:13:50.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:50.069399+0000) 2019-10-23T12:13:50.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:50.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:50.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:50.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:51.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:51.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:51.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:51.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:52.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:52.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:52.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:52.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:53.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:53.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:53.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:53.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:53.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:13:53.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:53.547241+0000) 2019-10-23T12:13:54.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:54.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:54.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:54.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:55.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:55.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:55.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:55.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:55.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:13:55.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:55.548470+0000) 2019-10-23T12:13:55.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:13:55.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:55.567794+0000) 2019-10-23T12:13:56.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:56.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:56.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:56.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:56.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:13:56.525+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:56.527034+0000) 2019-10-23T12:13:57.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:57.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:57.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:57.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:57.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:13:57.562+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:13:57.564105+0000) 2019-10-23T12:13:58.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:58.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:58.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:58.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:13:59.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:59.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:13:59.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:13:59.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:00.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:14:00.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:00.069505+0000) 2019-10-23T12:14:00.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:00.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:00.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:00.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:01.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:01.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:01.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:01.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:02.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:02.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:02.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:02.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:03.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:03.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:03.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:03.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:03.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:14:03.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:03.547340+0000) 2019-10-23T12:14:04.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:04.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:04.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:04.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:05.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:05.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:05.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:05.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:05.551 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:14:05.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:05.548642+0000) 2019-10-23T12:14:05.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:14:05.566+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:05.567911+0000) 2019-10-23T12:14:06.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:06.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:06.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:06.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:06.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:14:06.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:06.527174+0000) 2019-10-23T12:14:07.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:07.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:07.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:07.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:07.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:14:07.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:07.564276+0000) 2019-10-23T12:14:08.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:08.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:08.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:08.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:09.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:09.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:09.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:09.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:10.072 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:14:10.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:10.069688+0000) 2019-10-23T12:14:10.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:10.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:10.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:10.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:11.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:11.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:11.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:11.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:12.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:12.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:12.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:12.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:13.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:13.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:13.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:13.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:13.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:14:13.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:13.547479+0000) 2019-10-23T12:14:14.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:14.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:14.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:14.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:15.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:15.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:15.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:15.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:15.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:14:15.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:15.548835+0000) 2019-10-23T12:14:15.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:14:15.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:15.568041+0000) 2019-10-23T12:14:16.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:16.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:16.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:16.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:16.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:14:16.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:16.527366+0000) 2019-10-23T12:14:17.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:17.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:17.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:17.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:17.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:14:17.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:17.564491+0000) 2019-10-23T12:14:18.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:18.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:18.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:18.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:19.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:19.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:19.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:19.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:20.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:14:20.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:20.069882+0000) 2019-10-23T12:14:20.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:20.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:20.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:20.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:21.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:21.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:21.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:21.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:22.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:22.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:22.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:22.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:23.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:23.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:23.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:23.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:23.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:14:23.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:23.547609+0000) 2019-10-23T12:14:24.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:24.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:24.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:24.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:25.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:25.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:25.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:25.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:25.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:14:25.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:25.548977+0000) 2019-10-23T12:14:25.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:14:25.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:25.568159+0000) 2019-10-23T12:14:26.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:26.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:26.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:26.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:26.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:14:26.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:26.527519+0000) 2019-10-23T12:14:27.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:27.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:27.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:27.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:27.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:14:27.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:27.564632+0000) 2019-10-23T12:14:28.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:28.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:28.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:28.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:29.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:29.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:29.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:29.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:30.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:14:30.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:30.070033+0000) 2019-10-23T12:14:30.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:30.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:30.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:30.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:31.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:31.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:31.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:31.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:32.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:32.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:32.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:32.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:33.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:33.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:33.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:33.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:33.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:14:33.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:33.547707+0000) 2019-10-23T12:14:34.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:34.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:34.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:34.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:35.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:35.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:35.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:35.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:35.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:14:35.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:35.549097+0000) 2019-10-23T12:14:35.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:14:35.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:35.568277+0000) 2019-10-23T12:14:36.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:36.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:36.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:36.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:36.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:14:36.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:36.527614+0000) 2019-10-23T12:14:37.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:37.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:37.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:37.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:37.567 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:14:37.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:37.564747+0000) 2019-10-23T12:14:38.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:38.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:38.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:38.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:39.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:39.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:39.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:39.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:40.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:14:40.068+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:40.070176+0000) 2019-10-23T12:14:40.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:40.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:40.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:40.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:41.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:41.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:41.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:41.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:42.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:42.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:42.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:42.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:43.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:43.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:43.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:43.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:43.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:14:43.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:43.547804+0000) 2019-10-23T12:14:44.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:44.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:44.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:44.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:45.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:45.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:45.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:45.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:45.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:14:45.547+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:45.549219+0000) 2019-10-23T12:14:45.572 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:14:45.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:45.568397+0000) 2019-10-23T12:14:46.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:46.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:46.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:46.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:46.530 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:14:46.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:46.527711+0000) 2019-10-23T12:14:47.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:47.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:47.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:47.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:47.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:14:47.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:47.564863+0000) 2019-10-23T12:14:48.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:48.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:48.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:48.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:49.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:49.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:49.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:49.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:50.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:14:50.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:50.070297+0000) 2019-10-23T12:14:50.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:50.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:50.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:50.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:51.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:51.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:51.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:51.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:52.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:52.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:52.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:52.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:53.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:53.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:53.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:53.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:53.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:14:53.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:53.547896+0000) 2019-10-23T12:14:54.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:54.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:54.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:54.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:55.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:55.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:55.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:55.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:55.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:14:55.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:55.549418+0000) 2019-10-23T12:14:55.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:14:55.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:55.568512+0000) 2019-10-23T12:14:56.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:56.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:56.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:56.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:56.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:14:56.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:56.527837+0000) 2019-10-23T12:14:57.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:57.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:57.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:57.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:57.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:14:57.563+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:14:57.565027+0000) 2019-10-23T12:14:58.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:58.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:58.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:58.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:14:59.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:59.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:14:59.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:14:59.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:00.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:15:00.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:00.070431+0000) 2019-10-23T12:15:00.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:00.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:00.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:00.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:01.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:01.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:02.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:02.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:02.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:02.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:03.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:03.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:03.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:03.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:03.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:15:03.546+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:03.547990+0000) 2019-10-23T12:15:04.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:04.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:04.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:04.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:05.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:05.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:05.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:05.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:05.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:15:05.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:05.549565+0000) 2019-10-23T12:15:05.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:15:05.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:05.568626+0000) 2019-10-23T12:15:06.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:06.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:06.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:06.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:06.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:15:06.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:06.527975+0000) 2019-10-23T12:15:07.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:07.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:07.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:07.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:07.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:15:07.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:07.565167+0000) 2019-10-23T12:15:08.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:08.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:08.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:08.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:09.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:09.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:09.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:09.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:10.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:15:10.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:10.070555+0000) 2019-10-23T12:15:10.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:10.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:10.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:10.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:11.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:11.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:11.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:11.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:12.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:12.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:12.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:12.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:13.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:13.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:13.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:13.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:13.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:15:13.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:13.548094+0000) 2019-10-23T12:15:14.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:14.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:14.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:14.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:15.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:15.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:15.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:15.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:15.552 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:15:15.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:15.549684+0000) 2019-10-23T12:15:15.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:15:15.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:15.568737+0000) 2019-10-23T12:15:16.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:16.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:16.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:16.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:16.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:15:16.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:16.528067+0000) 2019-10-23T12:15:17.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:17.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:17.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:17.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:17.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:15:17.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:17.565280+0000) 2019-10-23T12:15:18.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:18.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:18.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:18.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:19.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:19.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:19.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:19.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:20.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:15:20.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:20.070653+0000) 2019-10-23T12:15:20.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:20.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:20.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:20.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:21.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:21.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:21.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:21.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:22.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:22.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:22.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:22.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:23.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:23.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:23.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:23.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:23.552 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:15:23.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:23.548187+0000) 2019-10-23T12:15:24.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:24.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:24.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:24.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:25.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:25.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:25.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:25.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:25.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:15:25.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:25.549801+0000) 2019-10-23T12:15:25.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:15:25.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:25.568850+0000) 2019-10-23T12:15:26.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:26.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:26.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:26.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:26.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:15:26.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:26.528161+0000) 2019-10-23T12:15:27.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:27.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:27.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:27.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:27.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:15:27.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:27.565397+0000) 2019-10-23T12:15:28.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:28.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:28.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:28.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:29.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:29.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:29.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:29.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:30.073 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:15:30.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:30.070752+0000) 2019-10-23T12:15:30.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:30.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:30.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:30.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:31.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:31.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:31.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:31.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:32.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:32.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:32.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:32.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:33.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:33.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:33.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:33.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:33.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:15:33.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:33.548285+0000) 2019-10-23T12:15:34.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:34.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:34.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:34.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:35.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:35.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:35.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:35.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:35.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:15:35.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:35.549920+0000) 2019-10-23T12:15:35.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:15:35.567+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:35.568967+0000) 2019-10-23T12:15:36.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:36.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:36.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:36.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:36.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:15:36.526+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:36.528254+0000) 2019-10-23T12:15:37.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:37.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:37.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:37.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:37.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:15:37.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:37.565513+0000) 2019-10-23T12:15:38.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:38.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:38.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:38.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:39.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:39.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:39.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:39.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:40.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:15:40.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:40.070850+0000) 2019-10-23T12:15:40.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:40.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:40.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:40.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:41.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:41.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:41.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:41.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:42.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:42.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:42.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:42.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:43.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:15:43.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:43.548383+0000) 2019-10-23T12:15:43.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:43.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:43.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:43.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:44.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:44.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:44.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:44.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:45.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:15:45.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:45.550040+0000) 2019-10-23T12:15:45.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:15:45.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:45.569076+0000) 2019-10-23T12:15:45.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:45.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:45.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:45.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:46.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:15:46.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:46.528356+0000) 2019-10-23T12:15:46.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:46.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:46.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:46.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:47.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:15:47.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:47.565623+0000) 2019-10-23T12:15:47.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:47.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:47.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:47.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:48.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:48.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:48.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:48.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:49.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:49.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:49.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:49.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:50.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:15:50.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:50.070946+0000) 2019-10-23T12:15:50.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:50.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:50.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:50.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:51.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:51.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:51.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:51.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:52.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:52.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:52.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:52.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:53.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:15:53.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:53.548480+0000) 2019-10-23T12:15:53.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:53.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:53.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:53.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:54.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:54.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:54.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:54.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:55.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:15:55.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:55.550155+0000) 2019-10-23T12:15:55.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:15:55.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:55.569185+0000) 2019-10-23T12:15:55.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:55.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:55.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:55.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:56.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:15:56.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:56.528452+0000) 2019-10-23T12:15:56.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:56.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:56.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:56.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:57.568 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:15:57.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:15:57.565733+0000) 2019-10-23T12:15:57.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:57.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:57.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:57.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:58.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:58.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:58.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:58.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:15:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:59.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:15:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:15:59.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:00.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:16:00.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:00.071043+0000) 2019-10-23T12:16:00.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:00.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:00.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:00.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:01.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:01.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:01.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:01.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:02.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:02.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:02.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:02.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:03.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:16:03.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:03.548580+0000) 2019-10-23T12:16:03.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:03.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:03.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:03.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:04.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:04.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:04.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:04.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:05.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:16:05.548+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:05.550269+0000) 2019-10-23T12:16:05.573 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:16:05.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:05.569300+0000) 2019-10-23T12:16:05.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:05.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:05.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:05.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:06.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:16:06.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:06.528545+0000) 2019-10-23T12:16:06.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:06.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:06.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:06.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:07.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:16:07.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:07.565841+0000) 2019-10-23T12:16:07.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:07.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:07.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:07.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:08.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:08.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:08.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:08.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:09.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:09.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:09.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:09.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:10.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:16:10.069+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:10.071141+0000) 2019-10-23T12:16:10.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:10.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:10.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:10.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:11.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:11.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:11.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:11.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:12.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:12.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:12.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:12.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:13.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:16:13.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:13.548679+0000) 2019-10-23T12:16:13.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:13.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:13.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:13.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:14.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:14.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:14.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:14.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:15.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:16:15.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:15.550392+0000) 2019-10-23T12:16:15.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:16:15.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:15.569420+0000) 2019-10-23T12:16:15.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:15.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:15.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:15.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:16.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:16:16.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:16.528643+0000) 2019-10-23T12:16:16.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:16.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:16.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:16.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:17.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:16:17.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:17.565955+0000) 2019-10-23T12:16:17.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:17.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:17.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:17.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:18.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:18.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:18.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:18.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:19.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:19.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:19.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:19.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:20.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:16:20.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:20.071238+0000) 2019-10-23T12:16:20.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:20.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:20.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:20.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:21.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:21.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:21.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:21.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:22.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:22.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:22.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:22.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:23.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:16:23.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:23.548769+0000) 2019-10-23T12:16:23.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:23.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:23.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:23.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:24.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:24.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:24.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:24.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:25.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:16:25.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:25.550510+0000) 2019-10-23T12:16:25.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:16:25.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:25.569536+0000) 2019-10-23T12:16:25.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:25.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:25.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:25.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:26.531 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:16:26.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:26.528738+0000) 2019-10-23T12:16:26.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:26.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:26.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:26.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:27.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:16:27.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:27.566071+0000) 2019-10-23T12:16:27.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:27.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:27.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:27.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:28.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:28.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:28.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:28.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:29.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:29.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:29.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:29.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:30.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:16:30.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:30.071298+0000) 2019-10-23T12:16:30.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:30.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:30.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:30.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:31.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:31.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:31.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:31.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:32.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:32.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:32.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:32.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:33.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:16:33.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:33.548860+0000) 2019-10-23T12:16:33.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:33.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:33.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:33.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:34.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:34.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:34.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:34.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:35.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:16:35.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:35.550629+0000) 2019-10-23T12:16:35.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:16:35.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:35.569648+0000) 2019-10-23T12:16:35.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:35.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:35.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:35.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:36.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:16:36.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:36.528833+0000) 2019-10-23T12:16:36.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:36.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:36.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:36.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:37.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:16:37.564+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:37.566185+0000) 2019-10-23T12:16:37.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:37.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:37.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:37.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:38.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:38.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:38.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:38.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:39.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:39.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:39.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:39.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:40.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:16:40.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:40.071391+0000) 2019-10-23T12:16:40.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:40.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:40.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:40.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:41.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:41.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:41.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:41.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:43.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:43.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:43.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:43.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:43.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:16:43.547+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:43.548952+0000) 2019-10-23T12:16:44.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:44.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:44.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:44.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:45.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:45.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:45.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:45.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:45.553 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:16:45.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:45.550746+0000) 2019-10-23T12:16:45.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:16:45.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:45.569766+0000) 2019-10-23T12:16:46.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:46.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:46.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:46.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:46.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:16:46.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:46.528930+0000) 2019-10-23T12:16:47.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:47.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:47.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:47.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:47.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:16:47.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:47.566299+0000) 2019-10-23T12:16:48.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:48.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:48.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:48.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:49.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:49.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:49.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:49.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:50.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:16:50.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:50.071485+0000) 2019-10-23T12:16:50.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:50.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:50.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:50.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:51.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:51.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:51.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:51.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:52.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:52.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:52.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:52.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:53.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:53.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:53.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:53.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:53.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:16:53.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:53.549042+0000) 2019-10-23T12:16:54.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:54.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:54.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:54.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:55.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:55.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:55.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:55.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:55.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:16:55.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:55.550868+0000) 2019-10-23T12:16:55.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:16:55.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:55.569883+0000) 2019-10-23T12:16:56.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:56.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:56.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:56.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:56.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:16:56.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:56.529028+0000) 2019-10-23T12:16:57.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:57.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:57.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:57.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:57.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:16:57.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:16:57.566413+0000) 2019-10-23T12:16:58.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:58.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:58.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:58.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:16:59.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:59.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:16:59.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:16:59.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:00.074 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:17:00.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:00.071581+0000) 2019-10-23T12:17:00.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:00.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:00.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:00.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:01.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:01.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:01.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:01.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:02.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:02.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:02.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:02.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:03.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:03.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:03.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:03.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:03.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:17:03.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:03.549134+0000) 2019-10-23T12:17:04.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:04.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:04.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:04.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:05.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:05.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:05.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:05.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:05.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:17:05.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:05.550984+0000) 2019-10-23T12:17:05.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:17:05.568+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:05.569999+0000) 2019-10-23T12:17:06.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:06.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:06.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:06.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:06.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:17:06.527+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:06.529124+0000) 2019-10-23T12:17:07.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:07.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:07.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:07.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:07.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:17:07.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:07.566526+0000) 2019-10-23T12:17:08.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:08.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:08.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:08.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:09.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:09.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:09.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:09.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:10.088 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:17:10.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:10.071679+0000) 2019-10-23T12:17:10.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:10.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:10.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:10.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:11.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:11.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:11.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:11.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:12.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:12.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:12.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:12.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:13.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:13.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:13.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:13.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:13.553 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:17:13.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:13.549226+0000) 2019-10-23T12:17:14.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:14.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:14.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:14.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:15.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:15.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:15.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:15.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:15.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:17:15.549+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:15.551101+0000) 2019-10-23T12:17:15.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:17:15.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:15.570115+0000) 2019-10-23T12:17:16.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:16.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:16.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:16.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:16.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:17:16.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:16.529220+0000) 2019-10-23T12:17:17.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:17.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:17.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:17.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:17.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:17:17.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:17.566641+0000) 2019-10-23T12:17:18.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:18.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:18.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:18.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:19.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:19.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:19.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:19.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:20.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:17:20.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:20.071784+0000) 2019-10-23T12:17:20.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:20.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:20.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:20.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:21.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:21.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:21.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:21.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:22.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:22.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:22.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:22.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:23.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:23.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:23.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:23.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:23.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:17:23.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:23.549321+0000) 2019-10-23T12:17:24.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:24.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:24.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:24.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:25.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:25.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:25.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:25.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:25.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:17:25.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:25.551220+0000) 2019-10-23T12:17:25.574 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:17:25.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:25.570245+0000) 2019-10-23T12:17:26.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:26.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:26.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:26.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:26.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:17:26.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:26.529339+0000) 2019-10-23T12:17:27.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:27.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:27.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:27.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:27.569 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:17:27.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:27.566757+0000) 2019-10-23T12:17:28.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:28.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:28.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:28.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:29.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:29.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:29.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:29.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:30.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:17:30.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:30.071897+0000) 2019-10-23T12:17:30.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:30.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:30.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:30.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:31.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:31.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:31.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:31.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:32.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:32.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:32.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:32.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:33.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:33.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:33.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:33.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:33.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:17:33.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:33.549412+0000) 2019-10-23T12:17:34.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:34.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:34.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:34.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:35.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:35.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:35.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:35.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:35.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:17:35.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:35.551326+0000) 2019-10-23T12:17:35.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:17:35.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:35.570361+0000) 2019-10-23T12:17:36.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:36.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:36.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:36.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:36.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:17:36.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:36.529485+0000) 2019-10-23T12:17:37.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:37.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:37.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:37.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:37.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:17:37.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:37.566866+0000) 2019-10-23T12:17:38.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:38.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:38.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:38.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:39.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:39.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:39.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:39.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:40.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:17:40.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:40.071995+0000) 2019-10-23T12:17:40.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:40.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:40.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:40.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:41.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:41.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:41.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:41.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:42.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:42.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:42.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:42.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:43.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:43.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:43.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:43.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:43.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:17:43.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:43.549502+0000) 2019-10-23T12:17:44.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:44.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:44.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:44.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:45.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:45.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:45.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:45.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:45.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:17:45.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:45.551442+0000) 2019-10-23T12:17:45.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:17:45.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:45.570476+0000) 2019-10-23T12:17:46.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:46.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:46.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:46.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:46.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:17:46.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:46.529579+0000) 2019-10-23T12:17:47.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:47.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:47.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:47.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:47.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:17:47.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:47.566969+0000) 2019-10-23T12:17:48.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:48.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:48.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:48.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:49.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:49.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:49.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:49.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:50.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:17:50.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:50.072094+0000) 2019-10-23T12:17:50.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:50.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:50.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:50.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:51.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:51.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:51.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:51.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:52.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:52.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:52.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:52.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:53.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:53.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:53.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:53.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:53.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:17:53.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:53.549595+0000) 2019-10-23T12:17:54.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:54.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:54.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:54.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:55.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:55.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:55.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:55.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:55.554 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:17:55.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:55.551561+0000) 2019-10-23T12:17:55.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:17:55.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:55.570588+0000) 2019-10-23T12:17:56.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:56.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:56.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:56.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:56.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:17:56.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:56.529671+0000) 2019-10-23T12:17:57.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:57.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:57.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:57.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:57.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:17:57.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:17:57.567074+0000) 2019-10-23T12:17:58.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:58.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:58.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:58.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:17:59.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:59.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:17:59.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:17:59.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:00.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:18:00.070+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:00.072192+0000) 2019-10-23T12:18:00.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:00.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:00.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:00.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:01.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:01.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:01.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:01.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:02.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:02.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:02.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:02.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:03.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:03.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:03.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:03.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:03.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:18:03.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:03.549691+0000) 2019-10-23T12:18:04.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:04.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:04.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:04.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:05.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:05.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:05.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:05.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:05.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:18:05.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:05.551675+0000) 2019-10-23T12:18:05.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:18:05.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:05.570704+0000) 2019-10-23T12:18:06.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:06.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:06.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:06.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:06.532 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:18:06.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:06.529764+0000) 2019-10-23T12:18:07.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:07.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:07.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:07.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:07.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:18:07.565+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:07.567184+0000) 2019-10-23T12:18:08.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:08.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:08.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:08.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:09.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:09.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:09.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:09.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:10.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:18:10.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:10.072289+0000) 2019-10-23T12:18:10.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:10.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:10.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:10.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:11.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:11.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:11.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:11.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:12.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:12.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:12.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:12.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:13.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:18:13.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:13.549785+0000) 2019-10-23T12:18:13.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:13.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:13.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:13.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:14.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:14.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:14.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:14.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:15.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:18:15.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:15.551793+0000) 2019-10-23T12:18:15.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:18:15.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:15.570829+0000) 2019-10-23T12:18:15.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:15.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:15.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:15.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:16.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:18:16.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:16.529861+0000) 2019-10-23T12:18:16.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:16.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:16.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:16.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:17.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:18:17.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:17.567304+0000) 2019-10-23T12:18:17.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:17.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:17.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:17.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:18.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:18.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:18.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:18.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:19.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:19.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:19.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:19.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:20.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:18:20.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:20.072384+0000) 2019-10-23T12:18:20.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:20.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:20.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:20.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:21.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:21.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:21.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:22.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:22.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:22.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:22.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:23.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:18:23.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:23.549875+0000) 2019-10-23T12:18:23.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:23.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:23.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:23.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:24.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:24.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:24.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:24.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:25.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:18:25.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:25.551909+0000) 2019-10-23T12:18:25.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:18:25.569+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:25.570939+0000) 2019-10-23T12:18:25.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:25.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:25.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:25.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:26.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:18:26.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:26.529962+0000) 2019-10-23T12:18:26.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:26.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:26.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:26.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:27.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:18:27.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:27.567414+0000) 2019-10-23T12:18:27.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:27.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:27.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:27.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:28.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:28.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:28.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:28.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:29.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:29.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:29.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:29.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:30.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:18:30.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:30.072479+0000) 2019-10-23T12:18:30.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:30.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:30.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:30.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:31.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:31.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:31.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:31.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:32.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:32.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:32.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:32.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:33.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:18:33.548+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:33.549967+0000) 2019-10-23T12:18:33.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:33.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:33.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:33.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:34.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:34.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:34.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:34.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:35.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:18:35.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:35.552022+0000) 2019-10-23T12:18:35.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:18:35.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:35.571068+0000) 2019-10-23T12:18:35.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:35.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:35.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:35.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:36.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:18:36.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:36.530062+0000) 2019-10-23T12:18:36.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:36.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:36.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:36.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:37.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:18:37.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:37.567519+0000) 2019-10-23T12:18:37.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:37.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:37.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:37.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:38.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:38.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:38.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:38.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:39.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:39.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:39.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:39.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:40.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:18:40.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:40.072576+0000) 2019-10-23T12:18:40.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:40.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:40.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:40.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:41.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:41.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:42.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:42.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:42.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:42.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:43.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:18:43.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:43.550063+0000) 2019-10-23T12:18:43.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:43.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:43.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:43.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:44.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:44.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:44.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:44.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:45.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:18:45.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:45.552136+0000) 2019-10-23T12:18:45.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:45.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:45.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:45.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:45.575 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:18:45.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:45.571185+0000) 2019-10-23T12:18:46.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:18:46.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:46.530162+0000) 2019-10-23T12:18:46.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:46.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:46.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:46.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:47.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:18:47.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:47.567627+0000) 2019-10-23T12:18:47.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:47.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:47.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:47.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:48.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:48.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:48.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:48.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:49.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:49.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:49.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:49.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:50.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:18:50.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:50.072673+0000) 2019-10-23T12:18:50.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:50.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:50.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:50.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:51.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:51.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:51.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:51.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:52.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:52.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:52.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:52.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:53.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:18:53.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:53.550156+0000) 2019-10-23T12:18:53.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:53.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:53.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:53.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:54.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:54.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:54.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:54.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:55.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:18:55.550+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:55.552248+0000) 2019-10-23T12:18:55.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:18:55.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:55.571299+0000) 2019-10-23T12:18:55.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:55.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:55.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:55.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:56.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:18:56.528+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:56.530259+0000) 2019-10-23T12:18:56.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:56.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:56.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:56.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:57.570 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:18:57.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:18:57.567740+0000) 2019-10-23T12:18:57.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:57.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:57.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:57.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:58.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:58.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:58.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:58.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:18:59.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:59.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:18:59.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:18:59.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:00.075 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:19:00.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:00.072771+0000) 2019-10-23T12:19:00.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:00.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:00.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:00.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:01.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:01.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:01.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:01.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:02.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:02.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:02.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:02.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:03.554 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:19:03.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:03.550250+0000) 2019-10-23T12:19:03.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:03.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:03.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:03.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:04.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:04.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:04.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:04.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:05.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:19:05.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:05.552324+0000) 2019-10-23T12:19:05.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:19:05.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:05.571427+0000) 2019-10-23T12:19:05.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:05.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:05.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:05.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:06.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:19:06.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:06.530354+0000) 2019-10-23T12:19:06.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:06.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:06.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:06.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:07.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:19:07.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:07.567851+0000) 2019-10-23T12:19:07.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:07.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:07.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:07.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:08.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:08.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:08.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:08.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:09.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:09.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:09.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:09.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:10.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:19:10.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:10.072867+0000) 2019-10-23T12:19:10.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:10.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:10.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:10.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:11.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:11.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:11.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:11.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:12.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:12.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:12.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:12.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:13.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:19:13.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:13.550350+0000) 2019-10-23T12:19:13.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:13.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:13.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:13.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:14.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:14.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:14.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:14.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:15.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:19:15.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:15.552444+0000) 2019-10-23T12:19:15.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:19:15.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:15.571544+0000) 2019-10-23T12:19:15.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:15.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:15.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:15.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:16.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:19:16.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:16.530454+0000) 2019-10-23T12:19:16.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:16.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:16.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:16.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:17.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:19:17.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:17.567963+0000) 2019-10-23T12:19:17.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:17.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:17.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:17.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:18.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:18.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:18.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:18.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:19.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:19.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:19.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:19.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:20.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:19:20.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:20.072964+0000) 2019-10-23T12:19:20.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:20.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:20.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:20.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:21.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:21.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:21.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:21.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:22.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:22.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:22.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:22.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:23.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:19:23.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:23.550441+0000) 2019-10-23T12:19:23.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:23.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:23.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:23.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:24.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:24.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:24.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:24.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:25.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:19:25.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:25.552559+0000) 2019-10-23T12:19:25.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:19:25.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:25.571656+0000) 2019-10-23T12:19:25.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:25.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:25.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:25.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:26.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:19:26.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:26.530573+0000) 2019-10-23T12:19:26.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:26.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:26.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:26.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:27.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:19:27.566+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:27.568073+0000) 2019-10-23T12:19:27.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:27.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:27.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:27.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:28.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:28.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:28.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:28.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:29.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:29.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:29.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:29.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:30.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:19:30.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:30.073061+0000) 2019-10-23T12:19:30.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:30.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:30.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:30.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:31.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:31.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:31.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:31.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:32.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:32.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:32.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:32.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:33.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:33.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:33.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:33.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:33.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:19:33.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:33.550539+0000) 2019-10-23T12:19:34.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:34.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:34.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:34.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:35.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:35.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:35.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:35.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:35.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:19:35.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:35.552671+0000) 2019-10-23T12:19:35.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:19:35.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:35.571768+0000) 2019-10-23T12:19:36.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:36.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:36.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:36.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:36.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:19:36.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:36.530682+0000) 2019-10-23T12:19:37.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:37.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:37.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:37.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:37.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:19:37.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:37.568178+0000) 2019-10-23T12:19:38.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:38.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:38.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:38.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:39.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:39.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:39.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:39.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:40.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:19:40.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:40.073156+0000) 2019-10-23T12:19:40.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:40.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:40.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:40.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:41.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:41.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:41.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:41.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:42.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:42.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:42.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:42.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:43.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:43.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:43.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:43.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:43.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:19:43.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:43.550635+0000) 2019-10-23T12:19:44.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:44.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:44.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:44.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:45.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:45.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:45.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:45.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:45.555 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:19:45.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:45.552784+0000) 2019-10-23T12:19:45.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:19:45.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:45.571889+0000) 2019-10-23T12:19:46.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:46.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:46.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:46.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:46.533 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:19:46.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:46.530793+0000) 2019-10-23T12:19:47.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:47.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:47.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:47.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:47.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:19:47.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:47.568288+0000) 2019-10-23T12:19:48.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:48.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:48.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:48.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:49.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:49.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:49.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:49.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:50.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:19:50.071+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:50.073252+0000) 2019-10-23T12:19:50.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:50.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:50.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:50.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:51.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:51.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:51.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:51.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:52.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:52.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:52.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:52.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:53.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:53.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:53.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:53.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:53.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:19:53.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:53.550728+0000) 2019-10-23T12:19:54.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:54.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:54.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:54.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:55.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:55.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:55.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:55.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:55.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:19:55.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:55.552900+0000) 2019-10-23T12:19:55.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:19:55.570+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:55.572003+0000) 2019-10-23T12:19:56.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:56.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:56.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:56.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:56.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:19:56.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:56.530898+0000) 2019-10-23T12:19:57.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:57.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:57.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:57.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:57.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:19:57.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:19:57.568395+0000) 2019-10-23T12:19:58.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:58.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:58.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:58.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:19:59.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:59.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:19:59.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:19:59.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:00.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:20:00.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:00.073348+0000) 2019-10-23T12:20:00.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:00.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:00.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:00.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:01.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:01.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:01.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:01.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:02.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:02.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:02.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:02.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:03.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:03.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:03.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:03.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:03.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:20:03.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:03.550823+0000) 2019-10-23T12:20:04.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:04.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:04.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:04.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:05.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:05.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:05.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:05.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:05.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:20:05.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:05.553014+0000) 2019-10-23T12:20:05.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:20:05.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:05.572121+0000) 2019-10-23T12:20:06.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:06.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:06.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:06.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:06.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:20:06.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:06.531007+0000) 2019-10-23T12:20:07.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:07.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:07.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:07.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:07.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:20:07.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:07.568505+0000) 2019-10-23T12:20:08.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:08.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:08.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:08.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:09.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:09.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:09.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:09.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:10.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:20:10.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:10.073447+0000) 2019-10-23T12:20:10.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:10.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:10.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:10.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:11.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:11.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:11.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:11.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:12.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:12.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:12.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:12.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:13.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:13.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:13.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:13.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:13.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:20:13.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:13.550918+0000) 2019-10-23T12:20:14.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:14.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:14.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:14.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:15.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:15.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:15.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:15.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:15.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:20:15.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:15.553138+0000) 2019-10-23T12:20:15.576 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:20:15.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:15.572238+0000) 2019-10-23T12:20:16.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:16.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:16.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:16.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:16.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:20:16.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:16.531116+0000) 2019-10-23T12:20:17.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:17.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:17.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:17.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:17.571 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:20:17.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:17.568616+0000) 2019-10-23T12:20:18.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:18.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:18.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:18.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:19.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:19.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:19.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:19.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:20.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:20:20.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:20.073540+0000) 2019-10-23T12:20:20.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:20.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:20.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:20.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:21.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:21.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:21.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:21.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:22.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:22.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:22.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:22.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:23.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:23.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:23.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:23.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:23.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:20:23.549+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:23.551011+0000) 2019-10-23T12:20:24.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:24.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:24.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:24.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:25.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:25.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:25.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:25.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:25.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:20:25.551+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:25.553249+0000) 2019-10-23T12:20:25.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:20:25.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:25.572354+0000) 2019-10-23T12:20:26.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:26.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:26.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:26.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:26.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:20:26.529+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:26.531224+0000) 2019-10-23T12:20:27.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:27.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:27.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:27.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:27.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:20:27.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:27.568722+0000) 2019-10-23T12:20:28.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:28.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:28.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:28.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:29.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:29.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:29.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:29.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:30.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:20:30.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:30.073636+0000) 2019-10-23T12:20:30.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:30.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:30.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:30.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:31.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:31.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:31.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:31.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:32.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:32.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:32.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:32.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:33.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:33.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:33.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:33.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:33.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:20:33.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:33.551110+0000) 2019-10-23T12:20:34.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:34.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:34.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:34.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:35.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:35.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:35.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:35.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:35.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:20:35.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:35.553322+0000) 2019-10-23T12:20:35.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:20:35.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:35.572470+0000) 2019-10-23T12:20:36.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:36.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:36.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:36.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:36.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:20:36.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:36.531326+0000) 2019-10-23T12:20:37.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:37.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:37.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:37.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:37.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:20:37.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:37.568830+0000) 2019-10-23T12:20:38.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:38.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:38.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:38.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:39.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:39.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:39.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:39.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:40.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:20:40.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:40.073738+0000) 2019-10-23T12:20:40.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:40.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:40.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:40.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:41.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:41.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:41.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:41.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:42.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:42.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:42.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:42.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:43.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:43.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:43.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:43.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:43.555 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:20:43.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:43.551203+0000) 2019-10-23T12:20:44.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:44.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:44.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:44.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:45.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:45.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:45.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:45.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:45.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:20:45.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:45.553442+0000) 2019-10-23T12:20:45.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:20:45.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:45.572586+0000) 2019-10-23T12:20:46.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:46.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:46.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:46.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:46.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:20:46.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:46.531436+0000) 2019-10-23T12:20:47.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:47.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:47.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:47.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:47.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:20:47.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:47.568938+0000) 2019-10-23T12:20:48.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:48.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:48.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:48.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:49.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:49.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:49.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:49.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:50.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:50.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:50.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:50.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:50.076 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:20:50.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:50.073831+0000) 2019-10-23T12:20:51.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:51.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:51.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:51.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:52.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:52.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:52.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:52.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:53.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:53.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:53.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:53.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:53.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:20:53.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:53.551301+0000) 2019-10-23T12:20:54.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:54.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:54.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:54.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:55.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:55.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:55.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:55.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:55.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:20:55.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:55.553560+0000) 2019-10-23T12:20:55.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:20:55.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:55.572709+0000) 2019-10-23T12:20:56.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:56.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:56.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:56.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:56.534 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:20:56.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:56.531550+0000) 2019-10-23T12:20:57.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:57.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:57.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:57.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:57.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:20:57.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:20:57.569047+0000) 2019-10-23T12:20:58.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:58.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:58.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:58.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:20:59.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:59.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:20:59.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:20:59.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:00.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:21:00.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:00.073924+0000) 2019-10-23T12:21:00.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:00.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:00.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:00.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:01.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:01.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:01.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:01.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:02.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:02.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:02.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:02.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:03.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:03.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:03.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:03.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:03.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:21:03.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:03.551399+0000) 2019-10-23T12:21:04.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:04.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:04.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:04.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:05.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:05.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:05.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:05.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:05.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:21:05.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:05.553677+0000) 2019-10-23T12:21:05.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:21:05.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:05.572823+0000) 2019-10-23T12:21:06.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:06.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:06.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:06.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:06.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:21:06.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:06.531668+0000) 2019-10-23T12:21:07.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:07.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:07.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:07.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:07.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:21:07.567+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:07.569170+0000) 2019-10-23T12:21:08.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:08.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:08.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:08.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:09.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:09.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:09.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:09.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:10.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:21:10.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:10.074022+0000) 2019-10-23T12:21:10.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:10.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:10.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:10.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:11.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:11.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:11.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:11.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:12.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:12.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:12.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:12.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:13.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:13.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:13.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:13.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:13.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:21:13.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:13.551495+0000) 2019-10-23T12:21:14.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:14.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:14.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:14.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:15.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:15.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:15.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:15.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:15.556 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:21:15.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:15.553801+0000) 2019-10-23T12:21:15.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:21:15.571+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:15.572934+0000) 2019-10-23T12:21:16.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:16.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:16.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:16.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:16.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:21:16.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:16.531784+0000) 2019-10-23T12:21:17.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:17.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:17.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:17.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:17.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:21:17.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:17.569345+0000) 2019-10-23T12:21:18.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:18.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:18.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:18.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:19.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:19.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:19.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:19.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:20.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:21:20.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:20.074119+0000) 2019-10-23T12:21:20.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:20.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:20.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:20.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:21.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:21.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:21.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:21.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:22.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:22.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:22.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:22.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:23.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:23.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:23.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:23.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:23.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:21:23.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:23.551588+0000) 2019-10-23T12:21:24.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:24.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:24.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:24.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:25.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:25.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:25.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:25.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:25.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:21:25.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:25.553917+0000) 2019-10-23T12:21:25.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:21:25.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:25.573049+0000) 2019-10-23T12:21:26.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:26.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:26.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:26.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:26.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:21:26.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:26.531896+0000) 2019-10-23T12:21:27.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:27.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:27.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:27.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:27.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:21:27.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:27.569497+0000) 2019-10-23T12:21:28.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:28.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:28.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:28.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:29.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:29.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:29.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:29.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:30.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:21:30.072+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:30.074219+0000) 2019-10-23T12:21:30.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:30.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:30.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:30.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:31.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:31.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:31.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:31.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:32.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:32.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:32.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:32.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:33.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:33.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:33.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:33.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:33.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:21:33.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:33.551684+0000) 2019-10-23T12:21:34.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:34.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:34.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:34.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:35.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:35.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:35.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:35.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:35.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:21:35.552+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:35.554033+0000) 2019-10-23T12:21:35.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:21:35.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:35.573165+0000) 2019-10-23T12:21:36.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:36.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:36.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:36.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:36.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:21:36.530+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:36.532008+0000) 2019-10-23T12:21:37.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:37.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:37.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:37.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:37.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:21:37.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:37.569606+0000) 2019-10-23T12:21:38.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:38.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:11:02.991459+0000 (oldest deadline 2019-10-23T12:11:22.991459+0000) 2019-10-23T12:21:38.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:38.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:39.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:39.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:40.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:21:40.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:40.074297+0000) 2019-10-23T12:21:40.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:40.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:41.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:41.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:42.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:42.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:43.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:43.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:43.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:21:43.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:43.551778+0000) 2019-10-23T12:21:44.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:44.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:45.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:45.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:45.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:21:45.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:45.554213+0000) 2019-10-23T12:21:45.577 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:21:45.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:45.573278+0000) 2019-10-23T12:21:46.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:46.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:46.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:21:46.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:46.532117+0000) 2019-10-23T12:21:47.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:47.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:47.572 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:21:47.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:47.569716+0000) 2019-10-23T12:21:48.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:48.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:49.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:49.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:50.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:50.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:50.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:21:50.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:50.074393+0000) 2019-10-23T12:21:51.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:51.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:52.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:52.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:53.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:53.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:53.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:21:53.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:53.551874+0000) 2019-10-23T12:21:54.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:54.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:55.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:55.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:55.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:21:55.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:55.554325+0000) 2019-10-23T12:21:55.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:21:55.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:55.573390+0000) 2019-10-23T12:21:56.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:56.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:56.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:21:56.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:56.532232+0000) 2019-10-23T12:21:57.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:57.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:57.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:21:57.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:21:57.569824+0000) 2019-10-23T12:21:58.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:58.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:21:59.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:21:59.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:00.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:22:00.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:00.074492+0000) 2019-10-23T12:22:00.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:00.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:00.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:00.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:01.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:01.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:01.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:01.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:02.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:02.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:02.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:02.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:03.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:03.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:03.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:03.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:03.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:22:03.550+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:03.551971+0000) 2019-10-23T12:22:04.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:04.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:04.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:04.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:05.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:05.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:05.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:05.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:05.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:22:05.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:05.554444+0000) 2019-10-23T12:22:05.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:22:05.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:05.573505+0000) 2019-10-23T12:22:06.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:06.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:06.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:06.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:06.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:22:06.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:06.532349+0000) 2019-10-23T12:22:07.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:07.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:07.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:07.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:07.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:22:07.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:07.569933+0000) 2019-10-23T12:22:08.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:08.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:08.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:08.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:09.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:09.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:09.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:09.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:10.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:22:10.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:10.074593+0000) 2019-10-23T12:22:10.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:10.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:10.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:10.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:11.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:11.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:11.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:11.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:12.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:12.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:12.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:12.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:13.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:13.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:13.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:13.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:13.556 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:22:13.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:13.552063+0000) 2019-10-23T12:22:14.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:14.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:14.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:14.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:15.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:15.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:15.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:15.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:15.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:22:15.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:15.554565+0000) 2019-10-23T12:22:15.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:22:15.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:15.573615+0000) 2019-10-23T12:22:16.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:16.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:16.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:16.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:16.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:22:16.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:16.532469+0000) 2019-10-23T12:22:17.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:17.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:17.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:17.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:17.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:22:17.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:17.570056+0000) 2019-10-23T12:22:18.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:18.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:18.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:18.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 120 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:19.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:19.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:19.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:19.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:20.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:22:20.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:20.074690+0000) 2019-10-23T12:22:20.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:20.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:20.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:20.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:21.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:21.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:21.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:21.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:22.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:22.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:22.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:22.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:23.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:23.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:23.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:23.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:23.560 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:22:23.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:23.552156+0000) 2019-10-23T12:22:24.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:24.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:24.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:24.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:25.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:25.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:25.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:25.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:25.557 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:22:25.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:25.554682+0000) 2019-10-23T12:22:25.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:22:25.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:25.573725+0000) 2019-10-23T12:22:26.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:26.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:26.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:26.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:26.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:22:26.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:26.532582+0000) 2019-10-23T12:22:27.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:27.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:27.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:27.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:27.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:22:27.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:27.570168+0000) 2019-10-23T12:22:28.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:28.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:28.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:28.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:29.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:29.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:29.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:29.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:30.077 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:22:30.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:30.074786+0000) 2019-10-23T12:22:30.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:30.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:30.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:30.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:31.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:31.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:31.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:31.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:32.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:32.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:32.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:32.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:33.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:33.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:33.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:33.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:33.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:22:33.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:33.552251+0000) 2019-10-23T12:22:34.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:34.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:34.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:34.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:35.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:35.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:35.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:35.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:35.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:22:35.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:35.554800+0000) 2019-10-23T12:22:35.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:22:35.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:35.573837+0000) 2019-10-23T12:22:36.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:36.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:36.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:36.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:36.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:22:36.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:36.532691+0000) 2019-10-23T12:22:37.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:37.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:37.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:37.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:37.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:22:37.568+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:37.570273+0000) 2019-10-23T12:22:38.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:38.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:38.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:38.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:39.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:39.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:39.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:39.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:40.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:22:40.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:40.074882+0000) 2019-10-23T12:22:40.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:40.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:40.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:40.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:41.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:41.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:41.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:41.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:42.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:42.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:42.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:42.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:43.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:43.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:43.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:43.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:43.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:22:43.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:43.552348+0000) 2019-10-23T12:22:44.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:44.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:44.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:44.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:45.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:45.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:45.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:45.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:45.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:22:45.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:45.554916+0000) 2019-10-23T12:22:45.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:22:45.572+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:45.573952+0000) 2019-10-23T12:22:46.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:46.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:46.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:46.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:46.535 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:22:46.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:46.532803+0000) 2019-10-23T12:22:47.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:47.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:47.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:47.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:47.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:22:47.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:47.570383+0000) 2019-10-23T12:22:48.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:48.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:48.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:48.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:49.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:49.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:49.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:49.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:50.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:22:50.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:50.074980+0000) 2019-10-23T12:22:50.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:50.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:50.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:50.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:51.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:51.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:51.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:51.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:52.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:52.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:52.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:52.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:53.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:53.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:53.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:53.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:53.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:22:53.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:53.552437+0000) 2019-10-23T12:22:54.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:54.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:54.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:54.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:55.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:55.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:55.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:55.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:55.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:22:55.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:55.555032+0000) 2019-10-23T12:22:55.578 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:22:55.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:55.574060+0000) 2019-10-23T12:22:56.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:56.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:56.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:56.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:56.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:22:56.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:56.532915+0000) 2019-10-23T12:22:57.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:57.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:57.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:57.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:57.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:22:57.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:22:57.570494+0000) 2019-10-23T12:22:58.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:58.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:58.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:58.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:22:59.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:59.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:22:59.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:22:59.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:00.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:00.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:00.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:00.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:00.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:23:00.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:00.075083+0000) 2019-10-23T12:23:01.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:01.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:01.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:01.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:02.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:02.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:02.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:02.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:03.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:03.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:03.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:03.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:03.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:23:03.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:03.552532+0000) 2019-10-23T12:23:04.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:04.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:04.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:04.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:05.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:05.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:05.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:05.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:05.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:23:05.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:05.555146+0000) 2019-10-23T12:23:05.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:23:05.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:05.574166+0000) 2019-10-23T12:23:05.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:05.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:05.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:05.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:06.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:23:06.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:06.533029+0000) 2019-10-23T12:23:07.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:07.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:07.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:07.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:07.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:23:07.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:07.570609+0000) 2019-10-23T12:23:07.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:07.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:07.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:07.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:09.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:09.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:09.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:09.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:10.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:10.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:10.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:10.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:10.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:23:10.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:10.075172+0000) 2019-10-23T12:23:11.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:11.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:11.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:11.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:12.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:12.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:12.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:12.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:13.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:13.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:13.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:13.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:13.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:23:13.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:13.552629+0000) 2019-10-23T12:23:14.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:14.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:14.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:14.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:14.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:14.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:14.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:14.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:15.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:23:15.553+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:15.555263+0000) 2019-10-23T12:23:15.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:23:15.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:15.574277+0000) 2019-10-23T12:23:15.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:15.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:15.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:15.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:16.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:23:16.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:16.533143+0000) 2019-10-23T12:23:16.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:16.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:16.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:16.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:17.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:23:17.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:17.570722+0000) 2019-10-23T12:23:17.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:17.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:17.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:17.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:18.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:18.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:18.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:18.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:19.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:19.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:19.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:19.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:20.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:23:20.073+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:20.075269+0000) 2019-10-23T12:23:20.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:20.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:20.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:20.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:21.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:21.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:21.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:21.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:22.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:22.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:22.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:22.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:23.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:23:23.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:23.552724+0000) 2019-10-23T12:23:23.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:23.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:23.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:23.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:24.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:24.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:24.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:24.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:25.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:23:25.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:25.555383+0000) 2019-10-23T12:23:25.585 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:23:25.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:25.574391+0000) 2019-10-23T12:23:25.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:25.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:25.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:25.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:26.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:23:26.531+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:26.533257+0000) 2019-10-23T12:23:26.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:26.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:26.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:26.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:27.573 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:23:27.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:27.570826+0000) 2019-10-23T12:23:27.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:27.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:27.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:27.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:28.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:28.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:28.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:28.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:29.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:29.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:29.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:29.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:30.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:23:30.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:30.075375+0000) 2019-10-23T12:23:30.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:30.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:30.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:30.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:31.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:31.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:31.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:31.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:32.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:32.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:32.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:32.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:33.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:23:33.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:33.552818+0000) 2019-10-23T12:23:33.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:33.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:33.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:33.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:34.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:34.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:34.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:34.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:35.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:23:35.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:35.555497+0000) 2019-10-23T12:23:35.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:23:35.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:35.574505+0000) 2019-10-23T12:23:35.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:35.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:35.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:35.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:36.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:23:36.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:36.533326+0000) 2019-10-23T12:23:36.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:36.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:36.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:36.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:37.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:23:37.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:37.570934+0000) 2019-10-23T12:23:37.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:37.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:37.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:37.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:38.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:38.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:38.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:38.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:39.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:39.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:39.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:39.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:40.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:23:40.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:40.075472+0000) 2019-10-23T12:23:40.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:40.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:40.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:40.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:41.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:41.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:41.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:41.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:42.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:42.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:42.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:42.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:43.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:23:43.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:43.552913+0000) 2019-10-23T12:23:43.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:43.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:43.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:43.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:44.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:44.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:44.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:44.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:45.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:23:45.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:45.555619+0000) 2019-10-23T12:23:45.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:23:45.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:45.574617+0000) 2019-10-23T12:23:45.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:45.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:45.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:45.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:46.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:23:46.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:46.533448+0000) 2019-10-23T12:23:46.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:46.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:46.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:46.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:47.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:23:47.569+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:47.571047+0000) 2019-10-23T12:23:47.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:47.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:47.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:47.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:48.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:48.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:48.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:48.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:49.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:49.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:49.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:49.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:50.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:23:50.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:50.075565+0000) 2019-10-23T12:23:50.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:50.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:50.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:50.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:51.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:51.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:51.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:51.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:52.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:52.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:52.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:52.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:53.557 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:23:53.551+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:53.553008+0000) 2019-10-23T12:23:53.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:53.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:53.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:53.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:54.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:54.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:54.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:54.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:55.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:23:55.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:55.555738+0000) 2019-10-23T12:23:55.581 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:23:55.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:55.574734+0000) 2019-10-23T12:23:55.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:55.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:55.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:55.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:56.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:23:56.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:56.533569+0000) 2019-10-23T12:23:56.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:56.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:56.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:56.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:57.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:23:57.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:23:57.571157+0000) 2019-10-23T12:23:57.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:57.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:57.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:57.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:58.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:58.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:58.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:58.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:23:59.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:59.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:23:59.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:23:59.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:00.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:24:00.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:00.075656+0000) 2019-10-23T12:24:00.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:00.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:00.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:00.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:01.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:01.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:01.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:01.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:02.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:02.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:02.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:02.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:03.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:24:03.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:03.553108+0000) 2019-10-23T12:24:03.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:03.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:03.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:03.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:04.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:04.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:04.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:04.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:05.558 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:24:05.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:05.555857+0000) 2019-10-23T12:24:05.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:05.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:05.574848+0000) 2019-10-23T12:24:05.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:05.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:05.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:05.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:06.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:24:06.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:06.533689+0000) 2019-10-23T12:24:06.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:06.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:06.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:06.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:07.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:24:07.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:07.571261+0000) 2019-10-23T12:24:07.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:07.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:07.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:07.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:08.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:08.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:08.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:08.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:09.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:09.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:09.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:09.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:10.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:24:10.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:10.075750+0000) 2019-10-23T12:24:10.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:10.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:10.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:10.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:11.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:11.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:11.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:11.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:12.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:12.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:12.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:12.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:13.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:24:13.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:13.553199+0000) 2019-10-23T12:24:13.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:13.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:13.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:13.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:14.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:14.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:14.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:14.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:15.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:24:15.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:15.555971+0000) 2019-10-23T12:24:15.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:15.573+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:15.574963+0000) 2019-10-23T12:24:15.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:15.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:15.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:15.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:16.536 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:24:16.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:16.533807+0000) 2019-10-23T12:24:16.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:16.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:16.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:16.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:17.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:24:17.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:17.571372+0000) 2019-10-23T12:24:17.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:17.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:17.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:17.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:18.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:18.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:18.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:18.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:19.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:19.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:19.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:19.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:20.078 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:24:20.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:20.075846+0000) 2019-10-23T12:24:20.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:20.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:20.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:20.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:21.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:21.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:21.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:21.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:22.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:22.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:22.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:22.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:23.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:24:23.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:23.553296+0000) 2019-10-23T12:24:23.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:23.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:23.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:23.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:24.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:24.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:24.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:24.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:25.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:24:25.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:25.556088+0000) 2019-10-23T12:24:25.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:25.574+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:25.575080+0000) 2019-10-23T12:24:25.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:25.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:25.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:25.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:26.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:24:26.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:26.533922+0000) 2019-10-23T12:24:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:26.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:26.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:27.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:24:27.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:27.571484+0000) 2019-10-23T12:24:27.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:27.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:27.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:27.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:28.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:28.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:28.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:28.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:29.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:29.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:29.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:29.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:30.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:24:30.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:30.075940+0000) 2019-10-23T12:24:30.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:30.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:30.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:30.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:31.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:31.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:31.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:31.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:32.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:32.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:32.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:32.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:33.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:24:33.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:33.553389+0000) 2019-10-23T12:24:33.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:33.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:33.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:33.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:34.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:34.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:34.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:34.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:35.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:24:35.554+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:35.556205+0000) 2019-10-23T12:24:35.579 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:35.574+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:35.575201+0000) 2019-10-23T12:24:35.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:35.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:35.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:35.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:36.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:24:36.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:36.534035+0000) 2019-10-23T12:24:36.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:36.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:36.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:36.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:37.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:24:37.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:37.571596+0000) 2019-10-23T12:24:37.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:37.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:37.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:37.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:38.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:38.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:38.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:38.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:39.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:39.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:39.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:39.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:40.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:24:40.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:40.076034+0000) 2019-10-23T12:24:40.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:40.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:40.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:40.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:41.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:41.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:41.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:41.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:42.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:42.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:42.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:42.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:43.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:24:43.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:43.553485+0000) 2019-10-23T12:24:43.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:43.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:43.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:43.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:44.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:44.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:44.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:44.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:45.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:24:45.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:45.556322+0000) 2019-10-23T12:24:45.580 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:45.574+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:45.575325+0000) 2019-10-23T12:24:45.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:45.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:45.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:45.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:46.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:24:46.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:46.534146+0000) 2019-10-23T12:24:46.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:46.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:46.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:46.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:47.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:24:47.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:47.571707+0000) 2019-10-23T12:24:47.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:47.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:47.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:47.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:48.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:48.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:48.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:48.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:49.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:49.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:49.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:49.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:50.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:24:50.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:50.076123+0000) 2019-10-23T12:24:50.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:50.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:50.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:50.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:51.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:51.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:51.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:51.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:52.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:52.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:52.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:52.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:53.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:24:53.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:53.553578+0000) 2019-10-23T12:24:53.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:53.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:53.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:53.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:54.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:54.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:54.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:54.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:55.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:24:55.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:55.556437+0000) 2019-10-23T12:24:55.580 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:55.574+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:55.575436+0000) 2019-10-23T12:24:55.580 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:24:55.575+0000 7f4b5bf0a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:55.576090+0000) 2019-10-23T12:24:55.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:55.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:55.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:55.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:56.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:24:56.532+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:56.534258+0000) 2019-10-23T12:24:56.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:56.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:56.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:56.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:57.574 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:24:57.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:24:57.571823+0000) 2019-10-23T12:24:57.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:57.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:57.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:57.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:58.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:58.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:58.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:58.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:24:59.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:59.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:24:59.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:24:59.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:00.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:25:00.074+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:00.076217+0000) 2019-10-23T12:25:00.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:25:00.074+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:00.075617+0000) 2019-10-23T12:25:00.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:00.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:00.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:00.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:01.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:01.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:01.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:01.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:02.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:02.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:02.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:02.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:03.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:25:03.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:03.553673+0000) 2019-10-23T12:25:03.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:03.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:03.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:03.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:04.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:04.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:04.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:04.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:05.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:25:05.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:05.556548+0000) 2019-10-23T12:25:05.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:05.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:05.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:05.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:06.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:25:06.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:06.534364+0000) 2019-10-23T12:25:06.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:06.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:06.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:06.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:07.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:25:07.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:07.571931+0000) 2019-10-23T12:25:07.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:07.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:07.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:07.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:08.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:08.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:08.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:08.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:09.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:09.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:09.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:09.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:10.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:25:10.074+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:10.075716+0000) 2019-10-23T12:25:10.085 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:25:10.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:10.076297+0000) 2019-10-23T12:25:10.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:10.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:10.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:10.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:11.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:11.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:11.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:11.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:12.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:12.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:12.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:12.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:13.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:25:13.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:13.553765+0000) 2019-10-23T12:25:13.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:13.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:13.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:13.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:14.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:14.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:14.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:14.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:15.559 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:25:15.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:15.556667+0000) 2019-10-23T12:25:15.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:15.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:15.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:15.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:16.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:25:16.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:16.534476+0000) 2019-10-23T12:25:16.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:16.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:16.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:16.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:17.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:25:17.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:17.572040+0000) 2019-10-23T12:25:18.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:17.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:18.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:17.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:19.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:19.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:19.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:19.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:20.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:20.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:20.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:20.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:20.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:25:20.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:20.076395+0000) 2019-10-23T12:25:20.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:25:20.074+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:20.075814+0000) 2019-10-23T12:25:21.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:21.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:21.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:21.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:22.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:22.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:22.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:22.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:23.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:23.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:23.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:23.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:23.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:25:23.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:23.553862+0000) 2019-10-23T12:25:24.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:24.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:24.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:24.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:25.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:25.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:25.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:25.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:25.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:25:25.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:25.556780+0000) 2019-10-23T12:25:26.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:26.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:26.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:26.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:26.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:25:26.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:26.534596+0000) 2019-10-23T12:25:27.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:27.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:27.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:27.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:27.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:25:27.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:27.572151+0000) 2019-10-23T12:25:28.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:28.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:28.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:28.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:29.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:29.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:29.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:29.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:30.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:30.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:30.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:30.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:30.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:25:30.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:30.076485+0000) 2019-10-23T12:25:30.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:25:30.074+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:30.075914+0000) 2019-10-23T12:25:31.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:31.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:31.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:31.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:32.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:32.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:32.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:32.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:33.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:33.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:33.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:33.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:33.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:25:33.552+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:33.553954+0000) 2019-10-23T12:25:34.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:34.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:34.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:34.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:35.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:35.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:35.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:35.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:35.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:25:35.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:35.556893+0000) 2019-10-23T12:25:36.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:36.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:36.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:36.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:36.537 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:25:36.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:36.534715+0000) 2019-10-23T12:25:37.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:37.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:37.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:37.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:37.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:25:37.570+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:37.572263+0000) 2019-10-23T12:25:38.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:38.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:38.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:38.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:38.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:38.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:38.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:38.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:39.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:39.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:39.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:39.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:40.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:25:40.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:40.076581+0000) 2019-10-23T12:25:40.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:25:40.074+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:40.076009+0000) 2019-10-23T12:25:40.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:40.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:40.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:40.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:41.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:41.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:41.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:41.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:42.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:42.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:42.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:42.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:43.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:25:43.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:43.554054+0000) 2019-10-23T12:25:43.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:43.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:43.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:43.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:44.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:44.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:44.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:44.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:45.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:25:45.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:45.557007+0000) 2019-10-23T12:25:45.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:45.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:45.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:45.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:46.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:25:46.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:46.534833+0000) 2019-10-23T12:25:46.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:46.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:46.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:46.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:47.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:25:47.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:47.572373+0000) 2019-10-23T12:25:47.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:47.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:47.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:47.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:48.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:48.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:48.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:48.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:49.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:49.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:49.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:49.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:50.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:25:50.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:50.076678+0000) 2019-10-23T12:25:50.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:25:50.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:50.076111+0000) 2019-10-23T12:25:50.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:50.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:50.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:50.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:51.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:51.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:51.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:51.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:52.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:52.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:52.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:52.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:53.558 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:25:53.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:53.554150+0000) 2019-10-23T12:25:53.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:53.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:53.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:53.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:54.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:54.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:54.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:54.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:55.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:25:55.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:55.557119+0000) 2019-10-23T12:25:55.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:55.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:55.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:55.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:56.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:25:56.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:56.534949+0000) 2019-10-23T12:25:56.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:56.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:56.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:56.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:57.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:25:57.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:25:57.572484+0000) 2019-10-23T12:25:57.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:57.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:57.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:57.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:58.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:58.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:58.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:58.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:25:59.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:59.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:25:59.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:25:59.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:00.079 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:26:00.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:00.076776+0000) 2019-10-23T12:26:00.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:26:00.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:00.076208+0000) 2019-10-23T12:26:00.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:00.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:00.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:00.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:01.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:01.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:01.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:01.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:02.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:02.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:02.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:02.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:03.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:03.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:03.554241+0000) 2019-10-23T12:26:03.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:03.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:03.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:03.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:04.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:04.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:04.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:04.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:05.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:26:05.555+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:05.557226+0000) 2019-10-23T12:26:05.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:05.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:05.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:05.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:06.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:26:06.533+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:06.535064+0000) 2019-10-23T12:26:06.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:06.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:06.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:06.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:07.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:26:07.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:07.572609+0000) 2019-10-23T12:26:07.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:07.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:07.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:07.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:08.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:08.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:08.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:08.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:09.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:09.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:09.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:09.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:10.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:26:10.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:10.076873+0000) 2019-10-23T12:26:10.080 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:26:10.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:10.076301+0000) 2019-10-23T12:26:10.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:10.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:10.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:10.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:11.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:11.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:11.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:11.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:12.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:12.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:12.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:12.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:13.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:13.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:13.554338+0000) 2019-10-23T12:26:13.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:13.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:13.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:13.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:14.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:14.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:14.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:14.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:15.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:26:15.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:15.557341+0000) 2019-10-23T12:26:15.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:15.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:15.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:15.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:16.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:26:16.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:16.535174+0000) 2019-10-23T12:26:16.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:16.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:16.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:16.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:17.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:26:17.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:17.572726+0000) 2019-10-23T12:26:17.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:17.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:17.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:17.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:18.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:18.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:18.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:18.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:19.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:19.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:19.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:19.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:20.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:26:20.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:20.076970+0000) 2019-10-23T12:26:20.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:26:20.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:20.076398+0000) 2019-10-23T12:26:20.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:20.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:20.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:20.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:21.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:21.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:21.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:21.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:22.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:22.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:22.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:22.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:23.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:23.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:23.554429+0000) 2019-10-23T12:26:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:23.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:23.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:24.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:24.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:24.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:24.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:25.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:26:25.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:25.557455+0000) 2019-10-23T12:26:25.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:25.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:25.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:25.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:26.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:26:26.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:26.535288+0000) 2019-10-23T12:26:26.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:26.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:26.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:26.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:27.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:27.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:27.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:27.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:27.575 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:26:27.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:27.572834+0000) 2019-10-23T12:26:28.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:28.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:28.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:28.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:29.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:29.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:29.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:29.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:30.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:26:30.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:30.077059+0000) 2019-10-23T12:26:30.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:26:30.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:30.076492+0000) 2019-10-23T12:26:30.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:30.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:30.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:30.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:31.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:31.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:31.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:31.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:32.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:32.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:32.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:32.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:33.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:33.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:33.554527+0000) 2019-10-23T12:26:33.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:33.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:33.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:33.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:34.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:34.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:34.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:34.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:35.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:26:35.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:35.557566+0000) 2019-10-23T12:26:35.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:35.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:35.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:35.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:36.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:26:36.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:36.535406+0000) 2019-10-23T12:26:36.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:36.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:36.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:36.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:37.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:26:37.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:37.572940+0000) 2019-10-23T12:26:37.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:37.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:37.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:37.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:38.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:38.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:38.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:38.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:39.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:39.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:39.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:39.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:40.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:26:40.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:40.077152+0000) 2019-10-23T12:26:40.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:26:40.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:40.076585+0000) 2019-10-23T12:26:40.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:40.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:40.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:40.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:41.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:41.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:41.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:41.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:42.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:42.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:42.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:42.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:43.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:43.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:43.554624+0000) 2019-10-23T12:26:43.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:43.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:43.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:43.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:44.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:44.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:44.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:44.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:45.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:26:45.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:45.557685+0000) 2019-10-23T12:26:45.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:45.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:45.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:45.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:46.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:26:46.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:46.535519+0000) 2019-10-23T12:26:46.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:46.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:46.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:46.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:47.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:26:47.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:47.573050+0000) 2019-10-23T12:26:47.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:47.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:47.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:47.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:48.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:48.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:48.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:48.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:49.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:49.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:49.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:49.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:50.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:26:50.075+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:50.077248+0000) 2019-10-23T12:26:50.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:26:50.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:50.076679+0000) 2019-10-23T12:26:50.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:50.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:50.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:50.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:51.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:51.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:51.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:51.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:52.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:52.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:52.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:52.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:53.559 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:53.553+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:53.554714+0000) 2019-10-23T12:26:53.560 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:53.554+0000 7f2d2215a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:53.555336+0000) 2019-10-23T12:26:53.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:53.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:53.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:53.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:54.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:54.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:54.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:54.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:55.560 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:26:55.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:55.557807+0000) 2019-10-23T12:26:55.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:55.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:55.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:55.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:56.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:26:56.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:56.535645+0000) 2019-10-23T12:26:56.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:56.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:56.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:56.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:57.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:26:57.571+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:57.573162+0000) 2019-10-23T12:26:57.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:57.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:57.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:57.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:58.059 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:26:58.053+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:26:58.054903+0000) 2019-10-23T12:26:58.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:58.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:58.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:58.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:26:59.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:59.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:26:59.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:26:59.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:00.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:27:00.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:00.077343+0000) 2019-10-23T12:27:00.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:27:00.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:00.076776+0000) 2019-10-23T12:27:00.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:00.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:00.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:00.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:01.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:01.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:01.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:01.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:02.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:02.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:02.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:02.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:03.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:03.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:03.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:03.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:04.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:04.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:04.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:04.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:05.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:27:05.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:05.557922+0000) 2019-10-23T12:27:05.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:05.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:05.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:05.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:06.538 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:27:06.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:06.535758+0000) 2019-10-23T12:27:06.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:06.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:06.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:06.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:07.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:27:07.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:07.573278+0000) 2019-10-23T12:27:07.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:07.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:07.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:07.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:08.059 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:27:08.053+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:08.055001+0000) 2019-10-23T12:27:08.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:08.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:08.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:08.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:09.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:09.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:09.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:09.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:10.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:27:10.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:10.077433+0000) 2019-10-23T12:27:10.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:27:10.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:10.076872+0000) 2019-10-23T12:27:10.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:10.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:10.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:10.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:11.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:11.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:11.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:11.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:12.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:12.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:12.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:12.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:13.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:13.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:13.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:13.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:14.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:14.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:14.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:14.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:15.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:15.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:15.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:15.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:15.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:27:15.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:15.558043+0000) 2019-10-23T12:27:16.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:27:16.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:16.535874+0000) 2019-10-23T12:27:16.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:16.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:16.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:16.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:17.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:17.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:17.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:17.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:17.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:27:17.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:17.573405+0000) 2019-10-23T12:27:18.059 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:27:18.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:18.055103+0000) 2019-10-23T12:27:18.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:18.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:18.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:18.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:19.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:19.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:19.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:19.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:20.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:27:20.077+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:20.077528+0000) 2019-10-23T12:27:20.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:27:20.075+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:20.076970+0000) 2019-10-23T12:27:20.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:20.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:20.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:20.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:21.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:21.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:21.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:21.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:22.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:22.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:22.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:22.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:23.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:23.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:23.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:23.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:24.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:24.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:24.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:24.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:25.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:27:25.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:25.558159+0000) 2019-10-23T12:27:25.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:25.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:25.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:25.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:26.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:27:26.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:26.535990+0000) 2019-10-23T12:27:26.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:26.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:26.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:26.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:27.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:27:27.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:27.573517+0000) 2019-10-23T12:27:27.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:27.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:27.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:27.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:28.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:27:28.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:28.055202+0000) 2019-10-23T12:27:28.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:28.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:28.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:28.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:29.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:29.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:29.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:29.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:30.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:27:30.077+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:30.077627+0000) 2019-10-23T12:27:30.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:27:30.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:30.077064+0000) 2019-10-23T12:27:30.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:30.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:30.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:30.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:31.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:31.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:31.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:31.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:32.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:32.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:32.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:32.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:33.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:33.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:33.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:33.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:34.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:34.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:34.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:34.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:35.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:27:35.556+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:35.558272+0000) 2019-10-23T12:27:35.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:35.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:35.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:35.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:36.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:27:36.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:36.536099+0000) 2019-10-23T12:27:36.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:36.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:36.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:36.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:37.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:27:37.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:37.573628+0000) 2019-10-23T12:27:37.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:37.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:37.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:37.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:38.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:27:38.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:38.055300+0000) 2019-10-23T12:27:38.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:38.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:38.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:38.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:39.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:39.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:39.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:39.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:40.080 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:27:40.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:40.077723+0000) 2019-10-23T12:27:40.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:27:40.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:40.077161+0000) 2019-10-23T12:27:40.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:40.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:40.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:40.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:41.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:41.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:41.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:41.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:42.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:42.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:42.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:42.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:43.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:43.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:43.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:43.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:44.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:44.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:44.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:44.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:45.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:27:45.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:45.558384+0000) 2019-10-23T12:27:45.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:45.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:45.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:45.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:46.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:27:46.534+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:46.536205+0000) 2019-10-23T12:27:46.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:46.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:46.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:46.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:47.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:27:47.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:47.573732+0000) 2019-10-23T12:27:47.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:47.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:47.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:47.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:48.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:27:48.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:48.055397+0000) 2019-10-23T12:27:48.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:48.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:48.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:48.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:49.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:49.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:49.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:49.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:50.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:27:50.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:50.077818+0000) 2019-10-23T12:27:50.081 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:27:50.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:50.077261+0000) 2019-10-23T12:27:50.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:50.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:50.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:50.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:51.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:51.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:51.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:51.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:52.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:52.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:52.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:52.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:53.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:53.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:53.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:53.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:54.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:54.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:54.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:54.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:55.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:27:55.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:55.558492+0000) 2019-10-23T12:27:55.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:55.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:55.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:55.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:56.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:27:56.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:56.536322+0000) 2019-10-23T12:27:56.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:56.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:56.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:56.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:57.576 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:27:57.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:57.573841+0000) 2019-10-23T12:27:57.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:57.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:57.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:57.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:58.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:27:58.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:27:58.055495+0000) 2019-10-23T12:27:58.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:58.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:58.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:58.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:27:59.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:59.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:27:59.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:27:59.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:00.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:28:00.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:00.077915+0000) 2019-10-23T12:28:00.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:28:00.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:00.077359+0000) 2019-10-23T12:28:00.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:00.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:00.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:00.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:01.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:01.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:01.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:01.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:02.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:02.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:02.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:02.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:03.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:03.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:03.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:03.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:04.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:04.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:04.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:04.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:05.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:28:05.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:05.558609+0000) 2019-10-23T12:28:05.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:05.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:05.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:05.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:06.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:28:06.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:06.536445+0000) 2019-10-23T12:28:06.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:06.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:06.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:06.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:07.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:28:07.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:07.573954+0000) 2019-10-23T12:28:07.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:07.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:07.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:07.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:08.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:28:08.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:08.055592+0000) 2019-10-23T12:28:08.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:08.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:08.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:08.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:09.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:09.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:09.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:09.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:10.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:28:10.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:10.078016+0000) 2019-10-23T12:28:10.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:28:10.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:10.077459+0000) 2019-10-23T12:28:10.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:10.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:10.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:10.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:11.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:11.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:11.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:11.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:12.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:12.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:12.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:12.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:13.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:13.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:13.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:13.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:14.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:14.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:14.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:14.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:15.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:28:15.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:15.558721+0000) 2019-10-23T12:28:15.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:15.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:15.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:15.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:16.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:28:16.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:16.536561+0000) 2019-10-23T12:28:16.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:16.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:16.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:16.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:17.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:28:17.572+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:17.574070+0000) 2019-10-23T12:28:17.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:17.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:17.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:17.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:18.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:28:18.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:18.055689+0000) 2019-10-23T12:28:18.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:18.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:18.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:18.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:19.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:19.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:19.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:19.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:20.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:28:20.076+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:20.078116+0000) 2019-10-23T12:28:20.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:28:20.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:20.077557+0000) 2019-10-23T12:28:20.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:20.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:20.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:20.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:21.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:21.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:21.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:21.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:22.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:22.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:22.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:22.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:23.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:23.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:23.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:23.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:24.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:24.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:24.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:24.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:25.561 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:28:25.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:25.558837+0000) 2019-10-23T12:28:25.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:25.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:25.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:25.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:26.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:28:26.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:26.536669+0000) 2019-10-23T12:28:26.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:26.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:26.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:26.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:27.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:28:27.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:27.574255+0000) 2019-10-23T12:28:27.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:27.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:27.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:27.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:28.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:28:28.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:28.055787+0000) 2019-10-23T12:28:28.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:28.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:28.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:28.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:29.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:29.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:29.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:29.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:30.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:28:30.077+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:30.078210+0000) 2019-10-23T12:28:30.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:28:30.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:30.077655+0000) 2019-10-23T12:28:30.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:30.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:30.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:30.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:31.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:31.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:31.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:31.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:32.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:32.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:32.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:32.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:33.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:33.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:33.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:33.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:34.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:34.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:34.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:34.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:35.562 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:28:35.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:35.558946+0000) 2019-10-23T12:28:35.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:35.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:35.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:35.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:36.539 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:28:36.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:36.536782+0000) 2019-10-23T12:28:36.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:36.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:36.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:36.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:37.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:28:37.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:37.574407+0000) 2019-10-23T12:28:37.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:37.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:37.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:37.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:38.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:28:38.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:38.055886+0000) 2019-10-23T12:28:38.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:38.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:38.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:38.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:39.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:39.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:39.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:39.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:40.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:28:40.078+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:40.078307+0000) 2019-10-23T12:28:40.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:28:40.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:40.077754+0000) 2019-10-23T12:28:40.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:40.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:40.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:40.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:41.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:41.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:41.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:41.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:42.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:42.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:42.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:42.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:43.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:43.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:43.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:43.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:44.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:44.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:44.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:44.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:45.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:28:45.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:45.559051+0000) 2019-10-23T12:28:45.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:45.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:45.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:45.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:46.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:28:46.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:46.536889+0000) 2019-10-23T12:28:46.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:46.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:46.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:46.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:47.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:28:47.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:47.574513+0000) 2019-10-23T12:28:47.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:47.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:47.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:47.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:48.060 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:28:48.054+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:48.055984+0000) 2019-10-23T12:28:48.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:48.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:48.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:48.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:49.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:49.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:49.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:49.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:50.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:28:50.077+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:50.078405+0000) 2019-10-23T12:28:50.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:28:50.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:50.077854+0000) 2019-10-23T12:28:50.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:50.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:50.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:50.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:51.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:51.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:51.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:51.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:52.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:52.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:52.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:52.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:53.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:53.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:53.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:53.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:54.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:54.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:54.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:54.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:55.562 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:28:55.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:55.559158+0000) 2019-10-23T12:28:55.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:55.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:55.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:55.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:56.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:28:56.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:56.536996+0000) 2019-10-23T12:28:56.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:56.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:56.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:56.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:57.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:28:57.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:57.574624+0000) 2019-10-23T12:28:57.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:57.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:57.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:57.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:58.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:28:58.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:28:58.056080+0000) 2019-10-23T12:28:58.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:58.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:58.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:58.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:28:59.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:59.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:28:59.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:28:59.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:00.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:00.077+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:00.078499+0000) 2019-10-23T12:29:00.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:29:00.076+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:00.077953+0000) 2019-10-23T12:29:00.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:00.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:00.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:00.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:01.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:01.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:01.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:01.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:02.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:02.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:02.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:02.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:03.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:03.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:03.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:03.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:04.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:04.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:04.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:04.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:05.562 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:29:05.557+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:05.559274+0000) 2019-10-23T12:29:05.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:05.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:05.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:05.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:06.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:29:06.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:06.537106+0000) 2019-10-23T12:29:06.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:06.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:06.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:06.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:07.577 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:29:07.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:07.574731+0000) 2019-10-23T12:29:07.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:07.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:07.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:07.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:08.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:29:08.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:08.056178+0000) 2019-10-23T12:29:08.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:08.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:08.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:08.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:09.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:09.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:09.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:09.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:10.081 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:10.077+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:10.078590+0000) 2019-10-23T12:29:10.082 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:10.077+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:10.079260+0000) 2019-10-23T12:29:10.082 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:29:10.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:10.078042+0000) 2019-10-23T12:29:10.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:10.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:10.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:10.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:11.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:11.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:11.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:11.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:12.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:12.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:12.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:12.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:13.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:13.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:13.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:13.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:14.581 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:14.577+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:14.578779+0000) 2019-10-23T12:29:14.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:14.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:14.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:14.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:15.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:29:15.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:15.559399+0000) 2019-10-23T12:29:15.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:15.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:15.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:15.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:16.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:29:16.535+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:16.537230+0000) 2019-10-23T12:29:16.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:16.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:16.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:16.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:17.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:29:17.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:17.574844+0000) 2019-10-23T12:29:17.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:17.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:17.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:17.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:18.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:29:18.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:18.056278+0000) 2019-10-23T12:29:18.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:18.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:18.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:18.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:19.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:19.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:19.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:19.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:20.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:29:20.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:20.078142+0000) 2019-10-23T12:29:20.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:20.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:20.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:20.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:21.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:21.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:22.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:22.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:22.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:22.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:23.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:23.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:23.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:23.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:24.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:24.577+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:24.578875+0000) 2019-10-23T12:29:24.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:24.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:24.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:24.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:25.562 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:29:25.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:25.559512+0000) 2019-10-23T12:29:25.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:25.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:25.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:25.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:26.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:29:26.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:26.537326+0000) 2019-10-23T12:29:26.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:26.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:26.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:26.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:27.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:29:27.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:27.574959+0000) 2019-10-23T12:29:27.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:27.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:27.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:27.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:28.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:29:28.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:28.056376+0000) 2019-10-23T12:29:28.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:28.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:28.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:28.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:29.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:29.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:29.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:29.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:30.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:29:30.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:30.078240+0000) 2019-10-23T12:29:30.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:30.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:30.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:30.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:31.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:31.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:31.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:31.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:32.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:32.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:32.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:32.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:33.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:33.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:33.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:33.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:34.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:34.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:34.578976+0000) 2019-10-23T12:29:34.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:34.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:34.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:34.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:35.562 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:29:35.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:35.559623+0000) 2019-10-23T12:29:35.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:35.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:35.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:35.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:36.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:29:36.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:36.537440+0000) 2019-10-23T12:29:36.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:36.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:36.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:36.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:37.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:29:37.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:37.575065+0000) 2019-10-23T12:29:37.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:37.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:37.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:37.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:38.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:29:38.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:38.056474+0000) 2019-10-23T12:29:38.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:38.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:38.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:38.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:39.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:39.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:39.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:39.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:40.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:29:40.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:40.078337+0000) 2019-10-23T12:29:40.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:40.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:40.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:40.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:41.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:41.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:41.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:41.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:42.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:42.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:42.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:42.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:43.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:43.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:43.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:43.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:44.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:44.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:44.579074+0000) 2019-10-23T12:29:44.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:44.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:44.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:44.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:45.562 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:29:45.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:45.559731+0000) 2019-10-23T12:29:45.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:45.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:45.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:45.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:46.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:29:46.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:46.537549+0000) 2019-10-23T12:29:46.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:46.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:46.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:46.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:47.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:29:47.573+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:47.575171+0000) 2019-10-23T12:29:47.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:47.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:47.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:47.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:48.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:29:48.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:48.056576+0000) 2019-10-23T12:29:48.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:48.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:48.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:48.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:49.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:49.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:49.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:49.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:50.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:29:50.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:50.078430+0000) 2019-10-23T12:29:50.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:50.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:50.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:50.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:51.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:51.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:51.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:51.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:52.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:52.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:52.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:52.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:53.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:53.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:53.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:53.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:54.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:29:54.577+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:54.579173+0000) 2019-10-23T12:29:54.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:54.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:54.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:54.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:55.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:29:55.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:55.559838+0000) 2019-10-23T12:29:55.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:55.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:55.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:55.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:56.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:29:56.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:56.537658+0000) 2019-10-23T12:29:56.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:56.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:56.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:56.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:57.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:29:57.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:57.575287+0000) 2019-10-23T12:29:57.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:57.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:57.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:57.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:58.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:29:58.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:29:58.056679+0000) 2019-10-23T12:29:58.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:58.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:58.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:58.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:29:59.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:59.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:29:59.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:29:59.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:00.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:30:00.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:00.078532+0000) 2019-10-23T12:30:00.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:00.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:00.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:00.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:01.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:01.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:01.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:01.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:02.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:02.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:02.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:02.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:03.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:03.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:03.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:03.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:04.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:30:04.577+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:04.579267+0000) 2019-10-23T12:30:04.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:04.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:04.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:04.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:05.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:30:05.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:05.559949+0000) 2019-10-23T12:30:05.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:05.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:05.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:05.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:06.540 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:30:06.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:06.537766+0000) 2019-10-23T12:30:06.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:06.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:06.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:06.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:07.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:30:07.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:07.575401+0000) 2019-10-23T12:30:07.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:07.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:07.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:07.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:08.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:30:08.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:08.056778+0000) 2019-10-23T12:30:08.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:08.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:08.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:08.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:09.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:09.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:09.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:09.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:10.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:30:10.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:10.078630+0000) 2019-10-23T12:30:10.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:10.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:10.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:10.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:11.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:11.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:11.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:11.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:12.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:12.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:12.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:12.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:13.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:13.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:13.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:13.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:14.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:30:14.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:14.579370+0000) 2019-10-23T12:30:14.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:14.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:14.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:15.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:30:15.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:15.560062+0000) 2019-10-23T12:30:15.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:15.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:15.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:15.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:16.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:30:16.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:16.537875+0000) 2019-10-23T12:30:16.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:16.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:16.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:16.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:17.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:30:17.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:17.575514+0000) 2019-10-23T12:30:17.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:17.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:17.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:17.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:18.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:30:18.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:18.056875+0000) 2019-10-23T12:30:18.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:18.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:18.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:18.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:19.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:19.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:19.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:19.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:20.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:30:20.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:20.078731+0000) 2019-10-23T12:30:20.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:20.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:20.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:20.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:21.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:21.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:21.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:21.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:22.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:22.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:22.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:22.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:23.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:23.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:23.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:23.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:24.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:30:24.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:24.579465+0000) 2019-10-23T12:30:24.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:24.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:24.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:24.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:25.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:30:25.558+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:25.560177+0000) 2019-10-23T12:30:25.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:25.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:25.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:25.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:26.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:30:26.536+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:26.537991+0000) 2019-10-23T12:30:26.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:26.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:26.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:26.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:27.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:30:27.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:27.575628+0000) 2019-10-23T12:30:27.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:27.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:27.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:27.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:28.061 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:30:28.055+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:28.056969+0000) 2019-10-23T12:30:28.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:28.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:28.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:28.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:29.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:29.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:29.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:29.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:30.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:30:30.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:30.078828+0000) 2019-10-23T12:30:30.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:30.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:30.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:30.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:31.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:31.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:31.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:31.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:32.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:32.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:32.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:32.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:33.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:33.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:33.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:33.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:34.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:30:34.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:34.579559+0000) 2019-10-23T12:30:34.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:34.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:34.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:34.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:35.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:30:35.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:35.560290+0000) 2019-10-23T12:30:35.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:35.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:35.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:35.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:36.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:30:36.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:36.538102+0000) 2019-10-23T12:30:36.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:36.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:36.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:36.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:37.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:30:37.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:37.575734+0000) 2019-10-23T12:30:37.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:37.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:37.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:37.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:38.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:30:38.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:38.057068+0000) 2019-10-23T12:30:38.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:38.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:38.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:38.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:39.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:39.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:39.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:39.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:40.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:30:40.077+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:40.078928+0000) 2019-10-23T12:30:40.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:40.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:40.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:40.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:41.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:41.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:41.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:41.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:42.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:42.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:42.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:42.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:43.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:43.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:43.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:43.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:44.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:30:44.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:44.579660+0000) 2019-10-23T12:30:44.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:44.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:44.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:44.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:45.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:30:45.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:45.560401+0000) 2019-10-23T12:30:45.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:45.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:45.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:45.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:46.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:30:46.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:46.538211+0000) 2019-10-23T12:30:46.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:46.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:46.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:46.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:47.578 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:30:47.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:47.575843+0000) 2019-10-23T12:30:47.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:47.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:47.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:47.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:48.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:30:48.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:48.057167+0000) 2019-10-23T12:30:48.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:48.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:48.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:48.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:49.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:49.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:49.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:49.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:50.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:30:50.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:50.079034+0000) 2019-10-23T12:30:50.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:50.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:50.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:50.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:51.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:51.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:51.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:51.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:52.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:52.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:52.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:52.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:53.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:53.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:53.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:53.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:54.582 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:30:54.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:54.579762+0000) 2019-10-23T12:30:54.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:54.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:54.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:54.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:55.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:30:55.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:55.560508+0000) 2019-10-23T12:30:55.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:55.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:55.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:55.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:56.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:30:56.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:56.538323+0000) 2019-10-23T12:30:56.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:56.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:56.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:56.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:57.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:30:57.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:57.575956+0000) 2019-10-23T12:30:57.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:57.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:57.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:57.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:58.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:30:58.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:30:58.057264+0000) 2019-10-23T12:30:58.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:58.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:58.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:58.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:30:59.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:59.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:30:59.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:30:59.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:00.083 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:31:00.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:00.079134+0000) 2019-10-23T12:31:00.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:00.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:00.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:00.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:01.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:01.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:01.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:01.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:02.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:02.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:02.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:02.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:03.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:03.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:03.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:03.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:04.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:31:04.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:04.579859+0000) 2019-10-23T12:31:04.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:04.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:04.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:04.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:05.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:31:05.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:05.560617+0000) 2019-10-23T12:31:05.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:05.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:05.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:05.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:06.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:31:06.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:06.538427+0000) 2019-10-23T12:31:06.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:06.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:06.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:06.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:07.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:31:07.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:07.576071+0000) 2019-10-23T12:31:07.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:07.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:07.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:07.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:08.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:31:08.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:08.057361+0000) 2019-10-23T12:31:08.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:08.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:08.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:08.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:09.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:09.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:09.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:09.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:10.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:31:10.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:10.079232+0000) 2019-10-23T12:31:10.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:10.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:10.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:10.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:11.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:11.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:11.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:11.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:12.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:12.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:12.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:12.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:13.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:13.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:13.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:13.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:14.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:31:14.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:14.579957+0000) 2019-10-23T12:31:14.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:14.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:14.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:14.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:15.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:31:15.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:15.560723+0000) 2019-10-23T12:31:15.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:15.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:15.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:15.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:16.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:31:16.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:16.538539+0000) 2019-10-23T12:31:16.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:16.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:16.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:16.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:17.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:31:17.574+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:17.576181+0000) 2019-10-23T12:31:17.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:17.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:17.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:17.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:18.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:31:18.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:18.057460+0000) 2019-10-23T12:31:18.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:18.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:18.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:18.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:19.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:19.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:19.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:19.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:20.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:31:20.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:20.079335+0000) 2019-10-23T12:31:20.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:20.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:20.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:20.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:21.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:21.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:21.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:21.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:22.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:22.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:22.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:22.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:23.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:23.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:23.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:23.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:24.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:31:24.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:24.580059+0000) 2019-10-23T12:31:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:24.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:24.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:24.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:25.563 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:31:25.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:25.560830+0000) 2019-10-23T12:31:25.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:25.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:25.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:25.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:26.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:31:26.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:26.538646+0000) 2019-10-23T12:31:26.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:26.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:26.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:26.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:27.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:31:27.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:27.576297+0000) 2019-10-23T12:31:27.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:27.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:27.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:27.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:28.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:31:28.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:28.057558+0000) 2019-10-23T12:31:28.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:28.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:28.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:28.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:29.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:29.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:29.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:29.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:30.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:31:30.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:30.079436+0000) 2019-10-23T12:31:30.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:30.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:30.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:30.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:31.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:31.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:31.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:31.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:32.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:32.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:32.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:32.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:33.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:33.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:33.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:33.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:34.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:31:34.578+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:34.580160+0000) 2019-10-23T12:31:34.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:34.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:34.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:34.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:35.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:31:35.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:35.560942+0000) 2019-10-23T12:31:35.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:35.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:35.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:35.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:36.541 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:31:36.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:36.538758+0000) 2019-10-23T12:31:36.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:36.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:36.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:36.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:37.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:31:37.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:37.576408+0000) 2019-10-23T12:31:37.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:37.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:37.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:37.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:38.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:31:38.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:38.057654+0000) 2019-10-23T12:31:38.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:38.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:38.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:38.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:39.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:39.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:39.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:39.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:40.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:31:40.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:40.079532+0000) 2019-10-23T12:31:40.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:40.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:40.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:40.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:41.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:41.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:41.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:41.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:42.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:42.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:42.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:42.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:43.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:43.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:43.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:43.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:44.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:31:44.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:44.580256+0000) 2019-10-23T12:31:44.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:44.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:44.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:44.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:45.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:31:45.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:45.561055+0000) 2019-10-23T12:31:45.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:45.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:45.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:45.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:46.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:31:46.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:46.538870+0000) 2019-10-23T12:31:46.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:46.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:46.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:46.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:47.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:31:47.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:47.576520+0000) 2019-10-23T12:31:47.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:47.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:47.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:47.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:48.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:31:48.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:48.057750+0000) 2019-10-23T12:31:48.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:48.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:48.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:48.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:49.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:49.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:49.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:49.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:50.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:31:50.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:50.079629+0000) 2019-10-23T12:31:50.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:50.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:50.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:50.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:51.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:51.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:52.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:52.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:52.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:52.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:53.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:53.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:53.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:53.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:54.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:31:54.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:54.580358+0000) 2019-10-23T12:31:54.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:54.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:54.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:54.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:55.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:31:55.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:55.561164+0000) 2019-10-23T12:31:55.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:55.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:55.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:55.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:56.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:31:56.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:56.538988+0000) 2019-10-23T12:31:56.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:56.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:56.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:56.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:57.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:31:57.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:57.576631+0000) 2019-10-23T12:31:57.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:57.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:57.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:57.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:58.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:31:58.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:31:58.057849+0000) 2019-10-23T12:31:58.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:58.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:58.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:58.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:31:59.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:59.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:31:59.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:31:59.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:00.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:32:00.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:00.079729+0000) 2019-10-23T12:32:00.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:00.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:00.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:00.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:01.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:01.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:02.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:02.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:02.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:02.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:03.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:03.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:03.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:03.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:04.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:32:04.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:04.580453+0000) 2019-10-23T12:32:04.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:04.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:04.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:04.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:05.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:32:05.559+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:05.561273+0000) 2019-10-23T12:32:05.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:05.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:05.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:05.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:06.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:32:06.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:06.539108+0000) 2019-10-23T12:32:06.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:06.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:06.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:06.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:07.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:07.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:07.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:07.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:07.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:32:07.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:07.576747+0000) 2019-10-23T12:32:08.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:32:08.056+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:08.057945+0000) 2019-10-23T12:32:08.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:08.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:08.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:08.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:09.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:09.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:09.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:09.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:10.084 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:32:10.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:10.079824+0000) 2019-10-23T12:32:10.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:10.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:10.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:10.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:11.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:11.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:21:39.918092+0000 (oldest deadline 2019-10-23T12:21:59.918092+0000) 2019-10-23T12:32:11.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:11.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:12.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:12.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:13.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:13.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:14.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:14.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:14.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:32:14.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:14.580545+0000) 2019-10-23T12:32:15.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:15.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:15.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:32:15.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:15.561394+0000) 2019-10-23T12:32:16.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:16.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:16.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:32:16.537+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:16.539219+0000) 2019-10-23T12:32:17.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:17.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:17.579 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:32:17.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:17.576874+0000) 2019-10-23T12:32:18.062 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:32:18.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:18.058041+0000) 2019-10-23T12:32:18.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:18.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:19.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:19.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:20.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:32:20.078+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:20.079919+0000) 2019-10-23T12:32:20.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:20.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:21.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:21.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:22.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:22.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:23.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:23.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:24.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:24.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:24.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:32:24.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:24.580643+0000) 2019-10-23T12:32:25.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:25.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:25.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:32:25.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:25.561508+0000) 2019-10-23T12:32:26.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:26.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:26.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:32:26.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:26.539321+0000) 2019-10-23T12:32:27.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:27.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:27.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:32:27.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:27.576991+0000) 2019-10-23T12:32:28.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:32:28.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:28.058138+0000) 2019-10-23T12:32:28.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:28.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:29.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:29.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:30.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:32:30.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:30.080039+0000) 2019-10-23T12:32:30.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:30.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:31.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:31.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:32.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:32.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:32.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:32.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:33.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:33.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:33.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:33.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:34.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:34.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:34.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:34.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:34.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:32:34.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:34.580744+0000) 2019-10-23T12:32:35.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:35.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:35.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:35.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:35.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:32:35.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:35.561617+0000) 2019-10-23T12:32:36.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:32:36.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:36.539428+0000) 2019-10-23T12:32:36.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:36.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:36.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:36.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:37.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:37.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:37.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:37.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:37.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:32:37.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:37.577109+0000) 2019-10-23T12:32:38.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:32:38.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:38.058232+0000) 2019-10-23T12:32:38.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:38.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:38.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:38.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:39.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:39.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:39.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:39.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:40.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:32:40.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:40.080137+0000) 2019-10-23T12:32:40.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:40.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:40.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:40.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:41.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:41.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:41.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:41.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:42.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:42.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:42.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:42.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:43.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:43.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:43.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:43.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:44.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:44.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:44.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:44.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:44.583 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:32:44.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:44.580844+0000) 2019-10-23T12:32:45.564 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:32:45.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:45.561731+0000) 2019-10-23T12:32:45.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:45.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:45.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:45.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:46.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:32:46.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:46.539541+0000) 2019-10-23T12:32:46.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:46.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:46.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:46.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:47.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:32:47.575+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:47.577216+0000) 2019-10-23T12:32:47.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:47.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:47.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:47.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:48.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:32:48.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:48.058328+0000) 2019-10-23T12:32:48.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:48.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:48.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:48.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:49.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:49.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:49.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:49.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:50.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:32:50.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:50.080230+0000) 2019-10-23T12:32:50.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:50.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:50.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:50.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:51.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:51.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:51.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:51.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:52.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:52.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:52.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:52.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:53.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:53.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:53.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:53.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:54.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:54.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:54.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:54.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:54.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:32:54.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:54.580939+0000) 2019-10-23T12:32:55.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:32:55.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:55.561841+0000) 2019-10-23T12:32:55.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:55.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:55.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:55.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:56.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:32:56.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:56.539650+0000) 2019-10-23T12:32:56.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:56.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:56.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:56.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:57.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:32:57.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:57.577323+0000) 2019-10-23T12:32:57.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:57.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:57.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:57.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:58.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:32:58.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:32:58.058425+0000) 2019-10-23T12:32:58.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:58.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:58.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:58.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:32:59.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:59.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:32:59.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:32:59.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:00.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:33:00.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:00.080326+0000) 2019-10-23T12:33:00.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:00.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:00.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:00.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:01.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:01.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:01.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:01.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:02.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:02.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:02.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:02.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:03.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:03.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:03.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:03.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:04.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:33:04.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:04.581035+0000) 2019-10-23T12:33:04.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:04.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:04.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:04.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:05.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:33:05.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:05.561951+0000) 2019-10-23T12:33:05.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:05.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:05.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:05.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:06.542 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:33:06.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:06.539760+0000) 2019-10-23T12:33:06.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:06.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:06.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:06.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:07.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:33:07.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:07.577435+0000) 2019-10-23T12:33:07.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:07.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:07.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:07.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:08.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:33:08.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:08.058516+0000) 2019-10-23T12:33:08.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:08.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:08.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:08.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:09.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:09.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:09.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:09.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:10.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:33:10.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:10.080423+0000) 2019-10-23T12:33:10.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:10.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:10.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:10.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:11.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:11.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:11.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:11.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:12.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:12.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:12.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:12.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:13.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:13.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:13.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:13.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:14.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:33:14.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:14.581132+0000) 2019-10-23T12:33:14.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:14.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:14.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:14.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:15.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:33:15.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:15.562066+0000) 2019-10-23T12:33:15.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:15.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:15.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:15.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:16.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:33:16.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:16.539876+0000) 2019-10-23T12:33:16.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:16.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:16.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:16.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:17.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:33:17.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:17.577544+0000) 2019-10-23T12:33:17.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:17.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:17.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:17.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:18.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:33:18.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:18.058613+0000) 2019-10-23T12:33:18.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:18.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:18.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:18.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:19.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:19.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:19.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:19.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:20.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:33:20.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:20.080520+0000) 2019-10-23T12:33:20.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:20.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:20.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:20.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:21.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:21.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:21.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:21.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:22.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:22.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:22.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:22.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:23.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:23.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:23.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:23.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:24.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:33:24.579+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:24.581231+0000) 2019-10-23T12:33:24.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:24.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:24.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:24.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:25.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:33:25.560+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:25.562177+0000) 2019-10-23T12:33:25.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:25.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:25.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:25.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:26.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:33:26.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:26.539989+0000) 2019-10-23T12:33:26.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:26.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:26.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:26.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:27.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:33:27.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:27.577665+0000) 2019-10-23T12:33:27.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:27.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:27.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:27.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:28.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:33:28.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:28.058710+0000) 2019-10-23T12:33:28.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:28.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:28.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:28.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:29.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:29.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:29.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:29.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:30.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:33:30.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:30.080617+0000) 2019-10-23T12:33:30.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:30.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:30.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:30.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:31.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:31.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:31.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:31.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:32.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:32.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:32.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:32.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:33.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:33.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:33.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:33.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:34.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:33:34.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:34.581327+0000) 2019-10-23T12:33:34.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:34.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:34.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:34.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:35.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:33:35.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:35.562288+0000) 2019-10-23T12:33:35.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:35.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:35.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:35.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:36.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:33:36.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:36.540100+0000) 2019-10-23T12:33:36.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:36.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:36.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:36.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:37.580 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:33:37.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:37.577779+0000) 2019-10-23T12:33:37.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:37.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:37.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:37.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:38.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:33:38.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:38.058808+0000) 2019-10-23T12:33:38.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:38.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:38.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:38.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:39.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:39.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:39.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:39.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:40.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:33:40.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:40.080710+0000) 2019-10-23T12:33:40.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:40.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:40.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:40.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:41.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:41.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:41.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:41.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:42.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:42.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:42.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:42.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:43.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:43.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:43.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:43.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:44.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:33:44.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:44.581425+0000) 2019-10-23T12:33:44.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:44.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:44.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:44.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:45.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:33:45.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:45.562403+0000) 2019-10-23T12:33:45.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:45.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:45.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:45.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:46.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:33:46.538+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:46.540221+0000) 2019-10-23T12:33:46.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:46.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:46.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:46.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:47.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:33:47.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:47.577885+0000) 2019-10-23T12:33:47.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:47.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:47.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:47.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:48.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:33:48.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:48.058903+0000) 2019-10-23T12:33:48.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:48.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:48.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:48.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:49.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:49.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:49.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:49.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:50.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:33:50.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:50.080801+0000) 2019-10-23T12:33:50.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:50.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:50.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:50.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:51.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:51.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:51.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:51.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:52.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:52.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:52.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:52.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:53.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:53.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:53.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:53.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:54.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:33:54.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:54.581518+0000) 2019-10-23T12:33:54.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:54.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:54.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:54.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:55.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:33:55.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:55.562515+0000) 2019-10-23T12:33:55.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:55.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:55.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:55.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:56.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:33:56.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:56.540332+0000) 2019-10-23T12:33:56.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:56.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:56.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:56.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:57.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:33:57.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:57.577995+0000) 2019-10-23T12:33:57.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:57.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:57.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:57.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:58.063 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:33:58.057+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:33:58.058998+0000) 2019-10-23T12:33:58.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:58.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:58.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:58.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:33:59.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:59.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:33:59.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:33:59.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:00.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:34:00.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:00.080899+0000) 2019-10-23T12:34:00.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:00.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:00.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:00.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:01.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:01.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:01.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:01.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:02.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:02.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:02.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:02.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:03.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:03.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:03.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:03.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:04.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:34:04.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:04.581617+0000) 2019-10-23T12:34:04.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:04.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:04.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:04.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:05.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:34:05.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:05.562626+0000) 2019-10-23T12:34:05.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:05.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:05.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:05.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:06.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:34:06.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:06.540452+0000) 2019-10-23T12:34:06.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:06.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:06.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:06.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:07.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:34:07.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:07.578104+0000) 2019-10-23T12:34:07.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:07.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:07.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:07.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:08.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:34:08.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:08.059097+0000) 2019-10-23T12:34:08.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:08.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:08.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:08.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:09.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:09.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:09.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:09.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:10.085 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:34:10.079+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:10.080994+0000) 2019-10-23T12:34:10.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:10.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:10.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:10.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:11.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:11.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:11.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:11.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:12.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:12.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:12.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:12.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:13.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:13.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:13.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:13.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:14.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:34:14.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:14.581715+0000) 2019-10-23T12:34:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:14.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:14.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:15.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:34:15.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:15.562737+0000) 2019-10-23T12:34:15.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:15.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:15.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:15.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:16.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:34:16.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:16.540571+0000) 2019-10-23T12:34:16.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:16.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:16.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:16.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:17.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:34:17.576+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:17.578220+0000) 2019-10-23T12:34:17.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:17.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:17.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:17.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:18.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:34:18.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:18.059195+0000) 2019-10-23T12:34:18.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:18.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:18.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:18.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:19.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:19.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:19.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:19.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:20.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:34:20.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:20.081096+0000) 2019-10-23T12:34:20.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:20.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:20.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:20.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:21.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:21.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:21.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:21.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:22.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:22.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:22.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:22.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:23.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:23.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:23.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:23.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:24.584 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:34:24.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:24.581813+0000) 2019-10-23T12:34:24.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:24.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:24.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:24.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:25.565 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:34:25.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:25.562851+0000) 2019-10-23T12:34:25.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:25.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:25.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:25.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:26.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:34:26.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:26.540687+0000) 2019-10-23T12:34:26.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:26.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:26.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:26.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:27.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:34:27.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:27.578320+0000) 2019-10-23T12:34:27.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:27.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:27.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:27.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:28.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:34:28.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:28.059293+0000) 2019-10-23T12:34:28.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:28.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:28.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:28.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:29.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:29.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:29.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:29.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:30.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:34:30.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:30.081191+0000) 2019-10-23T12:34:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:30.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:30.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:31.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:31.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:31.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:31.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:32.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:32.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:32.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:32.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:33.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:33.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:33.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:33.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:34.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:34:34.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:34.581905+0000) 2019-10-23T12:34:34.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:34.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:34.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:34.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:35.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:34:35.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:35.562962+0000) 2019-10-23T12:34:35.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:35.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:35.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:35.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:36.543 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:34:36.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:36.540806+0000) 2019-10-23T12:34:36.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:36.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:36.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:36.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:37.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:34:37.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:37.578437+0000) 2019-10-23T12:34:37.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:37.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:37.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:37.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:38.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:34:38.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:38.059391+0000) 2019-10-23T12:34:38.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:38.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:38.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:38.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:39.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:39.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:39.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:39.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:40.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:34:40.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:40.081286+0000) 2019-10-23T12:34:40.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:40.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:40.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:40.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:41.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:41.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:41.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:41.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:42.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:42.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:42.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:42.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:43.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:43.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:43.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:43.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:44.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:34:44.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:44.582046+0000) 2019-10-23T12:34:44.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:44.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:44.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:44.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:45.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:34:45.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:45.563072+0000) 2019-10-23T12:34:45.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:45.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:45.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:45.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:46.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:34:46.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:46.540917+0000) 2019-10-23T12:34:46.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:46.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:46.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:46.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:47.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:34:47.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:47.578543+0000) 2019-10-23T12:34:47.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:47.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:47.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:47.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:48.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:34:48.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:48.059485+0000) 2019-10-23T12:34:48.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:48.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:48.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:48.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:49.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:49.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:49.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:49.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:50.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:34:50.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:50.081383+0000) 2019-10-23T12:34:50.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:50.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:50.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:50.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:51.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:51.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:51.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:51.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:52.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:52.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:52.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:52.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:53.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:53.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:53.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:53.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:54.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:34:54.580+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:54.582208+0000) 2019-10-23T12:34:54.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:54.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:54.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:54.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:55.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:34:55.561+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:55.563182+0000) 2019-10-23T12:34:55.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:55.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:55.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:55.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:56.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:34:56.539+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:56.541031+0000) 2019-10-23T12:34:56.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:56.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:56.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:56.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:57.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:34:57.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:57.578660+0000) 2019-10-23T12:34:57.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:57.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:57.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:57.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:58.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:34:58.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:34:58.059584+0000) 2019-10-23T12:34:58.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:58.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:58.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:58.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:34:59.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:59.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:34:59.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:34:59.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:00.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:35:00.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:00.081480+0000) 2019-10-23T12:35:00.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:00.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:00.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:00.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:01.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:01.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:01.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:01.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:02.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:02.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:02.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:02.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:03.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:03.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:03.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:03.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:04.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:35:04.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:04.582318+0000) 2019-10-23T12:35:04.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:04.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:04.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:04.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:05.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:35:05.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:05.563305+0000) 2019-10-23T12:35:05.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:05.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:05.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:05.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:06.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:35:06.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:06.541141+0000) 2019-10-23T12:35:06.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:06.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:06.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:06.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:07.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:35:07.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:07.578765+0000) 2019-10-23T12:35:07.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:07.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:07.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:07.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:08.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:35:08.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:08.059681+0000) 2019-10-23T12:35:08.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:08.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:08.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:08.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:09.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:09.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:09.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:09.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:10.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:35:10.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:10.081576+0000) 2019-10-23T12:35:10.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:10.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:10.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:10.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:11.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:11.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:11.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:11.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:12.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:12.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:12.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:12.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:13.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:13.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:13.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:13.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:14.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:35:14.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:14.582414+0000) 2019-10-23T12:35:14.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:14.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:14.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:14.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:15.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:35:15.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:15.563415+0000) 2019-10-23T12:35:15.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:15.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:15.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:15.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:16.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:35:16.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:16.541250+0000) 2019-10-23T12:35:16.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:16.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:16.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:16.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:17.581 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:35:17.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:17.578875+0000) 2019-10-23T12:35:17.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:17.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:17.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:17.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:18.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:35:18.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:18.059779+0000) 2019-10-23T12:35:18.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:18.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:18.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:18.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:19.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:19.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:19.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:19.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:20.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:35:20.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:20.081675+0000) 2019-10-23T12:35:20.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:20.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:20.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:20.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:21.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:21.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:21.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:21.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:22.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:22.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:22.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:22.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:23.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:23.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:23.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:23.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:24.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:35:24.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:24.582516+0000) 2019-10-23T12:35:24.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:24.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:24.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:24.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:25.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:35:25.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:25.563523+0000) 2019-10-23T12:35:25.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:25.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:25.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:25.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:26.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:35:26.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:26.541324+0000) 2019-10-23T12:35:26.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:26.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:26.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:26.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:27.582 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:35:27.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:27.578981+0000) 2019-10-23T12:35:27.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:27.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:27.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:27.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:28.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:35:28.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:28.059878+0000) 2019-10-23T12:35:28.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:28.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:28.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:28.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:29.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:29.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:29.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:29.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:30.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:35:30.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:30.081771+0000) 2019-10-23T12:35:30.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:30.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:30.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:30.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:31.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:31.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:31.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:31.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:32.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:32.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:32.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:32.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:33.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:33.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:33.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:33.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:34.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:35:34.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:34.582613+0000) 2019-10-23T12:35:34.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:34.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:34.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:34.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:35.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:35:35.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:35.563633+0000) 2019-10-23T12:35:35.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:35.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:35.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:35.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:36.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:35:36.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:36.541434+0000) 2019-10-23T12:35:36.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:36.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:36.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:36.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:37.582 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:35:37.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:37.579094+0000) 2019-10-23T12:35:37.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:37.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:37.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:37.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:38.064 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:35:38.058+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:38.059972+0000) 2019-10-23T12:35:38.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:38.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:38.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:38.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:39.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:39.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:39.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:39.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:40.086 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:35:40.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:40.081867+0000) 2019-10-23T12:35:40.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:40.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:40.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:40.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:41.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:41.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:41.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:41.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:42.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:42.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:42.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:42.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:43.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:43.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:43.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:43.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:44.585 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:35:44.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:44.582716+0000) 2019-10-23T12:35:44.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:44.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:44.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:44.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:45.566 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:35:45.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:45.563748+0000) 2019-10-23T12:35:45.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:45.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:45.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:45.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:46.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:35:46.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:46.541545+0000) 2019-10-23T12:35:46.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:46.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:46.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:46.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:47.582 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:35:47.577+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:47.579205+0000) 2019-10-23T12:35:47.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:47.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:47.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:47.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:48.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:35:48.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:48.060070+0000) 2019-10-23T12:35:48.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:48.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:48.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:48.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:49.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:49.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:49.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:49.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:50.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:35:50.080+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:50.081965+0000) 2019-10-23T12:35:50.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:50.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:50.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:50.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:51.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:51.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:51.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:51.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:52.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:52.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:52.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:52.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:53.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:53.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:53.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:53.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:54.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:35:54.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:54.582811+0000) 2019-10-23T12:35:54.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:54.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:54.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:54.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:55.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:35:55.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:55.563862+0000) 2019-10-23T12:35:55.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:55.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:55.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:55.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:56.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:35:56.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:56.541657+0000) 2019-10-23T12:35:56.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:56.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:56.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:56.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:57.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:35:57.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:57.579336+0000) 2019-10-23T12:35:57.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:57.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:57.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:57.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:58.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:35:58.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:35:58.060170+0000) 2019-10-23T12:35:58.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:58.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:58.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:58.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:35:59.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:59.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:35:59.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:35:59.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:00.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:36:00.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:00.082064+0000) 2019-10-23T12:36:00.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:00.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:00.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:00.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:01.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:01.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:01.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:01.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:02.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:02.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:02.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:02.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:03.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:03.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:03.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:03.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:04.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:36:04.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:04.582906+0000) 2019-10-23T12:36:04.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:04.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:04.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:04.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:05.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:36:05.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:05.563976+0000) 2019-10-23T12:36:05.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:05.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:05.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:05.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:06.544 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:36:06.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:06.541770+0000) 2019-10-23T12:36:06.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:06.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:06.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:06.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:07.582 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:36:07.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:07.579444+0000) 2019-10-23T12:36:07.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:07.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:07.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:07.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:08.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:36:08.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:08.060266+0000) 2019-10-23T12:36:08.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:08.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:08.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:08.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:09.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:09.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:09.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:09.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:10.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:36:10.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:10.082163+0000) 2019-10-23T12:36:10.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:10.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:10.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:10.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:11.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:11.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:11.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:11.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:12.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:12.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:12.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:12.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:13.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:13.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:13.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:13.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:14.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:36:14.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:14.583002+0000) 2019-10-23T12:36:14.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:14.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:14.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:14.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:15.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:36:15.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:15.564086+0000) 2019-10-23T12:36:15.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:15.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:15.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:15.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:16.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:36:16.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:16.541878+0000) 2019-10-23T12:36:16.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:16.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:16.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:16.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:17.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:36:17.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:17.579553+0000) 2019-10-23T12:36:17.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:17.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:17.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:17.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:18.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:36:18.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:18.060364+0000) 2019-10-23T12:36:18.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:18.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:18.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:18.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:19.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:19.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:19.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:19.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:20.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:36:20.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:20.082259+0000) 2019-10-23T12:36:20.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:20.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:20.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:20.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:21.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:21.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:21.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:21.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:22.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:22.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:22.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:22.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:23.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:23.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:23.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:23.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:24.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:36:24.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:24.583100+0000) 2019-10-23T12:36:24.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:24.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:24.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:24.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:25.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:36:25.562+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:25.564200+0000) 2019-10-23T12:36:25.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:25.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:25.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:25.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:26.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:36:26.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:26.541990+0000) 2019-10-23T12:36:26.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:26.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:26.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:26.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:27.582 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:36:27.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:27.579666+0000) 2019-10-23T12:36:27.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:27.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:27.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:27.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:28.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:36:28.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:28.060458+0000) 2019-10-23T12:36:28.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:28.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:28.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:28.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:29.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:29.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:29.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:29.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:30.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:36:30.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:30.082358+0000) 2019-10-23T12:36:30.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:30.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:30.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:30.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:31.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:31.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:31.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:31.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:32.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:32.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:32.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:32.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:33.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:33.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:33.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:33.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:34.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:36:34.581+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:34.583202+0000) 2019-10-23T12:36:34.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:34.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:34.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:34.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:35.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:36:35.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:35.564316+0000) 2019-10-23T12:36:35.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:35.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:35.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:35.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:36.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:36:36.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:36.542097+0000) 2019-10-23T12:36:36.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:36.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:36.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:36.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:37.582 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:36:37.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:37.579780+0000) 2019-10-23T12:36:37.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:37.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:37.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:37.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:38.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:36:38.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:38.060557+0000) 2019-10-23T12:36:38.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:38.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:38.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:38.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:39.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:39.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:39.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:39.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:40.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:36:40.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:40.082454+0000) 2019-10-23T12:36:40.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:40.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:40.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:40.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:41.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:41.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:41.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:41.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:42.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:42.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:42.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:42.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:43.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:43.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:43.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:43.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:44.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:36:44.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:44.583302+0000) 2019-10-23T12:36:44.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:44.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:44.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:44.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:45.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:36:45.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:45.564429+0000) 2019-10-23T12:36:45.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:45.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:45.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:45.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:46.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:36:46.540+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:46.542209+0000) 2019-10-23T12:36:46.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:46.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:46.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:46.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:47.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:36:47.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:47.579890+0000) 2019-10-23T12:36:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:47.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:47.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:47.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:48.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:36:48.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:48.060653+0000) 2019-10-23T12:36:48.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:48.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:48.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:48.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:49.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:49.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:49.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:49.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:50.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:36:50.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:50.082550+0000) 2019-10-23T12:36:50.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:50.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:50.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:50.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:51.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:51.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:51.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:51.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:52.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:52.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:52.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:52.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:53.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:53.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:53.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:53.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:54.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:36:54.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:54.583401+0000) 2019-10-23T12:36:54.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:54.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:54.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:54.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:55.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:36:55.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:55.564540+0000) 2019-10-23T12:36:55.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:55.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:55.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:55.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:56.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:36:56.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:56.542327+0000) 2019-10-23T12:36:56.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:56.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:56.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:56.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:57.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:36:57.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:57.580003+0000) 2019-10-23T12:36:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:57.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:57.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:58.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:36:58.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:36:58.060746+0000) 2019-10-23T12:36:58.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:58.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:58.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:58.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:36:59.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:59.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:36:59.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:36:59.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:00.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:37:00.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:00.082645+0000) 2019-10-23T12:37:00.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:00.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:00.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:00.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:01.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:01.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:01.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:01.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:02.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:02.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:02.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:02.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:03.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:03.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:03.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:03.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:04.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:37:04.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:04.583500+0000) 2019-10-23T12:37:04.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:04.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:04.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:04.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:05.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:37:05.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:05.564657+0000) 2019-10-23T12:37:05.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:05.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:05.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:05.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:06.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:37:06.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:06.542440+0000) 2019-10-23T12:37:06.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:06.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:06.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:06.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:07.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:37:07.578+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:07.580117+0000) 2019-10-23T12:37:07.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:07.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:07.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:07.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:08.065 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:37:08.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:08.060840+0000) 2019-10-23T12:37:08.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:08.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:08.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:08.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:09.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:09.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:09.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:09.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:10.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:37:10.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:10.082737+0000) 2019-10-23T12:37:10.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:10.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:10.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:10.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:11.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:11.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:11.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:11.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:12.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:12.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:12.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:12.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:13.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:13.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:13.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:13.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:14.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:37:14.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:14.583600+0000) 2019-10-23T12:37:14.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:14.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:14.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:14.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:15.567 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:37:15.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:15.564762+0000) 2019-10-23T12:37:15.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:15.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:15.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:15.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:16.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:37:16.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:16.542557+0000) 2019-10-23T12:37:16.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:16.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:16.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:16.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:17.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:37:17.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:17.580228+0000) 2019-10-23T12:37:17.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:17.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:17.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:17.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:18.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:37:18.059+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:18.060939+0000) 2019-10-23T12:37:18.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:18.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:18.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:18.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:19.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:19.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:19.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:19.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:20.087 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:37:20.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:20.082829+0000) 2019-10-23T12:37:20.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:20.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:20.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:20.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:21.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:21.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:21.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:21.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:22.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:22.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:22.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:22.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:23.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:23.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:23.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:23.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:24.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:37:24.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:24.583697+0000) 2019-10-23T12:37:24.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:24.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:24.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:24.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:25.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:37:25.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:25.564867+0000) 2019-10-23T12:37:25.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:25.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:25.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:25.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:26.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:37:26.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:26.542665+0000) 2019-10-23T12:37:26.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:26.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:26.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:26.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:27.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:37:27.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:27.580343+0000) 2019-10-23T12:37:27.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:27.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:27.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:27.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:28.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:37:28.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:28.061034+0000) 2019-10-23T12:37:28.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:28.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:28.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:28.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:29.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:29.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:29.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:29.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:30.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:37:30.081+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:30.082925+0000) 2019-10-23T12:37:30.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:30.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:30.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:30.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:31.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:31.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:31.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:31.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:32.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:32.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:32.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:32.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:33.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:33.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:33.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:33.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:34.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:37:34.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:34.583796+0000) 2019-10-23T12:37:34.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:34.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:34.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:34.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:35.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:37:35.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:35.564977+0000) 2019-10-23T12:37:35.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:35.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:35.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:35.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:36.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:37:36.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:36.542772+0000) 2019-10-23T12:37:36.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:36.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:36.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:36.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:37.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:37:37.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:37.580457+0000) 2019-10-23T12:37:37.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:37.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:37.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:37.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:38.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:37:38.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:38.061127+0000) 2019-10-23T12:37:38.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:38.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:38.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:38.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:39.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:39.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:39.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:39.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:40.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:37:40.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:40.083021+0000) 2019-10-23T12:37:40.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:40.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:40.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:40.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:41.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:41.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:41.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:41.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:42.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:42.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:42.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:42.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:43.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:43.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:43.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:43.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:44.586 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:37:44.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:44.583897+0000) 2019-10-23T12:37:44.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:44.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:44.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:44.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:45.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:37:45.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:45.565088+0000) 2019-10-23T12:37:45.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:45.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:45.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:45.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:46.545 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:37:46.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:46.542882+0000) 2019-10-23T12:37:46.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:46.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:46.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:46.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:47.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:37:47.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:47.580587+0000) 2019-10-23T12:37:47.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:47.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:47.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:47.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:48.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:37:48.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:48.061219+0000) 2019-10-23T12:37:48.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:48.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:48.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:48.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:49.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:49.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:49.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:49.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:50.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:37:50.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:50.083120+0000) 2019-10-23T12:37:50.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:50.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:50.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:50.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:51.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:51.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:51.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:51.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:52.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:52.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:52.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:52.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:53.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:53.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:53.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:53.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:54.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:37:54.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:54.584000+0000) 2019-10-23T12:37:54.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:54.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:54.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:54.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:55.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:37:55.563+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:55.565198+0000) 2019-10-23T12:37:55.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:55.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:55.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:55.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:56.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:37:56.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:56.542996+0000) 2019-10-23T12:37:56.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:56.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:56.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:56.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:57.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:37:57.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:57.580732+0000) 2019-10-23T12:37:57.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:57.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:57.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:57.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:58.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:37:58.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:37:58.061359+0000) 2019-10-23T12:37:58.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:58.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:58.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:58.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:37:59.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:59.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:37:59.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:37:59.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:00.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:38:00.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:00.083217+0000) 2019-10-23T12:38:00.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:00.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:00.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:00.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:01.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:01.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:01.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:01.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:02.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:02.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:02.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:02.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:03.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:03.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:03.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:03.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:04.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:38:04.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:04.584100+0000) 2019-10-23T12:38:04.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:04.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:04.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:04.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:05.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:38:05.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:05.565314+0000) 2019-10-23T12:38:05.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:05.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:05.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:05.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:06.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:38:06.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:06.543115+0000) 2019-10-23T12:38:06.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:06.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:06.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:06.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:07.583 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:38:07.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:07.580851+0000) 2019-10-23T12:38:07.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:07.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:07.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:07.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:08.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:38:08.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:08.061508+0000) 2019-10-23T12:38:08.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:08.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:08.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:08.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:09.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:09.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:09.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:09.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:10.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:38:10.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:10.083317+0000) 2019-10-23T12:38:10.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:10.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:10.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:10.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:11.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:11.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:11.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:11.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:12.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:12.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:12.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:12.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:13.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:13.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:13.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:13.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:14.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:38:14.582+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:14.584203+0000) 2019-10-23T12:38:14.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:14.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:14.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:14.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:15.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:38:15.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:15.565423+0000) 2019-10-23T12:38:15.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:15.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:15.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:15.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:16.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:38:16.541+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:16.543225+0000) 2019-10-23T12:38:16.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:16.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:16.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:16.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:17.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:38:17.579+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:17.580963+0000) 2019-10-23T12:38:17.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:17.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:17.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:17.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:18.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:38:18.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:18.061603+0000) 2019-10-23T12:38:18.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:18.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:18.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:18.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:19.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:19.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:19.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:19.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:20.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:38:20.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:20.083415+0000) 2019-10-23T12:38:20.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:20.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:20.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:20.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:21.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:21.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:21.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:21.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:22.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:22.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:22.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:22.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:23.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:23.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:23.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:23.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:24.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:38:24.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:24.584304+0000) 2019-10-23T12:38:24.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:24.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:24.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:24.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:25.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:38:25.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:25.565527+0000) 2019-10-23T12:38:25.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:25.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:25.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:25.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:26.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:38:26.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:26.543330+0000) 2019-10-23T12:38:26.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:26.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:26.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:26.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:27.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:38:27.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:27.581074+0000) 2019-10-23T12:38:27.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:27.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:27.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:27.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:28.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:38:28.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:28.061697+0000) 2019-10-23T12:38:28.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:28.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:28.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:28.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:29.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:29.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:29.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:29.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:30.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:38:30.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:30.083510+0000) 2019-10-23T12:38:30.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:30.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:30.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:30.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:31.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:31.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:31.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:31.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:32.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:32.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:32.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:32.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:33.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:33.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:33.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:33.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:34.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:38:34.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:34.584398+0000) 2019-10-23T12:38:34.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:34.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:34.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:34.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:35.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:38:35.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:35.565636+0000) 2019-10-23T12:38:35.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:35.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:35.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:35.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:36.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:38:36.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:36.543440+0000) 2019-10-23T12:38:36.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:36.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:36.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:36.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:37.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:38:37.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:37.581184+0000) 2019-10-23T12:38:37.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:37.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:37.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:37.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:38.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:38:38.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:38.061791+0000) 2019-10-23T12:38:38.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:38.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:38.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:38.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:39.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:39.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:39.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:39.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:40.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:38:40.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:40.083604+0000) 2019-10-23T12:38:40.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:40.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:40.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:40.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:41.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:41.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:41.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:41.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:42.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:42.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:42.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:42.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:43.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:43.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:43.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:43.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:44.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:38:44.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:44.584496+0000) 2019-10-23T12:38:44.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:44.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:44.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:44.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:45.568 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:38:45.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:45.565743+0000) 2019-10-23T12:38:45.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:45.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:45.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:45.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:46.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:38:46.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:46.543549+0000) 2019-10-23T12:38:46.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:46.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:46.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:46.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:47.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:38:47.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:47.581297+0000) 2019-10-23T12:38:47.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:47.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:47.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:47.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:48.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:38:48.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:48.061885+0000) 2019-10-23T12:38:48.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:48.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:48.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:48.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:49.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:49.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:49.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:49.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:50.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:38:50.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:50.083701+0000) 2019-10-23T12:38:50.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:50.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:50.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:50.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:51.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:51.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:51.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:51.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:52.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:52.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:52.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:52.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:53.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:53.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:53.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:53.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:54.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:38:54.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:54.584595+0000) 2019-10-23T12:38:54.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:54.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:54.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:54.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:55.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:38:55.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:55.565846+0000) 2019-10-23T12:38:56.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:55.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:56.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:55.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:56.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:38:56.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:56.543660+0000) 2019-10-23T12:38:56.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:56.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:56.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:56.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:57.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:38:57.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:57.581480+0000) 2019-10-23T12:38:57.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:57.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:57.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:57.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:58.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:38:58.060+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:38:58.061983+0000) 2019-10-23T12:38:58.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:58.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:58.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:58.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:38:59.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:59.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:38:59.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:38:59.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:00.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:39:00.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:00.083796+0000) 2019-10-23T12:39:01.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:01.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:01.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:01.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:02.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:02.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:02.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:02.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:02.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:02.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:02.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:02.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:04.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:04.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:04.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:04.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:04.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:39:04.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:04.584689+0000) 2019-10-23T12:39:05.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:05.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:05.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:05.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:05.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:39:05.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:05.565952+0000) 2019-10-23T12:39:06.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:06.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:06.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:06.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:06.546 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:39:06.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:06.543774+0000) 2019-10-23T12:39:07.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:07.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:07.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:07.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:07.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:39:07.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:07.581617+0000) 2019-10-23T12:39:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:08.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:08.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:08.066 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:39:08.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:08.062082+0000) 2019-10-23T12:39:09.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:09.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:09.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:09.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:10.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:10.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:10.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:10.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:10.088 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:39:10.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:10.083892+0000) 2019-10-23T12:39:10.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:10.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:10.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:10.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:11.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:11.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:11.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:11.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:13.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:13.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:13.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:13.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:14.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:14.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:14.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:14.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:14.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:39:14.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:14.584785+0000) 2019-10-23T12:39:15.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:15.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:15.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:15.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:15.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:39:15.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:15.566062+0000) 2019-10-23T12:39:16.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:16.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:16.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:16.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:16.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:39:16.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:16.543901+0000) 2019-10-23T12:39:17.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:17.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:17.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:17.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:17.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:39:17.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:17.581724+0000) 2019-10-23T12:39:18.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:18.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:18.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:18.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:18.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:39:18.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:18.062178+0000) 2019-10-23T12:39:19.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:19.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:19.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:19.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:20.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:39:20.082+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:20.083987+0000) 2019-10-23T12:39:20.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:20.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:20.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:20.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:21.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:21.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:21.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:21.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:22.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:22.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:22.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:22.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:23.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:23.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:23.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:23.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:24.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:24.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:24.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:24.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:24.587 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:39:24.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:24.584883+0000) 2019-10-23T12:39:25.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:25.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:25.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:25.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:25.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:39:25.564+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:25.566176+0000) 2019-10-23T12:39:26.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:26.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:26.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:26.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:26.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:39:26.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:26.544017+0000) 2019-10-23T12:39:27.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:27.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:27.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:27.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:27.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:39:27.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:27.581838+0000) 2019-10-23T12:39:28.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:39:28.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:28.062278+0000) 2019-10-23T12:39:28.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:28.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:28.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:28.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:29.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:29.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:29.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:29.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:30.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:39:30.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:30.084081+0000) 2019-10-23T12:39:30.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:30.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:30.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:30.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:31.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:31.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:31.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:31.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:32.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:32.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:32.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:32.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:33.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:33.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:33.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:33.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:34.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:34.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:34.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:34.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:34.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:39:34.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:34.584980+0000) 2019-10-23T12:39:35.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:35.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:35.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:35.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:35.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:39:35.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:35.566289+0000) 2019-10-23T12:39:36.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:36.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:36.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:36.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:36.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:39:36.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:36.544131+0000) 2019-10-23T12:39:37.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:37.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:37.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:37.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:37.584 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:39:37.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:37.581953+0000) 2019-10-23T12:39:38.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:39:38.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:38.062371+0000) 2019-10-23T12:39:38.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:38.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:38.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:38.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:39.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:39.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:39.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:39.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:40.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:40.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:40.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:40.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:40.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:39:40.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:40.084176+0000) 2019-10-23T12:39:41.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:41.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:41.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:41.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:42.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:41.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:42.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:41.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:42.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:42.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:42.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:42.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:43.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:43.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:43.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:43.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:44.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:39:44.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:44.585078+0000) 2019-10-23T12:39:44.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:44.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:44.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:44.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:45.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:39:45.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:45.566401+0000) 2019-10-23T12:39:45.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:45.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:45.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:45.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:46.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:39:46.542+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:46.544246+0000) 2019-10-23T12:39:46.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:46.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:46.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:46.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:47.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:39:47.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:47.582063+0000) 2019-10-23T12:39:47.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:47.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:47.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:47.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:48.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:39:48.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:48.062466+0000) 2019-10-23T12:39:48.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:48.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:48.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:48.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:49.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:49.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:49.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:49.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:50.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:39:50.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:50.084271+0000) 2019-10-23T12:39:50.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:50.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:50.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:50.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:51.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:51.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:51.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:51.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:52.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:52.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:52.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:52.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:53.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:53.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:53.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:53.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:54.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:39:54.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:54.585175+0000) 2019-10-23T12:39:54.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:54.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:54.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:54.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:55.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:39:55.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:55.566510+0000) 2019-10-23T12:39:56.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:56.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:56.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:56.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:56.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:39:56.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:56.544324+0000) 2019-10-23T12:39:56.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:56.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:56.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:56.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:57.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:39:57.580+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:57.582173+0000) 2019-10-23T12:39:58.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:58.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:58.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:58.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:39:58.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:39:58.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:39:58.062562+0000) 2019-10-23T12:39:59.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:59.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:39:59.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:39:59.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:00.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:00.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:00.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:00.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:00.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:40:00.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:00.084364+0000) 2019-10-23T12:40:00.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:00.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:00.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:00.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:01.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:01.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:01.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:01.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:02.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:02.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:02.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:02.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:03.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:03.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:03.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:03.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:04.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:40:04.583+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:04.585274+0000) 2019-10-23T12:40:04.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:04.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:04.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:04.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:05.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:40:05.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:05.566620+0000) 2019-10-23T12:40:05.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:05.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:05.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:05.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:06.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:40:06.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:06.544437+0000) 2019-10-23T12:40:06.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:06.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:06.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:06.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:07.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:40:07.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:07.582287+0000) 2019-10-23T12:40:07.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:07.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:07.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:07.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:08.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:40:08.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:08.062658+0000) 2019-10-23T12:40:08.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:08.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:08.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:08.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:09.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:09.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:09.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:09.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:10.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:40:10.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:10.084461+0000) 2019-10-23T12:40:10.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:10.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:10.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:10.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:11.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:11.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:11.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:11.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:12.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:12.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:12.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:12.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:13.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:13.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:13.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:13.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:14.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:40:14.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:14.585375+0000) 2019-10-23T12:40:14.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:14.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:14.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:14.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:15.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:40:15.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:15.566729+0000) 2019-10-23T12:40:15.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:15.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:15.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:15.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:16.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:40:16.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:16.544546+0000) 2019-10-23T12:40:16.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:16.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:16.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:16.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:17.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:40:17.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:17.582399+0000) 2019-10-23T12:40:17.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:17.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:17.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:17.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:18.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:40:18.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:18.062752+0000) 2019-10-23T12:40:18.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:18.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:18.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:18.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:19.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:19.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:19.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:19.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:20.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:40:20.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:20.084557+0000) 2019-10-23T12:40:20.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:20.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:20.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:20.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:21.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:21.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:21.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:21.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:22.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:22.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:22.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:22.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:23.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:23.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:23.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:23.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:24.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:40:24.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:24.585471+0000) 2019-10-23T12:40:24.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:24.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:24.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:24.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:25.569 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:40:25.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:25.566840+0000) 2019-10-23T12:40:25.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:25.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:25.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:25.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:26.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:40:26.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:26.544666+0000) 2019-10-23T12:40:26.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:26.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:26.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:26.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:27.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:40:27.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:27.582511+0000) 2019-10-23T12:40:27.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:27.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:27.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:27.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:28.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:40:28.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:28.062845+0000) 2019-10-23T12:40:28.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:28.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:28.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:28.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:29.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:29.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:29.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:29.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:30.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:40:30.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:30.084654+0000) 2019-10-23T12:40:30.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:30.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:30.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:30.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:31.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:31.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:31.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:31.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:32.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:32.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:32.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:32.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:33.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:33.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:33.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:33.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:34.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:40:34.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:34.585569+0000) 2019-10-23T12:40:34.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:34.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:34.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:34.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:35.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:40:35.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:35.566951+0000) 2019-10-23T12:40:35.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:35.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:35.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:35.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:36.547 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:40:36.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:36.544781+0000) 2019-10-23T12:40:36.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:36.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:36.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:36.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:37.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:40:37.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:37.582624+0000) 2019-10-23T12:40:37.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:37.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:37.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:37.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:38.067 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:40:38.061+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:38.062937+0000) 2019-10-23T12:40:38.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:38.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:38.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:38.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:39.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:39.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:39.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:39.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:40.094 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:40:40.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:40.084751+0000) 2019-10-23T12:40:40.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:40.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:40.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:40.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:41.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:41.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:41.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:41.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:42.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:42.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:42.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:42.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:43.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:43.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:43.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:43.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:44.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:40:44.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:44.585670+0000) 2019-10-23T12:40:44.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:44.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:44.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:44.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:45.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:40:45.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:45.567065+0000) 2019-10-23T12:40:45.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:45.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:45.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:45.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:46.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:40:46.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:46.544895+0000) 2019-10-23T12:40:46.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:46.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:46.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:46.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:47.585 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:40:47.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:47.582735+0000) 2019-10-23T12:40:47.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:47.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:47.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:47.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:48.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:40:48.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:48.063035+0000) 2019-10-23T12:40:48.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:48.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:48.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:48.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:49.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:49.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:49.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:49.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:50.089 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:40:50.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:50.084850+0000) 2019-10-23T12:40:50.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:50.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:50.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:50.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:51.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:51.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:51.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:51.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:52.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:52.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:52.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:52.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:53.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:53.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:53.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:53.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:54.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:40:54.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:54.585809+0000) 2019-10-23T12:40:54.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:54.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:54.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:54.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:55.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:40:55.565+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:55.567268+0000) 2019-10-23T12:40:55.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:55.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:55.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:55.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:56.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:40:56.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:56.545073+0000) 2019-10-23T12:40:56.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:56.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:56.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:56.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:57.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:40:57.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:57.582844+0000) 2019-10-23T12:40:57.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:57.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:57.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:57.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:58.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:40:58.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:40:58.063133+0000) 2019-10-23T12:40:58.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:58.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:58.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:58.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:40:59.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:59.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:40:59.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:40:59.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:00.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:41:00.083+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:00.084948+0000) 2019-10-23T12:41:00.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:00.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:00.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:00.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:01.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:01.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:01.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:01.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:02.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:02.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:02.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:02.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:03.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:03.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:03.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:03.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:04.588 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:41:04.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:04.585940+0000) 2019-10-23T12:41:04.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:04.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:04.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:04.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:05.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:41:05.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:05.567442+0000) 2019-10-23T12:41:05.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:05.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:05.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:05.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:06.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:41:06.543+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:06.545232+0000) 2019-10-23T12:41:06.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:06.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:06.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:06.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:07.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:41:07.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:07.582960+0000) 2019-10-23T12:41:07.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:07.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:07.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:07.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:08.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:41:08.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:08.063231+0000) 2019-10-23T12:41:08.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:08.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:08.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:08.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:09.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:09.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:09.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:09.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:10.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:41:10.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:10.085044+0000) 2019-10-23T12:41:10.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:10.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:10.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:10.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:11.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:11.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:11.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:11.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:12.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:12.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:12.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:12.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:13.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:13.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:13.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:13.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:14.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:41:14.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:14.586037+0000) 2019-10-23T12:41:14.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:14.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:14.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:14.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:15.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:41:15.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:15.567553+0000) 2019-10-23T12:41:15.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:15.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:15.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:15.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:16.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:41:16.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:16.545326+0000) 2019-10-23T12:41:16.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:16.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:16.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:16.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:17.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:41:17.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:17.583071+0000) 2019-10-23T12:41:17.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:17.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:17.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:17.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:18.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:41:18.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:18.063327+0000) 2019-10-23T12:41:18.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:18.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:18.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:18.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:19.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:19.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:19.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:19.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:20.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:41:20.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:20.085139+0000) 2019-10-23T12:41:20.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:20.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:20.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:20.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:21.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:21.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:21.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:21.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:22.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:22.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:22.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:22.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:23.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:23.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:23.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:23.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:24.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:41:24.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:24.586140+0000) 2019-10-23T12:41:24.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:24.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:24.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:24.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:25.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:41:25.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:25.567665+0000) 2019-10-23T12:41:25.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:25.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:25.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:25.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:26.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:41:26.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:26.545441+0000) 2019-10-23T12:41:26.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:26.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:26.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:26.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:27.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:41:27.581+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:27.583183+0000) 2019-10-23T12:41:27.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:27.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:27.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:27.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:28.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:41:28.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:28.063423+0000) 2019-10-23T12:41:28.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:28.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:28.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:28.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:29.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:29.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:29.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:29.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:30.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:41:30.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:30.085234+0000) 2019-10-23T12:41:30.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:30.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:30.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:30.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:31.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:31.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:31.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:31.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:32.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:32.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:32.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:32.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:33.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:33.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:33.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:33.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:34.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:41:34.584+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:34.586238+0000) 2019-10-23T12:41:34.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:34.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:34.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:34.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:35.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:41:35.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:35.567780+0000) 2019-10-23T12:41:35.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:35.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:35.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:35.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:36.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:41:36.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:36.545565+0000) 2019-10-23T12:41:36.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:36.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:36.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:36.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:37.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:41:37.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:37.583303+0000) 2019-10-23T12:41:37.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:37.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:37.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:37.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:38.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:41:38.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:38.063517+0000) 2019-10-23T12:41:38.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:38.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:38.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:38.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:39.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:39.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:39.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:39.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:40.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:41:40.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:40.085330+0000) 2019-10-23T12:41:40.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:40.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:40.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:40.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:41.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:41.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:41.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:41.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:42.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:42.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:42.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:42.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:43.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:43.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:43.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:43.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:44.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:41:44.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:44.586334+0000) 2019-10-23T12:41:44.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:44.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:44.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:44.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:45.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:41:45.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:45.567894+0000) 2019-10-23T12:41:45.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:45.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:45.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:45.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:46.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:41:46.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:46.545681+0000) 2019-10-23T12:41:46.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:46.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:46.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:46.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:47.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:41:47.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:47.583420+0000) 2019-10-23T12:41:47.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:47.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:47.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:47.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:48.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:41:48.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:48.063614+0000) 2019-10-23T12:41:48.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:48.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:48.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:48.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:49.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:49.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:49.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:49.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:50.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:41:50.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:50.085426+0000) 2019-10-23T12:41:50.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:50.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:50.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:50.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:51.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:51.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:51.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:51.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:52.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:52.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:52.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:52.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:53.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:53.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:53.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:53.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:54.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:41:54.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:54.586430+0000) 2019-10-23T12:41:54.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:54.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:54.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:54.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:55.570 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:41:55.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:55.568007+0000) 2019-10-23T12:41:55.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:55.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:55.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:55.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:56.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:41:56.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:56.545788+0000) 2019-10-23T12:41:56.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:56.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:56.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:56.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:57.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:41:57.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:57.583537+0000) 2019-10-23T12:41:57.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:57.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:57.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:57.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:58.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:41:58.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:41:58.063708+0000) 2019-10-23T12:41:58.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:58.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:58.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:58.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:41:59.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:59.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:41:59.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:41:59.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:00.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:42:00.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:00.085524+0000) 2019-10-23T12:42:00.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:00.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:00.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:00.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:01.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:01.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:01.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:01.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:02.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:02.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:02.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:02.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:03.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:03.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:03.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:03.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:04.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:42:04.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:04.586555+0000) 2019-10-23T12:42:04.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:04.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:04.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:04.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:05.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:42:05.566+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:05.568195+0000) 2019-10-23T12:42:05.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:05.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:05.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:05.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:06.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:42:06.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:06.545909+0000) 2019-10-23T12:42:06.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:06.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:06.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:06.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:07.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:42:07.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:07.583654+0000) 2019-10-23T12:42:07.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:07.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:07.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:07.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:08.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:42:08.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:08.063801+0000) 2019-10-23T12:42:08.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:08.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:08.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:08.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:09.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:09.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:09.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:09.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:10.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:42:10.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:10.085621+0000) 2019-10-23T12:42:10.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:10.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:10.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:10.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:11.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:11.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:11.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:11.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:12.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:12.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:12.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:12.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:13.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:13.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:13.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:13.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:14.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:14.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:14.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:14.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:14.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:42:14.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:14.586694+0000) 2019-10-23T12:42:15.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:15.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:15.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:15.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:15.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:42:15.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:15.568341+0000) 2019-10-23T12:42:16.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:16.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:16.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:16.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:16.548 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:42:16.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:16.546031+0000) 2019-10-23T12:42:17.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:17.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:17.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:17.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:17.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:42:17.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:17.583770+0000) 2019-10-23T12:42:18.068 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:42:18.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:18.063896+0000) 2019-10-23T12:42:18.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:18.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:18.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:18.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:19.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:19.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:19.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:19.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:20.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:42:20.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:20.085715+0000) 2019-10-23T12:42:20.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:20.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:20.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:20.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:21.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:21.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:21.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:21.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:22.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:22.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:22.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:22.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:23.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:23.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:23.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:23.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:24.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:24.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:24.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:24.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:24.589 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:42:24.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:24.586789+0000) 2019-10-23T12:42:25.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:25.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:25.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:25.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:25.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:42:25.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:25.568449+0000) 2019-10-23T12:42:26.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:26.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:26.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:26.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:26.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:42:26.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:26.546145+0000) 2019-10-23T12:42:27.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:27.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:27.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:27.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:27.586 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:42:27.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:27.583935+0000) 2019-10-23T12:42:28.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:42:28.062+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:28.063992+0000) 2019-10-23T12:42:28.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:28.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:28.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:28.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:29.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:29.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:29.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:29.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:30.090 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:42:30.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:30.085811+0000) 2019-10-23T12:42:30.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:30.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:30.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:30.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:31.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:31.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:31.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:31.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:32.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:32.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:32.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:32.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:33.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:33.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:33.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:33.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:34.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:34.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:34.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:34.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:34.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:42:34.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:34.586883+0000) 2019-10-23T12:42:35.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:35.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:35.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:35.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:35.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:42:35.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:35.568562+0000) 2019-10-23T12:42:36.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:36.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:36.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:36.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:36.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:42:36.544+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:36.546257+0000) 2019-10-23T12:42:37.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:37.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:37.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:37.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:37.587 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:42:37.582+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:37.584067+0000) 2019-10-23T12:42:38.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:42:38.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:38.064090+0000) 2019-10-23T12:42:38.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:38.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:38.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:38.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:39.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:39.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:39.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:39.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:40.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:42:40.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:40.085905+0000) 2019-10-23T12:42:40.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:40.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:40.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:40.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:41.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:41.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:41.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:41.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:42.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:42.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:42.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:42.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:43.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:43.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:43.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:43.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:44.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:44.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:44.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:44.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:44.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:42:44.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:44.586981+0000) 2019-10-23T12:42:45.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:45.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:45.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:45.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:45.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:42:45.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:45.568674+0000) 2019-10-23T12:42:46.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:46.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:46.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:46.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:46.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:42:46.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:46.546332+0000) 2019-10-23T12:42:47.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:47.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:32:12.245641+0000 (oldest deadline 2019-10-23T12:32:32.245641+0000) 2019-10-23T12:42:47.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:47.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:47.587 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:42:47.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:47.584151+0000) 2019-10-23T12:42:48.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:42:48.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:48.064183+0000) 2019-10-23T12:42:48.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:48.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:49.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:49.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:50.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:42:50.084+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:50.086000+0000) 2019-10-23T12:42:50.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:50.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:51.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:51.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:52.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:52.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:53.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:53.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:54.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:54.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:54.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:42:54.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:54.587082+0000) 2019-10-23T12:42:55.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:55.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:55.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:42:55.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:55.568783+0000) 2019-10-23T12:42:56.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:56.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:56.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:42:56.546+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:56.546443+0000) 2019-10-23T12:42:57.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:57.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:57.587 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:42:57.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:57.584264+0000) 2019-10-23T12:42:58.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:42:58.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:42:58.064281+0000) 2019-10-23T12:42:58.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:58.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:42:59.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:42:59.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:00.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:43:00.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:00.086100+0000) 2019-10-23T12:43:00.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:00.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:01.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:01.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:02.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:02.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:03.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:03.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:04.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:04.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:04.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:43:04.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:04.587181+0000) 2019-10-23T12:43:05.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:05.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:05.571 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:43:05.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:05.568897+0000) 2019-10-23T12:43:06.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:06.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:06.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:06.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:06.546550+0000) 2019-10-23T12:43:07.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:07.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:07.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:07.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:07.584388+0000) 2019-10-23T12:43:08.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:43:08.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:08.064379+0000) 2019-10-23T12:43:08.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:08.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:08.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:08.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:09.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:09.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:09.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:09.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:10.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:43:10.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:10.086195+0000) 2019-10-23T12:43:10.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:10.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:10.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:10.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:11.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:11.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:11.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:11.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:12.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:12.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:12.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:12.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:13.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:13.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:13.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:13.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:14.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:14.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:14.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:14.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:14.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:43:14.585+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:14.587276+0000) 2019-10-23T12:43:15.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:15.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:15.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:15.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:15.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:43:15.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:15.569010+0000) 2019-10-23T12:43:16.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:16.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:16.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:16.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:16.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:16.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:16.546654+0000) 2019-10-23T12:43:17.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:17.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:17.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:17.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:17.587 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:17.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:17.584501+0000) 2019-10-23T12:43:18.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:43:18.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:18.064474+0000) 2019-10-23T12:43:18.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:18.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:18.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:18.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:19.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:19.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:19.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:19.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:20.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:43:20.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:20.086293+0000) 2019-10-23T12:43:20.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:20.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:20.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:20.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:21.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:21.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:21.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:21.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:22.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:22.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:22.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:22.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:23.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:23.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:23.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:23.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:24.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:24.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:24.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:24.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:24.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:43:24.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:24.587373+0000) 2019-10-23T12:43:25.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:25.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:25.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:25.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:25.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:43:25.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:25.569121+0000) 2019-10-23T12:43:26.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:26.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:26.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:26.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:26.549 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:26.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:26.546755+0000) 2019-10-23T12:43:27.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:27.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:27.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:27.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:27.587 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:27.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:27.584610+0000) 2019-10-23T12:43:28.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:43:28.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:28.064572+0000) 2019-10-23T12:43:28.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:28.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:28.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:28.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:29.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:29.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:29.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:29.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:30.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:43:30.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:30.086392+0000) 2019-10-23T12:43:30.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:30.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:30.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:30.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:31.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:31.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:31.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:31.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:32.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:32.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:32.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:32.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:33.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:33.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:33.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:33.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:34.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:34.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:34.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:34.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:34.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:43:34.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:34.587471+0000) 2019-10-23T12:43:35.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:35.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:35.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:35.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:35.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:43:35.567+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:35.569225+0000) 2019-10-23T12:43:36.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:36.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:36.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:36.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:36.551 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:36.545+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:36.546857+0000) 2019-10-23T12:43:36.551 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:36.546+0000 7f0f60258700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:36.547457+0000) 2019-10-23T12:43:37.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:37.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:37.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:37.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:37.587 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:37.583+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:37.584714+0000) 2019-10-23T12:43:37.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:37.583+0000 7f9e31a91700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:37.585260+0000) 2019-10-23T12:43:38.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:43:38.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:38.064668+0000) 2019-10-23T12:43:38.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:38.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:38.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:38.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:39.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:39.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:39.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:39.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:40.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:43:40.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:40.086489+0000) 2019-10-23T12:43:40.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:40.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:40.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:40.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:41.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:41.045+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:41.047030+0000) 2019-10-23T12:43:41.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:41.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:41.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:41.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:42.087 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:42.083+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:42.084884+0000) 2019-10-23T12:43:42.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:42.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:42.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:42.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:43.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:43.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:43.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:43.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:44.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:44.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:44.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:44.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:44.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:43:44.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:44.587568+0000) 2019-10-23T12:43:45.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:45.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:45.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:45.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:45.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:43:45.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:45.569329+0000) 2019-10-23T12:43:46.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:46.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:46.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:46.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:47.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:47.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:47.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:47.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:48.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:43:48.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:48.064769+0000) 2019-10-23T12:43:48.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:48.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:48.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:48.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:49.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:49.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:49.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:49.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:50.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:43:50.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:50.086586+0000) 2019-10-23T12:43:50.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:50.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:50.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:50.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:51.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:43:51.045+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:51.047130+0000) 2019-10-23T12:43:51.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:51.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:51.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:51.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:52.087 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:43:52.083+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:52.084979+0000) 2019-10-23T12:43:52.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:52.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:52.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:52.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:53.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:53.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:53.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:53.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:54.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:54.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:54.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:54.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:54.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:43:54.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:54.587664+0000) 2019-10-23T12:43:55.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:55.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:55.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:55.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:55.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:43:55.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:55.569438+0000) 2019-10-23T12:43:56.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:56.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:56.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:56.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:57.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:57.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:57.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:57.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:58.069 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:43:58.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:43:58.064866+0000) 2019-10-23T12:43:58.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:58.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:58.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:58.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:43:59.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:59.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:43:59.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:43:59.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:00.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:44:00.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:00.086684+0000) 2019-10-23T12:44:00.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:00.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:00.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:00.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:01.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:44:01.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:01.047224+0000) 2019-10-23T12:44:01.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:01.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:01.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:01.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:02.088 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:02.084+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:02.085072+0000) 2019-10-23T12:44:02.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:02.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:02.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:02.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:03.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:03.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:03.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:03.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:04.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:04.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:04.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:04.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:04.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:44:04.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:04.587758+0000) 2019-10-23T12:44:05.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:05.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:05.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:05.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:05.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:44:05.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:05.569554+0000) 2019-10-23T12:44:06.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:06.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:06.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:06.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:07.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:07.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:07.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:07.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:08.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:44:08.063+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:08.064959+0000) 2019-10-23T12:44:08.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:08.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:08.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:08.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:09.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:09.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:09.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:09.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:10.091 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:44:10.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:10.086781+0000) 2019-10-23T12:44:10.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:10.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:10.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:10.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:11.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:44:11.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:11.047324+0000) 2019-10-23T12:44:11.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:11.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:11.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:11.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:12.089 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:12.084+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:12.085164+0000) 2019-10-23T12:44:12.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:12.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:12.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:12.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:13.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:13.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:13.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:13.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:14.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:14.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:14.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:14.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:14.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:44:14.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:14.587858+0000) 2019-10-23T12:44:15.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:15.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:15.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:15.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:15.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:44:15.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:15.569669+0000) 2019-10-23T12:44:16.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:16.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:16.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:16.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:17.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:17.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:17.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:17.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:18.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:44:18.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:18.065057+0000) 2019-10-23T12:44:18.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:18.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:18.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:18.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:19.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:19.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:19.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:19.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:20.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:44:20.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:20.086877+0000) 2019-10-23T12:44:20.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:20.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:20.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:20.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:21.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:44:21.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:21.047420+0000) 2019-10-23T12:44:21.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:21.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:21.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:21.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:22.088 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:22.083+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:22.085257+0000) 2019-10-23T12:44:22.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:22.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:22.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:22.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:23.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:23.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:23.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:23.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:24.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:24.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:24.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:24.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:24.590 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:44:24.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:24.587957+0000) 2019-10-23T12:44:25.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:25.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:25.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:25.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:25.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:44:25.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:25.569781+0000) 2019-10-23T12:44:26.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:26.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:26.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:26.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:27.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:27.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:27.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:27.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:28.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:44:28.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:28.065153+0000) 2019-10-23T12:44:28.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:28.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:28.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:28.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:29.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:29.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:29.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:29.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:30.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:44:30.085+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:30.086977+0000) 2019-10-23T12:44:30.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:30.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:30.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:30.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:31.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:44:31.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:31.047516+0000) 2019-10-23T12:44:31.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:31.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:31.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:31.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:32.088 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:32.084+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:32.085347+0000) 2019-10-23T12:44:32.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:32.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:32.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:32.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:33.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:33.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:33.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:33.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:34.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:34.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:34.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:34.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:34.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:44:34.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:34.588052+0000) 2019-10-23T12:44:35.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:35.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:35.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:35.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:35.572 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:44:35.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:35.569889+0000) 2019-10-23T12:44:36.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:36.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:36.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:36.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:37.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:37.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:37.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:37.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:38.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:44:38.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:38.065251+0000) 2019-10-23T12:44:38.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:38.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:38.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:38.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:39.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:39.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:39.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:39.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:40.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:44:40.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:40.087073+0000) 2019-10-23T12:44:40.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:40.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:40.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:40.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:41.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:44:41.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:41.047612+0000) 2019-10-23T12:44:41.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:41.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:41.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:41.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:42.088 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:42.084+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:42.085433+0000) 2019-10-23T12:44:42.088 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:42.084+0000 7f9e31290700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:42.086130+0000) 2019-10-23T12:44:42.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:42.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:42.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:42.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:43.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:43.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:43.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:43.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:44.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:44.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:44.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:44.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:44.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:44:44.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:44.588151+0000) 2019-10-23T12:44:45.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:45.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:45.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:45.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:45.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:44:45.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:45.570007+0000) 2019-10-23T12:44:46.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:46.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:46.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:46.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:46.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:46.584+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:46.585625+0000) 2019-10-23T12:44:47.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:47.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:47.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:47.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:48.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:44:48.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:48.065347+0000) 2019-10-23T12:44:48.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:48.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:48.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:48.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:49.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:49.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:49.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:49.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:50.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:44:50.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:50.087168+0000) 2019-10-23T12:44:50.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:50.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:50.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:50.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:51.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:44:51.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:51.047712+0000) 2019-10-23T12:44:51.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:51.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:51.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:51.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:52.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:52.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:52.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:52.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:53.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:53.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:53.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:53.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:54.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:54.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:54.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:54.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:54.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:44:54.586+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:54.588246+0000) 2019-10-23T12:44:55.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:55.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:55.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:55.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:55.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:44:55.568+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:55.570115+0000) 2019-10-23T12:44:56.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:56.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:56.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:56.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:56.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:44:56.584+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:56.585718+0000) 2019-10-23T12:44:57.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:57.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:57.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:57.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:58.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:44:58.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:44:58.065445+0000) 2019-10-23T12:44:58.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:58.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:58.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:58.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:44:59.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:59.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:44:59.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:44:59.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:00.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:00.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:00.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:00.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:00.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:45:00.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:00.087262+0000) 2019-10-23T12:45:01.050 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:45:01.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:01.047811+0000) 2019-10-23T12:45:01.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:01.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:01.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:01.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:02.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:02.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:02.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:02.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:03.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:03.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:03.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:03.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:04.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:04.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:04.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:04.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:04.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:45:04.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:04.588297+0000) 2019-10-23T12:45:05.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:05.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:05.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:05.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:05.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:45:05.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:05.570223+0000) 2019-10-23T12:45:06.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:06.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:06.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:06.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:06.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:45:06.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:06.585813+0000) 2019-10-23T12:45:07.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:07.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:07.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:07.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:08.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:45:08.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:08.065538+0000) 2019-10-23T12:45:08.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:08.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:08.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:08.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:09.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:09.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:09.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:09.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:10.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:45:10.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:10.087357+0000) 2019-10-23T12:45:10.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:10.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:10.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:10.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:11.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:45:11.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:11.047954+0000) 2019-10-23T12:45:11.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:11.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:11.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:11.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:12.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:12.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:12.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:12.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:13.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:13.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:13.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:13.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:14.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:14.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:14.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:14.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:14.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:45:14.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:14.588394+0000) 2019-10-23T12:45:15.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:15.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:15.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:15.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:15.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:45:15.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:15.570325+0000) 2019-10-23T12:45:16.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:16.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:16.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:16.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:16.588 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:45:16.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:16.585907+0000) 2019-10-23T12:45:17.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:17.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:17.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:17.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:18.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:45:18.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:18.065636+0000) 2019-10-23T12:45:18.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:18.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:18.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:18.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:19.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:19.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:19.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:19.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:20.094 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:45:20.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:20.087453+0000) 2019-10-23T12:45:20.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:20.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:20.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:20.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:21.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:45:21.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:21.048099+0000) 2019-10-23T12:45:21.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:21.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:21.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:21.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:22.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:22.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:22.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:22.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:23.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:23.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:23.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:23.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:24.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:24.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:24.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:24.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:24.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:45:24.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:24.588495+0000) 2019-10-23T12:45:25.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:25.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:25.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:25.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:25.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:45:25.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:25.570433+0000) 2019-10-23T12:45:26.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:26.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:26.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:26.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:26.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:45:26.584+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:26.586001+0000) 2019-10-23T12:45:27.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:27.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:27.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:27.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:28.070 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:45:28.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:28.065729+0000) 2019-10-23T12:45:28.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:28.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:28.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:28.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:29.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:29.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:29.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:29.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:30.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:45:30.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:30.087549+0000) 2019-10-23T12:45:30.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:30.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:30.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:30.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:31.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:45:31.046+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:31.048200+0000) 2019-10-23T12:45:31.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:31.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:31.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:31.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:32.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:32.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:32.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:32.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:33.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:33.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:33.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:33.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:34.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:34.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:34.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:34.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:34.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:45:34.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:34.588595+0000) 2019-10-23T12:45:35.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:35.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:35.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:35.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:35.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:45:35.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:35.570542+0000) 2019-10-23T12:45:36.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:36.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:36.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:36.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:36.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:45:36.584+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:36.586092+0000) 2019-10-23T12:45:37.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:37.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:37.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:37.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:38.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:45:38.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:38.065820+0000) 2019-10-23T12:45:38.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:38.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:38.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:38.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:39.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:39.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:39.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:39.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:40.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:45:40.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:40.087642+0000) 2019-10-23T12:45:40.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:40.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:40.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:40.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:41.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:45:41.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:41.048298+0000) 2019-10-23T12:45:41.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:41.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:41.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:41.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:42.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:42.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:42.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:42.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:43.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:43.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:43.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:43.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:44.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:44.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:44.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:44.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:44.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:45:44.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:44.588696+0000) 2019-10-23T12:45:45.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:45.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:45.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:45.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:45.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:45:45.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:45.570657+0000) 2019-10-23T12:45:46.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:46.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:46.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:46.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:46.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:45:46.584+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:46.586184+0000) 2019-10-23T12:45:47.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:47.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:47.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:47.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:48.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:45:48.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:48.065913+0000) 2019-10-23T12:45:48.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:48.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:48.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:48.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:49.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:49.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:49.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:49.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:50.092 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:45:50.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:50.087736+0000) 2019-10-23T12:45:50.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:50.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:50.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:50.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:51.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:45:51.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:51.048398+0000) 2019-10-23T12:45:51.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:51.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:51.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:51.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:52.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:52.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:52.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:52.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:53.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:53.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:53.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:53.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:54.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:54.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:54.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:54.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:54.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:45:54.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:54.588796+0000) 2019-10-23T12:45:55.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:55.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:55.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:55.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:55.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:45:55.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:55.570770+0000) 2019-10-23T12:45:56.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:56.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:56.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:56.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:56.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:45:56.584+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:56.586277+0000) 2019-10-23T12:45:57.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:57.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:57.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:57.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:58.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:45:58.064+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:45:58.066008+0000) 2019-10-23T12:45:58.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:58.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:58.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:58.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:45:59.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:59.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:45:59.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:45:59.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:00.093 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:00.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:00.087832+0000) 2019-10-23T12:46:00.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:00.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:00.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:00.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:01.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:46:01.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:01.048500+0000) 2019-10-23T12:46:01.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:01.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:01.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:01.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:02.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:02.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:02.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:02.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:03.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:03.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:03.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:03.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:04.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:04.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:04.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:04.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:04.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:46:04.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:04.588893+0000) 2019-10-23T12:46:05.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:05.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:05.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:05.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:05.573 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:46:05.569+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:05.570881+0000) 2019-10-23T12:46:06.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:06.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:06.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:06.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:06.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:46:06.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:06.586378+0000) 2019-10-23T12:46:07.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:07.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:07.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:07.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:08.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:46:08.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:08.066106+0000) 2019-10-23T12:46:08.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:08.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:08.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:08.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:09.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:09.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:09.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:09.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:10.093 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:10.086+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:10.087929+0000) 2019-10-23T12:46:10.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:10.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:10.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:10.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:11.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:46:11.048+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:11.048612+0000) 2019-10-23T12:46:11.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:11.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:11.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:11.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:12.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:12.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:12.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:12.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:13.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:13.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:13.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:13.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:14.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:14.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:14.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:14.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:14.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:46:14.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:14.588989+0000) 2019-10-23T12:46:15.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:15.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:15.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:15.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:15.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:46:15.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:15.571080+0000) 2019-10-23T12:46:16.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:16.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:16.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:16.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:16.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:46:16.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:16.586474+0000) 2019-10-23T12:46:17.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:17.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:17.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:17.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:18.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:46:18.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:18.066247+0000) 2019-10-23T12:46:18.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:18.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:18.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:18.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:19.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:19.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:19.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:19.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:20.093 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:20.087+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:20.088021+0000) 2019-10-23T12:46:20.093 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:20.087+0000 7f4b5bf0a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:20.088686+0000) 2019-10-23T12:46:20.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:20.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:20.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:20.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:21.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:46:21.048+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:21.048711+0000) 2019-10-23T12:46:21.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:21.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:21.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:21.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:22.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:22.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:22.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:22.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:23.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:23.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:23.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:23.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:24.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:24.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:24.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:24.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:24.591 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:46:24.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:24.589089+0000) 2019-10-23T12:46:24.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:24.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:24.588221+0000) 2019-10-23T12:46:25.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:25.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:25.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:25.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:25.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:46:25.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:25.571222+0000) 2019-10-23T12:46:26.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:26.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:26.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:26.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:26.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:46:26.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:26.586581+0000) 2019-10-23T12:46:27.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:27.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:27.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:27.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:28.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:46:28.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:28.066382+0000) 2019-10-23T12:46:28.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:28.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:28.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:28.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:29.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:29.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:29.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:29.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:30.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:30.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:30.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:30.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:31.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:46:31.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:31.048810+0000) 2019-10-23T12:46:31.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:31.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:31.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:31.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:32.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:32.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:32.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:32.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:33.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:33.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:33.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:33.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:34.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:34.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:34.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:34.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:34.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:46:34.587+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:34.589188+0000) 2019-10-23T12:46:34.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:34.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:34.588316+0000) 2019-10-23T12:46:35.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:46:35.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:35.571322+0000) 2019-10-23T12:46:35.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:35.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:35.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:35.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:36.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:36.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:36.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:36.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:36.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:46:36.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:36.586676+0000) 2019-10-23T12:46:37.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:37.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:37.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:37.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:38.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:46:38.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:38.066480+0000) 2019-10-23T12:46:38.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:38.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:38.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:38.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:39.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:39.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:39.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:39.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:40.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:40.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:40.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:40.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:41.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:46:41.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:41.048904+0000) 2019-10-23T12:46:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:41.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:41.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:42.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:42.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:42.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:42.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:43.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:43.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:43.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:43.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:44.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:46:44.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:44.589289+0000) 2019-10-23T12:46:44.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:44.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:44.588411+0000) 2019-10-23T12:46:44.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:44.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:44.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:44.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:45.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:46:45.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:45.571431+0000) 2019-10-23T12:46:45.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:45.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:45.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:45.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:46.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:46:46.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:46.586769+0000) 2019-10-23T12:46:46.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:46.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:46.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:46.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:47.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:47.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:47.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:47.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:48.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:46:48.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:48.066578+0000) 2019-10-23T12:46:48.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:48.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:48.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:48.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:49.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:49.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:49.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:49.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:50.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:50.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:50.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:50.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:51.051 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:46:51.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:51.048996+0000) 2019-10-23T12:46:51.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:51.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:51.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:51.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:52.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:52.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:52.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:52.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:53.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:53.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:53.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:53.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:54.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:46:54.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:54.589388+0000) 2019-10-23T12:46:54.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:46:54.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:54.588493+0000) 2019-10-23T12:46:54.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:54.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:54.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:54.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:55.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:46:55.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:55.571543+0000) 2019-10-23T12:46:55.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:55.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:55.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:55.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:56.589 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:46:56.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:56.586845+0000) 2019-10-23T12:46:56.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:56.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:56.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:56.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:57.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:57.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:57.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:57.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:58.071 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:46:58.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:46:58.066673+0000) 2019-10-23T12:46:58.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:58.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:58.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:58.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:46:59.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:59.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:46:59.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:46:59.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:00.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:00.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:00.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:00.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:01.052 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:01.047+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:01.049094+0000) 2019-10-23T12:47:01.052 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:01.048+0000 7f0f60258700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:01.049738+0000) 2019-10-23T12:47:01.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:01.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:01.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:01.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:02.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:02.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:02.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:02.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:03.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:03.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:03.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:03.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:04.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:04.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:04.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:04.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:04.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:47:04.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:04.589488+0000) 2019-10-23T12:47:04.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:47:04.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:04.588587+0000) 2019-10-23T12:47:05.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:05.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:05.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:05.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:05.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:05.548+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:05.549298+0000) 2019-10-23T12:47:05.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:47:05.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:05.571655+0000) 2019-10-23T12:47:06.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:06.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:06.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:06.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:06.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:47:06.585+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:06.586986+0000) 2019-10-23T12:47:07.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:07.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:07.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:07.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:08.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:47:08.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:08.066770+0000) 2019-10-23T12:47:08.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:08.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:08.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:08.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:09.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:09.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:09.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:09.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:10.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:10.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:10.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:10.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:11.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:11.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:11.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:11.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:12.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:12.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:12.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:12.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:13.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:13.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:13.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:13.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:14.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:14.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:14.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:14.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:14.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:47:14.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:14.588684+0000) 2019-10-23T12:47:14.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:47:14.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:14.589679+0000) 2019-10-23T12:47:15.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:15.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:15.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:15.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:15.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:15.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:15.549395+0000) 2019-10-23T12:47:15.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:47:15.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:15.571764+0000) 2019-10-23T12:47:16.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:16.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:16.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:16.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:16.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:47:16.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:16.587135+0000) 2019-10-23T12:47:17.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:17.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:17.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:17.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:18.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:47:18.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:18.066869+0000) 2019-10-23T12:47:18.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:18.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:18.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:18.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:19.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:19.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:19.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:19.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:20.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:20.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:20.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:20.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:21.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:21.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:21.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:21.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:22.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:22.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:22.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:22.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:23.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:23.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:23.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:23.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:24.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:24.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:24.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:24.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:24.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:47:24.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:24.589832+0000) 2019-10-23T12:47:24.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:47:24.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:24.588777+0000) 2019-10-23T12:47:25.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:25.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:25.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:25.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:25.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:25.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:25.549539+0000) 2019-10-23T12:47:25.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:47:25.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:25.571925+0000) 2019-10-23T12:47:26.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:26.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:26.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:26.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:26.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:47:26.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:26.587230+0000) 2019-10-23T12:47:27.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:27.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:27.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:27.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:28.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:47:28.065+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:28.066968+0000) 2019-10-23T12:47:28.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:28.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:28.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:28.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:29.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:29.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:29.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:29.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:30.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:30.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:30.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:30.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:31.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:31.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:31.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:31.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:32.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:32.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:32.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:32.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:33.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:33.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:33.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:33.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:34.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:34.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:34.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:34.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:34.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:47:34.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:34.589929+0000) 2019-10-23T12:47:34.593 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:47:34.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:34.588869+0000) 2019-10-23T12:47:35.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:35.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:35.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:35.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:35.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:35.548+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:35.549670+0000) 2019-10-23T12:47:35.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:47:35.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:35.572074+0000) 2019-10-23T12:47:36.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:36.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:36.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:36.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:36.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:47:36.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:36.587299+0000) 2019-10-23T12:47:37.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:37.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:37.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:37.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:38.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:47:38.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:38.067065+0000) 2019-10-23T12:47:38.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:38.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:38.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:38.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:39.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:39.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:39.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:39.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:40.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:40.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:40.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:40.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:41.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:41.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:41.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:41.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:42.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:42.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:42.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:42.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:43.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:43.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:43.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:43.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:44.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:44.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:44.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:44.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:44.592 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:47:44.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:44.590031+0000) 2019-10-23T12:47:44.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:47:44.587+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:44.588964+0000) 2019-10-23T12:47:45.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:45.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:45.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:45.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:45.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:45.548+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:45.549765+0000) 2019-10-23T12:47:45.574 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:47:45.570+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:45.572184+0000) 2019-10-23T12:47:46.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:46.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:46.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:46.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:46.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:47:46.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:46.587396+0000) 2019-10-23T12:47:47.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:47.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:47.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:47.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:48.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:47:48.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:48.067144+0000) 2019-10-23T12:47:48.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:48.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:48.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:48.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:49.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:49.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:49.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:49.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:50.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:50.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:50.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:50.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:51.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:51.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:51.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:51.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:52.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:52.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:52.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:52.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:53.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:53.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:53.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:53.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:54.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:54.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:54.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:54.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:54.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:47:54.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:54.590126+0000) 2019-10-23T12:47:54.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:47:54.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:54.589063+0000) 2019-10-23T12:47:55.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:55.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:55.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:55.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:55.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:47:55.548+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:55.549858+0000) 2019-10-23T12:47:55.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:47:55.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:55.572300+0000) 2019-10-23T12:47:56.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:56.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:56.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:56.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:56.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:47:56.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:56.587497+0000) 2019-10-23T12:47:57.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:57.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:57.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:57.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:58.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:47:58.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:47:58.067242+0000) 2019-10-23T12:47:58.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:58.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:58.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:58.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:47:59.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:59.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:47:59.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:47:59.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:00.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:00.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:00.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:00.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:01.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:01.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:01.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:01.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:02.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:02.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:02.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:02.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:03.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:03.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:03.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:03.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:04.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:04.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:04.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:04.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:04.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:48:04.588+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:04.590222+0000) 2019-10-23T12:48:04.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:48:04.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:04.589160+0000) 2019-10-23T12:48:05.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:48:05.548+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:05.549954+0000) 2019-10-23T12:48:05.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:05.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:05.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:05.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:05.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:48:05.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:05.572412+0000) 2019-10-23T12:48:06.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:06.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:06.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:06.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:06.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:48:06.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:06.587589+0000) 2019-10-23T12:48:07.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:07.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:07.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:07.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:08.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:48:08.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:08.067339+0000) 2019-10-23T12:48:08.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:08.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:08.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:08.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:09.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:09.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:09.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:09.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:10.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:10.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:10.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:10.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:11.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:11.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:11.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:11.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:12.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:12.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:12.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:12.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:13.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:13.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:13.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:13.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:14.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:48:14.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:14.590300+0000) 2019-10-23T12:48:14.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:14.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:14.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:14.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:14.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:48:14.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:14.589221+0000) 2019-10-23T12:48:15.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:15.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:15.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:15.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:15.552 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:48:15.548+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:15.550051+0000) 2019-10-23T12:48:15.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:48:15.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:15.572521+0000) 2019-10-23T12:48:16.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:16.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:16.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:16.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:16.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:48:16.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:16.587684+0000) 2019-10-23T12:48:17.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:17.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:17.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:17.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:18.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:48:18.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:18.067437+0000) 2019-10-23T12:48:18.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:18.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:18.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:18.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:19.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:19.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:19.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:19.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:20.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:20.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:20.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:20.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:21.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:21.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:21.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:21.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:22.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:22.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:22.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:22.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:23.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:23.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:23.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:23.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:24.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:48:24.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:24.590399+0000) 2019-10-23T12:48:24.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:48:24.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:24.589319+0000) 2019-10-23T12:48:24.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:24.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:24.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:24.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:25.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:48:25.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:25.550141+0000) 2019-10-23T12:48:25.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:48:25.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:25.572630+0000) 2019-10-23T12:48:25.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:25.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:25.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:25.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:26.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:48:26.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:26.587776+0000) 2019-10-23T12:48:26.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:26.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:26.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:26.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:27.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:27.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:27.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:27.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:28.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:48:28.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:28.067534+0000) 2019-10-23T12:48:28.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:28.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:28.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:28.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:29.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:29.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:29.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:29.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:30.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:30.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:30.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:30.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:31.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:31.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:31.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:31.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:32.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:32.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:32.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:32.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:33.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:33.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:33.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:33.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:34.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:48:34.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:34.590539+0000) 2019-10-23T12:48:34.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:48:34.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:34.589416+0000) 2019-10-23T12:48:34.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:34.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:34.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:34.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:35.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:48:35.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:35.550240+0000) 2019-10-23T12:48:35.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:48:35.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:35.572740+0000) 2019-10-23T12:48:35.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:35.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:35.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:35.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:36.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:48:36.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:36.587871+0000) 2019-10-23T12:48:36.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:36.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:36.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:36.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:37.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:37.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:37.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:37.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:38.072 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:48:38.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:38.067626+0000) 2019-10-23T12:48:38.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:38.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:38.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:38.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:39.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:39.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:39.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:39.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:40.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:40.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:40.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:40.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:41.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:41.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:41.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:41.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:42.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:42.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:42.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:42.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:43.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:43.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:43.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:43.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:44.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:48:44.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:44.590669+0000) 2019-10-23T12:48:44.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:48:44.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:44.589514+0000) 2019-10-23T12:48:44.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:44.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:44.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:44.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:45.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:48:45.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:45.550353+0000) 2019-10-23T12:48:45.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:48:45.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:45.572854+0000) 2019-10-23T12:48:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:45.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:45.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:46.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:48:46.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:46.587961+0000) 2019-10-23T12:48:46.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:46.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:46.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:46.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:47.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:47.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:47.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:47.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:48.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:48:48.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:48.067722+0000) 2019-10-23T12:48:48.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:48.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:48.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:48.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:49.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:49.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:49.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:49.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:50.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:50.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:50.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:50.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:51.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:51.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:51.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:51.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:52.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:52.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:52.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:52.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:53.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:53.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:53.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:53.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:54.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:48:54.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:54.590769+0000) 2019-10-23T12:48:54.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:48:54.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:54.589607+0000) 2019-10-23T12:48:54.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:54.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:54.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:54.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:55.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:48:55.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:55.550448+0000) 2019-10-23T12:48:55.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:48:55.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:55.572964+0000) 2019-10-23T12:48:55.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:55.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:55.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:55.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:56.590 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:48:56.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:56.588057+0000) 2019-10-23T12:48:56.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:56.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:56.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:56.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:57.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:57.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:57.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:57.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:58.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:48:58.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:48:58.067819+0000) 2019-10-23T12:48:58.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:58.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:58.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:58.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:48:59.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:59.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:48:59.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:48:59.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:00.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:00.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:00.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:00.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:01.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:01.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:01.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:01.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:02.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:02.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:02.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:02.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:03.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:03.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:03.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:03.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:04.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:49:04.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:04.590864+0000) 2019-10-23T12:49:04.594 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:49:04.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:04.589703+0000) 2019-10-23T12:49:04.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:04.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:04.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:04.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:05.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:49:05.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:05.550547+0000) 2019-10-23T12:49:05.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:49:05.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:05.573072+0000) 2019-10-23T12:49:05.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:05.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:05.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:05.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:06.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:49:06.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:06.588155+0000) 2019-10-23T12:49:06.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:06.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:06.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:06.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:07.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:07.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:07.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:07.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:08.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:49:08.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:08.067916+0000) 2019-10-23T12:49:08.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:08.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:08.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:08.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:09.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:09.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:09.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:09.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:10.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:10.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:10.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:10.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:11.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:11.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:11.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:11.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:12.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:12.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:12.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:12.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:13.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:13.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:13.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:13.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:14.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:49:14.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:14.590960+0000) 2019-10-23T12:49:14.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:49:14.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:14.589797+0000) 2019-10-23T12:49:14.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:14.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:14.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:14.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:15.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:49:15.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:15.550644+0000) 2019-10-23T12:49:15.575 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:49:15.571+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:15.573190+0000) 2019-10-23T12:49:15.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:15.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:15.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:15.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:16.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:49:16.586+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:16.588250+0000) 2019-10-23T12:49:16.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:16.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:16.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:16.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:17.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:17.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:17.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:17.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:18.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:49:18.066+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:18.068010+0000) 2019-10-23T12:49:18.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:18.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:18.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:18.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:19.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:19.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:19.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:19.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:20.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:20.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:20.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:20.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:21.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:21.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:21.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:21.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:22.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:22.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:22.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:22.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:23.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:23.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:23.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:23.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:24.593 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:49:24.589+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:24.591059+0000) 2019-10-23T12:49:24.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:49:24.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:24.589894+0000) 2019-10-23T12:49:24.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:24.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:24.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:24.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:25.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:49:25.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:25.550738+0000) 2019-10-23T12:49:25.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:49:25.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:25.573305+0000) 2019-10-23T12:49:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:25.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:25.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:26.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:49:26.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:26.588379+0000) 2019-10-23T12:49:26.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:26.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:26.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:26.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:27.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:27.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:27.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:27.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:28.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:49:28.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:28.068110+0000) 2019-10-23T12:49:28.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:28.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:28.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:28.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:29.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:29.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:29.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:29.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:30.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:30.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:30.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:30.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:31.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:31.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:31.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:31.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:33.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:33.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:33.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:33.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:33.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:33.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:33.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:33.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:34.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:49:34.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:34.591155+0000) 2019-10-23T12:49:34.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:49:34.588+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:34.589989+0000) 2019-10-23T12:49:34.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:34.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:34.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:34.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:35.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:49:35.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:35.550832+0000) 2019-10-23T12:49:35.581 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:49:35.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:35.573417+0000) 2019-10-23T12:49:35.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:35.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:35.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:35.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:36.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:49:36.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:36.588515+0000) 2019-10-23T12:49:36.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:36.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:36.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:36.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:37.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:37.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:37.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:37.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:38.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:49:38.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:38.068206+0000) 2019-10-23T12:49:38.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:38.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:38.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:38.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:39.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:39.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:39.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:39.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:40.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:40.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:40.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:40.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:41.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:41.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:41.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:41.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:42.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:42.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:42.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:42.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:43.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:43.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:43.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:43.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:44.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:49:44.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:44.591250+0000) 2019-10-23T12:49:44.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:49:44.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:44.590090+0000) 2019-10-23T12:49:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:44.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:44.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:45.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:49:45.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:45.550922+0000) 2019-10-23T12:49:45.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:49:45.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:45.573527+0000) 2019-10-23T12:49:45.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:45.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:45.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:45.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:46.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:49:46.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:46.588610+0000) 2019-10-23T12:49:46.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:46.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:46.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:46.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:47.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:47.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:47.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:47.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:48.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:49:48.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:48.068303+0000) 2019-10-23T12:49:48.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:48.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:48.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:48.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:49.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:49.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:49.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:49.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:50.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:50.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:50.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:50.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:51.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:51.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:51.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:51.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:52.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:52.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:52.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:52.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:53.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:53.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:53.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:53.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:54.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:49:54.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:54.591347+0000) 2019-10-23T12:49:54.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:49:54.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:54.590187+0000) 2019-10-23T12:49:54.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:54.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:54.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:54.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:55.553 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:49:55.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:55.551013+0000) 2019-10-23T12:49:55.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:49:55.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:55.573638+0000) 2019-10-23T12:49:55.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:55.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:55.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:55.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:56.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:49:56.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:56.588707+0000) 2019-10-23T12:49:57.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:57.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:57.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:57.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:58.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:58.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:58.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:58.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:49:58.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:49:58.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:49:58.068400+0000) 2019-10-23T12:49:59.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:59.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:49:59.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:49:59.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:00.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:00.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:00.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:00.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:01.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:00.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:01.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:00.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:02.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:02.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:02.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:02.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:03.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:02.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:03.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:02.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:04.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:04.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:04.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:04.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:04.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:50:04.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:04.591445+0000) 2019-10-23T12:50:04.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:50:04.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:04.590283+0000) 2019-10-23T12:50:05.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:05.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:05.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:05.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:05.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:50:05.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:05.551109+0000) 2019-10-23T12:50:05.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:50:05.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:05.573749+0000) 2019-10-23T12:50:06.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:06.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:06.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:06.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:06.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:50:06.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:06.588804+0000) 2019-10-23T12:50:07.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:07.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:07.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:07.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:08.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:50:08.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:08.068495+0000) 2019-10-23T12:50:08.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:08.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:08.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:08.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:09.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:09.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:09.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:09.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:10.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:10.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:10.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:10.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:11.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:11.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:11.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:11.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:12.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:12.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:12.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:12.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:13.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:13.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:13.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:13.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:14.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:14.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:14.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:14.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:14.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:50:14.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:14.591542+0000) 2019-10-23T12:50:14.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:50:14.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:14.590380+0000) 2019-10-23T12:50:15.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:15.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:15.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:15.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:15.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:50:15.549+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:15.551207+0000) 2019-10-23T12:50:15.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:50:15.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:15.573862+0000) 2019-10-23T12:50:16.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:16.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:16.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:16.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:16.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:50:16.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:16.588898+0000) 2019-10-23T12:50:17.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:17.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:17.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:17.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:18.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:50:18.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:18.068592+0000) 2019-10-23T12:50:18.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:18.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:18.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:18.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:19.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:19.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:19.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:19.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:20.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:20.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:20.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:20.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:21.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:21.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:21.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:21.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:22.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:22.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:22.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:22.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:23.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:23.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:23.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:23.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:24.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:24.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:24.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:24.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:24.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:50:24.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:24.591636+0000) 2019-10-23T12:50:24.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:50:24.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:24.590474+0000) 2019-10-23T12:50:25.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:25.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:25.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:25.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:25.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:50:25.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:25.551298+0000) 2019-10-23T12:50:25.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:50:25.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:25.573976+0000) 2019-10-23T12:50:26.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:26.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:26.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:26.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:26.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:50:26.587+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:26.588992+0000) 2019-10-23T12:50:27.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:27.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:27.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:27.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:28.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:28.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:28.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:28.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:28.073 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:50:28.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:28.068692+0000) 2019-10-23T12:50:28.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:28.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:28.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:28.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:30.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:29.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:30.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:29.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:31.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:31.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:31.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:31.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:32.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:31.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:32.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:31.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:32.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:32.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:32.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:32.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:33.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:33.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:33.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:33.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:34.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:50:34.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:34.591732+0000) 2019-10-23T12:50:34.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:50:34.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:34.590571+0000) 2019-10-23T12:50:34.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:34.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:34.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:34.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:35.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:50:35.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:35.551389+0000) 2019-10-23T12:50:35.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:50:35.572+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:35.574085+0000) 2019-10-23T12:50:35.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:35.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:35.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:35.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:36.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:50:36.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:36.589097+0000) 2019-10-23T12:50:36.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:36.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:36.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:36.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:37.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:37.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:37.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:37.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:38.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:50:38.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:38.068790+0000) 2019-10-23T12:50:38.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:38.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:38.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:38.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:39.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:39.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:39.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:39.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:40.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:40.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:40.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:40.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:41.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:41.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:41.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:41.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:42.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:42.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:42.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:42.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:43.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:43.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:43.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:43.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:44.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:50:44.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:44.591830+0000) 2019-10-23T12:50:44.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:50:44.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:44.590667+0000) 2019-10-23T12:50:44.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:44.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:44.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:44.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:45.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:50:45.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:45.551489+0000) 2019-10-23T12:50:45.576 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:50:45.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:45.574194+0000) 2019-10-23T12:50:45.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:45.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:45.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:45.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:46.591 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:50:46.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:46.589195+0000) 2019-10-23T12:50:46.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:46.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:46.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:46.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:47.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:47.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:47.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:47.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:48.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:50:48.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:48.068888+0000) 2019-10-23T12:50:48.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:48.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:48.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:48.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:49.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:49.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:49.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:49.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:50.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:50.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:50.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:50.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:51.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:51.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:51.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:51.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:52.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:52.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:52.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:52.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:53.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:53.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:53.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:53.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:54.594 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:50:54.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:54.591932+0000) 2019-10-23T12:50:54.595 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:50:54.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:54.590764+0000) 2019-10-23T12:50:54.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:54.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:54.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:54.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:55.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:50:55.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:55.551586+0000) 2019-10-23T12:50:55.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:50:55.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:55.574311+0000) 2019-10-23T12:50:55.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:55.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:55.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:55.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:56.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:50:56.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:56.589295+0000) 2019-10-23T12:50:56.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:56.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:56.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:56.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:57.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:57.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:57.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:57.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:58.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:50:58.067+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:50:58.068991+0000) 2019-10-23T12:50:58.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:58.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:58.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:58.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:50:59.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:59.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:50:59.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:50:59.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:00.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:00.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:00.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:00.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:01.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:01.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:01.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:01.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:02.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:02.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:02.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:02.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:03.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:03.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:03.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:03.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:04.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:51:04.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:04.592031+0000) 2019-10-23T12:51:04.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:51:04.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:04.590862+0000) 2019-10-23T12:51:04.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:04.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:04.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:04.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:05.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:51:05.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:05.551684+0000) 2019-10-23T12:51:05.598 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:51:05.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:05.574419+0000) 2019-10-23T12:51:05.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:05.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:05.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:05.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:06.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:51:06.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:06.589389+0000) 2019-10-23T12:51:06.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:06.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:06.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:06.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:07.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:07.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:07.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:07.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:08.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:51:08.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:08.069085+0000) 2019-10-23T12:51:08.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:08.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:08.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:08.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:09.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:09.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:09.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:09.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:10.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:10.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:10.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:10.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:11.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:11.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:11.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:11.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:12.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:12.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:12.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:12.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:13.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:13.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:13.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:13.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:14.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:51:14.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:14.592129+0000) 2019-10-23T12:51:14.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:51:14.589+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:14.590954+0000) 2019-10-23T12:51:15.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:15.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:15.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:15.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:15.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:51:15.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:15.551778+0000) 2019-10-23T12:51:15.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:51:15.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:15.574532+0000) 2019-10-23T12:51:15.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:15.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:15.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:15.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:16.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:51:16.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:16.589487+0000) 2019-10-23T12:51:16.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:16.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:16.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:16.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:17.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:17.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:17.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:17.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:18.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:51:18.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:18.069181+0000) 2019-10-23T12:51:18.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:18.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:18.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:18.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:19.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:19.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:19.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:19.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:20.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:20.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:20.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:20.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:21.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:21.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:21.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:21.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:22.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:22.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:22.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:22.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:23.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:23.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:23.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:23.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:24.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:51:24.590+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:24.592224+0000) 2019-10-23T12:51:24.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:51:24.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:24.591050+0000) 2019-10-23T12:51:24.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:24.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:24.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:24.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:25.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:51:25.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:25.551876+0000) 2019-10-23T12:51:25.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:51:25.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:25.574637+0000) 2019-10-23T12:51:25.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:25.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:25.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:25.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:26.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:51:26.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:26.589585+0000) 2019-10-23T12:51:26.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:26.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:26.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:26.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:27.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:27.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:27.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:27.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:28.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:51:28.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:28.069277+0000) 2019-10-23T12:51:28.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:28.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:28.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:28.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:29.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:29.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:29.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:29.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:31.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:31.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:31.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:31.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:31.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:31.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:31.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:31.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:32.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:32.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:32.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:32.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:33.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:33.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:33.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:33.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:34.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:51:34.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:34.592300+0000) 2019-10-23T12:51:34.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:51:34.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:34.591145+0000) 2019-10-23T12:51:34.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:34.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:34.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:34.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:35.554 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:51:35.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:35.551972+0000) 2019-10-23T12:51:35.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:51:35.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:35.574758+0000) 2019-10-23T12:51:36.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:36.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:36.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:36.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:36.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:51:36.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:36.589675+0000) 2019-10-23T12:51:37.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:37.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:37.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:37.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:38.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:38.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:38.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:38.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:38.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:51:38.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:38.069373+0000) 2019-10-23T12:51:39.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:39.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:39.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:39.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:40.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:40.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:41.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:41.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:41.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:41.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:42.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:42.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:42.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:42.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:43.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:43.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:43.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:43.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:44.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:44.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:44.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:44.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:44.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:51:44.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:44.592397+0000) 2019-10-23T12:51:44.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:51:44.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:44.591244+0000) 2019-10-23T12:51:45.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:45.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:45.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:45.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:45.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:51:45.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:45.552069+0000) 2019-10-23T12:51:45.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:51:45.574+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:45.574867+0000) 2019-10-23T12:51:46.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:46.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:46.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:46.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:46.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:51:46.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:46.589771+0000) 2019-10-23T12:51:47.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:47.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:47.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:47.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:48.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:48.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:48.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:48.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:48.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:51:48.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:48.069472+0000) 2019-10-23T12:51:49.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:48.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:49.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:48.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:50.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:50.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:50.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:50.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:51.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:51.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:51.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:51.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:51.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:51.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:51.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:51.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:52.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:52.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:52.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:52.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:54.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:54.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:54.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:54.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:54.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:51:54.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:54.592493+0000) 2019-10-23T12:51:54.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:51:54.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:54.591340+0000) 2019-10-23T12:51:55.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:55.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:55.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:55.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:55.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:51:55.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:55.552165+0000) 2019-10-23T12:51:55.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:51:55.574+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:55.574970+0000) 2019-10-23T12:51:56.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:56.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:56.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:56.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:56.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:51:56.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:56.589861+0000) 2019-10-23T12:51:57.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:57.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:57.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:57.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:58.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:58.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:58.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:58.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:51:58.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:51:58.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:51:58.069571+0000) 2019-10-23T12:51:59.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:59.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:51:59.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:51:59.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:00.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:00.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:00.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:00.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:01.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:01.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:01.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:01.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:02.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:02.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:02.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:02.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:02.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:02.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:02.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:02.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:03.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:03.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:03.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:03.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:04.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:52:04.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:04.592591+0000) 2019-10-23T12:52:04.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:52:04.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:04.591437+0000) 2019-10-23T12:52:04.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:04.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:04.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:04.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:05.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:52:05.550+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:05.552259+0000) 2019-10-23T12:52:05.577 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:05.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:05.575075+0000) 2019-10-23T12:52:05.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:05.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:05.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:05.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:06.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:52:06.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:06.589957+0000) 2019-10-23T12:52:06.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:06.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:06.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:06.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:07.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:07.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:07.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:07.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:08.074 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:52:08.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:08.069669+0000) 2019-10-23T12:52:08.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:08.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:08.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:08.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:09.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:09.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:09.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:09.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:10.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:10.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:10.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:10.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:11.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:11.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:11.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:11.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:12.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:12.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:12.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:12.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:13.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:13.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:13.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:13.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:14.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:52:14.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:14.592691+0000) 2019-10-23T12:52:14.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:52:14.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:14.591535+0000) 2019-10-23T12:52:14.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:14.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:14.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:14.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:15.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:52:15.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:15.552355+0000) 2019-10-23T12:52:15.578 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:15.573+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:15.575180+0000) 2019-10-23T12:52:15.578 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:15.574+0000 7fa171eda700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:15.575778+0000) 2019-10-23T12:52:15.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:15.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:15.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:15.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:16.592 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:52:16.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:16.590053+0000) 2019-10-23T12:52:16.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:16.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:16.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:16.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:17.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:17.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:17.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:17.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 132 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:18.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:52:18.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:18.069765+0000) 2019-10-23T12:52:18.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:18.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:18.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:18.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:19.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:19.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:19.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:19.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:20.078 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:20.074+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:20.075354+0000) 2019-10-23T12:52:20.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:20.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:20.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:20.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:21.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:21.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:21.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:21.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:22.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:22.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:22.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:22.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:23.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:23.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:23.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:23.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:24.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:52:24.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:24.592786+0000) 2019-10-23T12:52:24.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:52:24.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:24.591632+0000) 2019-10-23T12:52:24.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:24.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:24.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:24.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:25.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:52:25.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:25.552452+0000) 2019-10-23T12:52:25.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:25.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:25.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:25.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:26.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:52:26.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:26.590145+0000) 2019-10-23T12:52:26.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:26.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:26.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:26.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:27.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:27.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:27.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:27.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:28.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:52:28.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:28.069859+0000) 2019-10-23T12:52:28.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:28.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:28.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:28.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:29.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:29.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:29.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:29.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:30.078 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:30.074+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:30.075451+0000) 2019-10-23T12:52:30.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:30.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:30.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:30.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:31.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:31.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:31.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:31.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:32.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:32.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:32.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:32.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:33.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:33.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:33.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:33.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:34.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:52:34.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:34.592886+0000) 2019-10-23T12:52:34.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:52:34.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:34.591729+0000) 2019-10-23T12:52:34.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:34.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:34.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:34.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:35.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:52:35.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:35.552546+0000) 2019-10-23T12:52:35.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:35.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:35.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:35.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:36.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:52:36.588+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:36.590241+0000) 2019-10-23T12:52:36.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:36.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:36.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:36.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:37.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:37.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:37.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:37.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:38.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:52:38.068+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:38.069955+0000) 2019-10-23T12:52:38.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:38.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:38.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:38.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:39.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:39.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:39.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:39.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:40.078 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:40.074+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:40.075686+0000) 2019-10-23T12:52:40.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:40.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:40.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:40.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:41.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:41.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:41.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:41.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:42.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:42.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:42.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:42.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:43.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:43.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:43.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:43.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:44.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:44.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:44.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:44.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:44.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:52:44.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:44.592985+0000) 2019-10-23T12:52:44.596 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:52:44.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:44.591824+0000) 2019-10-23T12:52:45.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:52:45.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:45.552639+0000) 2019-10-23T12:52:45.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:45.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:45.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:45.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:46.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:46.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:46.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:46.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:46.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:52:46.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:46.590339+0000) 2019-10-23T12:52:47.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:47.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:47.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:47.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:48.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:52:48.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:48.070048+0000) 2019-10-23T12:52:48.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:48.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:48.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:48.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:49.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:49.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:49.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:49.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:50.078 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:52:50.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:50.075806+0000) 2019-10-23T12:52:50.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:50.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:50.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:50.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:51.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:51.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:51.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:51.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:52.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:52.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:52.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:52.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:53.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:53.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:53.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:53.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:54.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:54.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:54.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:54.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:54.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:52:54.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:54.593082+0000) 2019-10-23T12:52:54.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:52:54.590+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:54.591919+0000) 2019-10-23T12:52:55.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:55.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:55.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:55.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:55.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:52:55.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:55.552738+0000) 2019-10-23T12:52:56.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:56.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:56.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:56.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:56.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:52:56.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:56.590432+0000) 2019-10-23T12:52:57.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:57.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:57.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:57.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:58.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:52:58.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:52:58.070145+0000) 2019-10-23T12:52:58.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:58.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:58.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:58.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:52:59.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:59.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:52:59.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:52:59.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:00.078 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:53:00.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:00.075899+0000) 2019-10-23T12:53:00.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:00.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:00.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:00.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:01.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:01.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:01.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:01.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:02.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:02.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:02.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:02.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:03.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:03.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:03.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:03.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:04.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:04.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:04.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:04.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:04.595 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:53:04.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:04.593179+0000) 2019-10-23T12:53:04.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:53:04.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:04.592018+0000) 2019-10-23T12:53:05.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:05.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:05.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:05.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:05.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:53:05.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:05.552834+0000) 2019-10-23T12:53:06.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:06.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:06.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:06.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:06.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:53:06.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:06.590531+0000) 2019-10-23T12:53:07.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:07.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:07.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:07.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:08.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:53:08.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:08.070240+0000) 2019-10-23T12:53:08.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:08.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:08.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:08.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:09.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:09.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:09.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:09.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:10.078 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:53:10.074+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:10.076015+0000) 2019-10-23T12:53:10.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:10.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:10.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:10.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:11.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:11.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:11.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:11.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:12.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:12.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:12.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:12.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:13.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:13.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:13.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:13.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:14.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:14.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:14.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:14.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:14.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:53:14.591+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:14.593273+0000) 2019-10-23T12:53:14.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:53:14.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:14.592117+0000) 2019-10-23T12:53:15.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:15.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:15.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:15.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:15.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:53:15.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:15.552926+0000) 2019-10-23T12:53:16.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:16.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:16.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:16.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:16.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:53:16.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:16.590627+0000) 2019-10-23T12:53:17.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:17.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:17.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:17.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:18.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:53:18.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:18.070334+0000) 2019-10-23T12:53:18.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:18.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:18.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:18.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:19.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:19.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:19.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:19.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:20.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:53:20.074+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:20.076112+0000) 2019-10-23T12:53:20.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:20.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:20.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:20.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:21.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:21.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:42:48.073173+0000 (oldest deadline 2019-10-23T12:43:08.073173+0000) 2019-10-23T12:53:21.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:21.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:22.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:22.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:23.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:23.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:24.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:24.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:24.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:53:24.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:24.593372+0000) 2019-10-23T12:53:24.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:53:24.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:24.592213+0000) 2019-10-23T12:53:25.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:53:25.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:25.553020+0000) 2019-10-23T12:53:25.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:25.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:26.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:53:26.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:26.590720+0000) 2019-10-23T12:53:26.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:26.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:27.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:27.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:28.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:53:28.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:28.070433+0000) 2019-10-23T12:53:28.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:28.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:29.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:29.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:30.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:53:30.074+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:30.076232+0000) 2019-10-23T12:53:30.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:30.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:31.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:31.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:32.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:32.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:33.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:33.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:34.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:53:34.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:34.593469+0000) 2019-10-23T12:53:34.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:53:34.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:34.592310+0000) 2019-10-23T12:53:34.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:34.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:35.555 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:53:35.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:35.553109+0000) 2019-10-23T12:53:35.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:35.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:36.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:53:36.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:36.590814+0000) 2019-10-23T12:53:36.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:36.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:37.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:37.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:38.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:53:38.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:38.070528+0000) 2019-10-23T12:53:38.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:38.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:39.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:39.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:40.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:53:40.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:40.076326+0000) 2019-10-23T12:53:40.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:40.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:41.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:41.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:42.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:42.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:43.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:43.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:44.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:44.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:44.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:44.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:44.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:53:44.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:44.593566+0000) 2019-10-23T12:53:44.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:53:44.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:44.592406+0000) 2019-10-23T12:53:45.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:53:45.551+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:45.553204+0000) 2019-10-23T12:53:45.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:45.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:45.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:45.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:46.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:46.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:46.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:46.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:46.593 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:53:46.589+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:46.590912+0000) 2019-10-23T12:53:47.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:47.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:47.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:47.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:48.075 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:53:48.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:48.070620+0000) 2019-10-23T12:53:48.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:48.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:48.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:48.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:49.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:49.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:49.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:49.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:50.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:53:50.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:50.076420+0000) 2019-10-23T12:53:50.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:50.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:50.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:50.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:51.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:51.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:51.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:51.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:52.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:52.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:52.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:52.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:53.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:53.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:53.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:53.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:54.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:54.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:54.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:54.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:54.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:53:54.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:54.593704+0000) 2019-10-23T12:53:54.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:53:54.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:54.592501+0000) 2019-10-23T12:53:55.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:53:55.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:55.553322+0000) 2019-10-23T12:53:55.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:55.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:55.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:55.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:56.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:53:56.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:56.591048+0000) 2019-10-23T12:53:56.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:56.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:56.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:56.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:57.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:57.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:57.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:57.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:58.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:53:58.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:53:58.070716+0000) 2019-10-23T12:53:58.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:58.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:58.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:58.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:53:59.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:59.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:53:59.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:53:59.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:00.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:54:00.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:00.076563+0000) 2019-10-23T12:54:00.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:00.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:00.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:00.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:01.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:01.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:01.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:01.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:02.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:02.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:02.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:02.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:03.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:03.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:03.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:03.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:04.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:54:04.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:04.593874+0000) 2019-10-23T12:54:04.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:54:04.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:04.592598+0000) 2019-10-23T12:54:04.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:04.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:04.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:04.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:05.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:54:05.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:05.553503+0000) 2019-10-23T12:54:05.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:05.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:05.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:05.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:06.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:54:06.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:06.591227+0000) 2019-10-23T12:54:06.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:06.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:06.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:06.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:07.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:07.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:07.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:07.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:08.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:54:08.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:08.070811+0000) 2019-10-23T12:54:08.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:08.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:08.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:08.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:09.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:09.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:09.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:09.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:10.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:54:10.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:10.076757+0000) 2019-10-23T12:54:10.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:10.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:10.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:10.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:11.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:11.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:11.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:11.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:12.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:12.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:12.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:12.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:13.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:13.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:13.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:13.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:14.596 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:54:14.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:14.594021+0000) 2019-10-23T12:54:14.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:54:14.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:14.592695+0000) 2019-10-23T12:54:14.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:14.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:14.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:14.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:15.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:54:15.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:15.553646+0000) 2019-10-23T12:54:15.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:15.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:15.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:15.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:16.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:54:16.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:16.591386+0000) 2019-10-23T12:54:16.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:16.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:16.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:16.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:17.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:17.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:17.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:17.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:18.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:54:18.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:18.070908+0000) 2019-10-23T12:54:18.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:18.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:18.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:18.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:19.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:19.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:19.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:19.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:20.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:54:20.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:20.076906+0000) 2019-10-23T12:54:20.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:20.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:20.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:20.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:21.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:21.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:21.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:21.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:22.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:22.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:22.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:22.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:23.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:23.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:23.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:23.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:24.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:54:24.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:24.594119+0000) 2019-10-23T12:54:24.597 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:54:24.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:24.592791+0000) 2019-10-23T12:54:24.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:24.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:24.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:24.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:25.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:54:25.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:25.553741+0000) 2019-10-23T12:54:25.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:25.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:25.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:25.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:26.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:54:26.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:26.591479+0000) 2019-10-23T12:54:26.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:26.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:26.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:26.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:27.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:27.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:27.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:27.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:28.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:54:28.069+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:28.071004+0000) 2019-10-23T12:54:28.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:28.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:28.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:28.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:29.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:29.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:29.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:29.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:30.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:54:30.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:30.077003+0000) 2019-10-23T12:54:30.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:30.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:30.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:30.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:31.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:31.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:31.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:31.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:32.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:32.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:32.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:32.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:33.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:33.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:33.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:33.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:34.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:54:34.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:34.592897+0000) 2019-10-23T12:54:34.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:54:34.592+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:34.594227+0000) 2019-10-23T12:54:34.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:34.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:34.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:34.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:35.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:54:35.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:35.553836+0000) 2019-10-23T12:54:35.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:35.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:35.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:35.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:36.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:54:36.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:36.591579+0000) 2019-10-23T12:54:36.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:36.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:36.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:36.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:37.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:37.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:37.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:37.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:38.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:54:38.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:38.071107+0000) 2019-10-23T12:54:38.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:38.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:38.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:38.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:39.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:39.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:39.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:39.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:40.079 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:54:40.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:40.077105+0000) 2019-10-23T12:54:40.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:40.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:40.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:40.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:41.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:41.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:41.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:41.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:42.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:42.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:42.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:42.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:43.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:43.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:43.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:43.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:44.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:54:44.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:44.594341+0000) 2019-10-23T12:54:44.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:54:44.591+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:44.593005+0000) 2019-10-23T12:54:44.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:44.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:44.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:44.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:45.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:54:45.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:45.553937+0000) 2019-10-23T12:54:45.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:45.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:45.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:45.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:46.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:54:46.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:46.591678+0000) 2019-10-23T12:54:46.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:46.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:46.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:46.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:47.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:47.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:47.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:47.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:48.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:54:48.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:48.071203+0000) 2019-10-23T12:54:48.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:48.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:48.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:48.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:49.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:49.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:49.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:49.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:50.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:54:50.075+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:50.077207+0000) 2019-10-23T12:54:50.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:50.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:50.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:50.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:51.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:51.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:51.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:51.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:52.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:52.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:52.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:52.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:53.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:53.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:53.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:53.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:54.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:54:54.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:54.594441+0000) 2019-10-23T12:54:54.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:54:54.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:54.593102+0000) 2019-10-23T12:54:54.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:54.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:54.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:54.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:55.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:54:55.552+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:55.554030+0000) 2019-10-23T12:54:55.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:55.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:55.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:55.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:56.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:56.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:56.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:56.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:56.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:54:56.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:56.591773+0000) 2019-10-23T12:54:57.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:57.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:57.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:57.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:58.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:54:58.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:54:58.071298+0000) 2019-10-23T12:54:58.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:58.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:58.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:58.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:54:59.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:59.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:54:59.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:54:59.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:00.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:55:00.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:00.077304+0000) 2019-10-23T12:55:00.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:00.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:00.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:00.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:01.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:01.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:01.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:01.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:02.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:02.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:02.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:02.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:03.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:03.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:03.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:03.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:04.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:55:04.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:04.594536+0000) 2019-10-23T12:55:04.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:55:04.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:04.593198+0000) 2019-10-23T12:55:04.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:04.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:04.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:04.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:05.556 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:55:05.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:05.554123+0000) 2019-10-23T12:55:05.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:05.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:05.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:05.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:06.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:55:06.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:06.591868+0000) 2019-10-23T12:55:06.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:06.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:06.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:06.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:07.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:07.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:07.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:07.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:08.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:55:08.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:08.071397+0000) 2019-10-23T12:55:08.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:08.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:08.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:08.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:09.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:09.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:09.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:09.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:10.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:55:10.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:10.077403+0000) 2019-10-23T12:55:10.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:10.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:10.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:10.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:11.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:11.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:11.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:11.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:12.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:12.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:12.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:12.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:13.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:13.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:13.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:13.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:14.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:55:14.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:14.594637+0000) 2019-10-23T12:55:14.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:55:14.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:14.593294+0000) 2019-10-23T12:55:14.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:14.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:14.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:14.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:15.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:55:15.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:15.554217+0000) 2019-10-23T12:55:15.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:15.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:15.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:15.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:16.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:55:16.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:16.591958+0000) 2019-10-23T12:55:16.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:16.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:16.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:16.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:17.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:17.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:17.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:17.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:18.076 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:55:18.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:18.071494+0000) 2019-10-23T12:55:18.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:18.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:18.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:18.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:19.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:19.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:19.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:19.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:20.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:55:20.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:20.077500+0000) 2019-10-23T12:55:20.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:20.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:20.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:20.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:21.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:21.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:21.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:21.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:22.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:22.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:22.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:22.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:23.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:23.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:23.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:23.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:24.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:55:24.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:24.594737+0000) 2019-10-23T12:55:24.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:55:24.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:24.593386+0000) 2019-10-23T12:55:24.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:24.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:24.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:24.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:25.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:55:25.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:25.554314+0000) 2019-10-23T12:55:25.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:25.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:25.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:25.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:26.594 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:55:26.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:26.592053+0000) 2019-10-23T12:55:26.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:26.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:26.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:26.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:27.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:27.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:27.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:27.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:28.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:55:28.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:28.071591+0000) 2019-10-23T12:55:28.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:28.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:28.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:28.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:29.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:29.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:29.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:29.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:30.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:55:30.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:30.077595+0000) 2019-10-23T12:55:30.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:30.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:30.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:30.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:31.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:31.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:31.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:31.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:32.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:32.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:32.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:32.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:33.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:33.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:33.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:33.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:34.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:55:34.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:34.594832+0000) 2019-10-23T12:55:34.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:55:34.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:34.593478+0000) 2019-10-23T12:55:34.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:34.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:34.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:34.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:35.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:55:35.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:35.554408+0000) 2019-10-23T12:55:35.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:35.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:35.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:35.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:36.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:55:36.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:36.592149+0000) 2019-10-23T12:55:36.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:36.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:36.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:36.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:37.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:37.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:37.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:37.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:38.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:55:38.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:38.071689+0000) 2019-10-23T12:55:38.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:38.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:38.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:38.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:39.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:39.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:39.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:39.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:40.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:55:40.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:40.077697+0000) 2019-10-23T12:55:40.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:40.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:40.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:40.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:41.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:41.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:41.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:41.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:42.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:42.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:42.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:42.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:43.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:43.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:43.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:43.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:44.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:55:44.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:44.594930+0000) 2019-10-23T12:55:44.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:55:44.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:44.593574+0000) 2019-10-23T12:55:44.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:44.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:44.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:44.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:45.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:55:45.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:45.554502+0000) 2019-10-23T12:55:45.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:45.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:45.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:45.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:46.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:55:46.590+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:46.592242+0000) 2019-10-23T12:55:46.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:46.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:46.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:46.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:47.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:47.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:47.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:47.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:48.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:55:48.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:48.071789+0000) 2019-10-23T12:55:48.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:48.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:48.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:48.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:49.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:49.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:49.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:49.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:50.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:55:50.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:50.077798+0000) 2019-10-23T12:55:50.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:50.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:50.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:50.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:51.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:51.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:51.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:51.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:52.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:52.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:52.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:52.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:53.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:53.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:53.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:53.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:54.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:54.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:54.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:54.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:54.597 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:55:54.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:54.595026+0000) 2019-10-23T12:55:54.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:55:54.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:54.593666+0000) 2019-10-23T12:55:55.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:55:55.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:55.554593+0000) 2019-10-23T12:55:55.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:55.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:55.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:55.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:56.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:56.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:56.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:56.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:56.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:55:56.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:56.592336+0000) 2019-10-23T12:55:57.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:57.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:57.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:57.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:58.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:55:58.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:55:58.071886+0000) 2019-10-23T12:55:58.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:58.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:58.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:58.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:55:59.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:59.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:55:59.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:55:59.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:00.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:56:00.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:00.077895+0000) 2019-10-23T12:56:00.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:00.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:00.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:00.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:01.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:01.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:01.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:01.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:02.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:02.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:02.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:02.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:03.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:03.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:03.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:03.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:04.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:04.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:04.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:04.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:04.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:56:04.593+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:04.595123+0000) 2019-10-23T12:56:04.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:56:04.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:04.593763+0000) 2019-10-23T12:56:05.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:05.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:05.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:05.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:05.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:56:05.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:05.554686+0000) 2019-10-23T12:56:06.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:06.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:06.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:06.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:06.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:56:06.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:06.592430+0000) 2019-10-23T12:56:07.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:07.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:07.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:07.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:08.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:56:08.070+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:08.071983+0000) 2019-10-23T12:56:08.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:08.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:08.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:08.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:09.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:09.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:09.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:09.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:10.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:56:10.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:10.077991+0000) 2019-10-23T12:56:10.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:10.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:10.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:10.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:11.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:11.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:11.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:11.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:12.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:12.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:12.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:12.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:13.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:13.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:13.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:13.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:14.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:14.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:14.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:14.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:14.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:56:14.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:14.595220+0000) 2019-10-23T12:56:14.598 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:56:14.592+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:14.593856+0000) 2019-10-23T12:56:15.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:15.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:15.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:15.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:15.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:56:15.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:15.554780+0000) 2019-10-23T12:56:16.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:16.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:16.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:16.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:16.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:56:16.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:16.592525+0000) 2019-10-23T12:56:17.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:17.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:17.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:17.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:18.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:56:18.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:18.072083+0000) 2019-10-23T12:56:18.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:18.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:18.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:18.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:19.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:19.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:19.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:19.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:20.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:56:20.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:20.078088+0000) 2019-10-23T12:56:20.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:20.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:20.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:20.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:21.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:21.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:21.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:21.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:22.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:22.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:22.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:22.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:23.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:23.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:23.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:23.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:24.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:24.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:24.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:24.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:24.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:56:24.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:24.595318+0000) 2019-10-23T12:56:24.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:56:24.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:24.593948+0000) 2019-10-23T12:56:25.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:25.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:25.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:25.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:25.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:56:25.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:25.554875+0000) 2019-10-23T12:56:26.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:26.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:26.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:26.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:26.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:56:26.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:26.592618+0000) 2019-10-23T12:56:27.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:27.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:27.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:27.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:28.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:56:28.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:28.072182+0000) 2019-10-23T12:56:28.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:28.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:28.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:28.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:29.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:29.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:29.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:29.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:30.080 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:56:30.076+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:30.078185+0000) 2019-10-23T12:56:30.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:30.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:30.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:30.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:31.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:31.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:31.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:31.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:32.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:32.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:32.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:32.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:33.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:33.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:33.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:33.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:34.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:34.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:34.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:34.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:34.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:56:34.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:34.595416+0000) 2019-10-23T12:56:34.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:56:34.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:34.594043+0000) 2019-10-23T12:56:35.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:35.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:35.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:35.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:35.557 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:56:35.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:35.554967+0000) 2019-10-23T12:56:36.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:36.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:36.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:36.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:36.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:56:36.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:36.592713+0000) 2019-10-23T12:56:37.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:37.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:37.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:37.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:38.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:56:38.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:38.072277+0000) 2019-10-23T12:56:38.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:38.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:38.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:38.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:39.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:39.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:39.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:39.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:40.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:56:40.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:40.078282+0000) 2019-10-23T12:56:40.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:40.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:40.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:40.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:41.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:41.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:41.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:41.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:42.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:42.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:42.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:42.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:43.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:43.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:43.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:43.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:44.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:44.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:44.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:44.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:44.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:56:44.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:44.595510+0000) 2019-10-23T12:56:44.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:56:44.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:44.594135+0000) 2019-10-23T12:56:45.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:45.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:45.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:45.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:45.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:56:45.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:45.555064+0000) 2019-10-23T12:56:46.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:46.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:46.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:46.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:46.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:56:46.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:46.592808+0000) 2019-10-23T12:56:47.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:47.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:47.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:47.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:48.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:56:48.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:48.072375+0000) 2019-10-23T12:56:48.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:48.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:48.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:48.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:49.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:49.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:49.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:49.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:50.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:56:50.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:50.078381+0000) 2019-10-23T12:56:50.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:50.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:50.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:50.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:51.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:51.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:51.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:51.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:52.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:52.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:52.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:52.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:53.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:53.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:53.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:53.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:54.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:54.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:54.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:54.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:54.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:56:54.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:54.595601+0000) 2019-10-23T12:56:54.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:56:54.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:54.594225+0000) 2019-10-23T12:56:55.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:55.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:55.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:55.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:55.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:56:55.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:55.555159+0000) 2019-10-23T12:56:56.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:56.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:56.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:56.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:56.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:56:56.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:56.592899+0000) 2019-10-23T12:56:57.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:57.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:57.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:57.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:58.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:56:58.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:56:58.072474+0000) 2019-10-23T12:56:58.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:58.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:58.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:58.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:56:59.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:59.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:56:59.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:56:59.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:00.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:57:00.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:00.078479+0000) 2019-10-23T12:57:00.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:00.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:00.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:00.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:01.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:01.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:01.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:01.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:02.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:02.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:02.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:02.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:03.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:03.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:03.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:03.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:04.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:04.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:04.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:04.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:04.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:57:04.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:04.595695+0000) 2019-10-23T12:57:04.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:57:04.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:04.594316+0000) 2019-10-23T12:57:05.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:05.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:05.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:05.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:05.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:57:05.553+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:05.555255+0000) 2019-10-23T12:57:06.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:06.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:06.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:06.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:06.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:57:06.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:06.592992+0000) 2019-10-23T12:57:07.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:07.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:07.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:07.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:08.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:57:08.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:08.072571+0000) 2019-10-23T12:57:08.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:08.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:08.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:08.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:09.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:09.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:09.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:09.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:10.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:57:10.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:10.078578+0000) 2019-10-23T12:57:10.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:10.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:10.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:10.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:11.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:11.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:11.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:11.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:12.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:12.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:12.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:12.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:13.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:13.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:13.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:13.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:14.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:14.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:14.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:14.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:14.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:57:14.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:14.595792+0000) 2019-10-23T12:57:14.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:57:14.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:14.594409+0000) 2019-10-23T12:57:15.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:15.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:15.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:15.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:15.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:57:15.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:15.555347+0000) 2019-10-23T12:57:16.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:16.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:16.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:16.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:16.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:57:16.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:16.593087+0000) 2019-10-23T12:57:17.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:17.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:17.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:17.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:18.077 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:57:18.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:18.072669+0000) 2019-10-23T12:57:18.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:18.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:18.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:18.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:19.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:19.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:19.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:19.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:20.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:57:20.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:20.078678+0000) 2019-10-23T12:57:20.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:20.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:20.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:20.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:21.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:21.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:21.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:21.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:22.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:22.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:22.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:22.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:23.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:23.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:23.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:23.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:24.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:24.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:24.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:24.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:24.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:57:24.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:24.595887+0000) 2019-10-23T12:57:24.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:57:24.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:24.594502+0000) 2019-10-23T12:57:25.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:25.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:25.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:25.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:25.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:57:25.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:25.555443+0000) 2019-10-23T12:57:26.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:26.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:26.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:26.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:26.595 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:57:26.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:26.593183+0000) 2019-10-23T12:57:27.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:27.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:27.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:27.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:28.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:57:28.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:28.072766+0000) 2019-10-23T12:57:28.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:28.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:28.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:28.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:29.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:29.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:29.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:29.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:30.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:57:30.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:30.078775+0000) 2019-10-23T12:57:30.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:30.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:30.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:30.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:31.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:31.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:31.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:31.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:32.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:32.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:32.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:32.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:33.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:33.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:33.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:33.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:34.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:34.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:34.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:34.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:34.598 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:57:34.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:34.595983+0000) 2019-10-23T12:57:34.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:57:34.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:34.594594+0000) 2019-10-23T12:57:35.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:35.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:35.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:35.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:35.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:57:35.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:35.555537+0000) 2019-10-23T12:57:36.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:36.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:36.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:36.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:36.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:57:36.591+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:36.593278+0000) 2019-10-23T12:57:37.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:37.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:37.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:37.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:38.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:57:38.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:38.072860+0000) 2019-10-23T12:57:38.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:38.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:38.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:38.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:39.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:39.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:39.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:39.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:40.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:57:40.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:40.078876+0000) 2019-10-23T12:57:40.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:40.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:40.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:40.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:41.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:41.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:41.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:41.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:42.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:42.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:42.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:42.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:43.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:43.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:43.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:43.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:44.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:44.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:44.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:44.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:44.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:57:44.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:44.596044+0000) 2019-10-23T12:57:44.599 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:57:44.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:44.594687+0000) 2019-10-23T12:57:45.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:45.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:45.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:45.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:45.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:57:45.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:45.555634+0000) 2019-10-23T12:57:46.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:46.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:46.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:46.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:46.601 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:57:46.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:46.593379+0000) 2019-10-23T12:57:47.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:47.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:47.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:47.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:48.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:57:48.071+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:48.072957+0000) 2019-10-23T12:57:48.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:48.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:48.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:48.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:49.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:49.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:49.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:49.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:50.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:57:50.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:50.078974+0000) 2019-10-23T12:57:50.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:50.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:50.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:50.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:51.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:51.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:51.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:51.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:52.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:52.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:52.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:52.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:53.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:53.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:53.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:53.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:54.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:54.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:54.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:54.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:54.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:57:54.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:54.596140+0000) 2019-10-23T12:57:54.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:57:54.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:54.594779+0000) 2019-10-23T12:57:55.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:55.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:55.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:55.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:55.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:57:55.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:55.555727+0000) 2019-10-23T12:57:56.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:56.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:56.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:56.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:56.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:57:56.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:56.593473+0000) 2019-10-23T12:57:57.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:57.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:57.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:57.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:58.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:57:58.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:57:58.073055+0000) 2019-10-23T12:57:58.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:58.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:58.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:58.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:57:59.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:59.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:57:59.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:57:59.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:00.081 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:58:00.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:00.079067+0000) 2019-10-23T12:58:00.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:00.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:00.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:00.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:01.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:01.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:01.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:01.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:02.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:02.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:02.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:02.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:03.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:03.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:03.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:03.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:04.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:04.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:04.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:04.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:04.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:58:04.594+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:04.596238+0000) 2019-10-23T12:58:04.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:58:04.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:04.594874+0000) 2019-10-23T12:58:05.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:05.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:05.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:05.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:05.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:58:05.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:05.555825+0000) 2019-10-23T12:58:06.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:06.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:06.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:06.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:06.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:58:06.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:06.593569+0000) 2019-10-23T12:58:07.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:07.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:07.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:07.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:08.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:58:08.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:08.073153+0000) 2019-10-23T12:58:08.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:08.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:08.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:08.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:09.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:09.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:09.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:09.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:10.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:58:10.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:10.079166+0000) 2019-10-23T12:58:10.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:10.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:10.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:10.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:11.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:11.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:11.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:11.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:12.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:12.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:12.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:12.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:13.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:13.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:13.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:13.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:14.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:14.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:14.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:14.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:14.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:58:14.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:14.596334+0000) 2019-10-23T12:58:14.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:58:14.593+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:14.594968+0000) 2019-10-23T12:58:15.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:15.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:15.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:15.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:15.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:58:15.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:15.555917+0000) 2019-10-23T12:58:16.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:16.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:16.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:16.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:16.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:58:16.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:16.593664+0000) 2019-10-23T12:58:17.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:17.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:17.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:17.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:18.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:58:18.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:18.073249+0000) 2019-10-23T12:58:18.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:18.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:18.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:18.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:19.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:19.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:19.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:19.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:20.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:58:20.077+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:20.079262+0000) 2019-10-23T12:58:20.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:20.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:20.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:20.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:21.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:21.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:21.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:21.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:22.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:22.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:22.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:22.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:23.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:23.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:23.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:23.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:24.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:58:24.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:24.596430+0000) 2019-10-23T12:58:24.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:58:24.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:24.595061+0000) 2019-10-23T12:58:24.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:24.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:24.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:24.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:25.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:58:25.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:25.556012+0000) 2019-10-23T12:58:25.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:25.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:25.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:25.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:26.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:58:26.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:26.593756+0000) 2019-10-23T12:58:26.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:26.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:26.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:26.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:27.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:27.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:27.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:27.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:28.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:58:28.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:28.073348+0000) 2019-10-23T12:58:28.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:28.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:28.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:28.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:29.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:29.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:29.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:29.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:30.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:58:30.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:30.079358+0000) 2019-10-23T12:58:30.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:30.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:30.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:30.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:31.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:31.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:31.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:31.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:32.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:32.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:32.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:32.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:33.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:33.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:33.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:33.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:34.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:58:34.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:34.596527+0000) 2019-10-23T12:58:34.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:58:34.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:34.595155+0000) 2019-10-23T12:58:34.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:34.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:34.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:34.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:35.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:58:35.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:35.556105+0000) 2019-10-23T12:58:35.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:35.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:35.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:35.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:36.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:36.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:36.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:36.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:36.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:58:36.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:36.593846+0000) 2019-10-23T12:58:37.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:37.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:37.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:37.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:38.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:58:38.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:38.073445+0000) 2019-10-23T12:58:38.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:38.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:38.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:38.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:39.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:39.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:39.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:39.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:40.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:58:40.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:40.079453+0000) 2019-10-23T12:58:40.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:40.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:40.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:40.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:41.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:41.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:41.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:41.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:42.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:42.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:42.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:42.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:43.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:43.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:43.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:43.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:44.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:58:44.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:44.596623+0000) 2019-10-23T12:58:44.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:58:44.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:44.595247+0000) 2019-10-23T12:58:44.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:44.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:44.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:44.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:45.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:58:45.554+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:45.556200+0000) 2019-10-23T12:58:45.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:45.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:45.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:45.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:46.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:58:46.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:46.593942+0000) 2019-10-23T12:58:46.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:46.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:46.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:46.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:47.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:47.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:47.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:47.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:48.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:58:48.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:48.073537+0000) 2019-10-23T12:58:48.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:48.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:48.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:48.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:49.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:49.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:49.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:49.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:50.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:58:50.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:50.079561+0000) 2019-10-23T12:58:50.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:50.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:50.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:50.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:51.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:51.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:51.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:51.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:52.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:52.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:52.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:52.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:53.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:53.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:53.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:53.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:54.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:54.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:54.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:54.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:54.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:58:54.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:54.596718+0000) 2019-10-23T12:58:54.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:58:54.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:54.595335+0000) 2019-10-23T12:58:55.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:55.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:55.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:55.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:55.558 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:58:55.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:55.556295+0000) 2019-10-23T12:58:56.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:56.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:56.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:56.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:56.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:58:56.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:56.594033+0000) 2019-10-23T12:58:57.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:57.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:57.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:57.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:58.078 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:58:58.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:58:58.073629+0000) 2019-10-23T12:58:58.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:58.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:58.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:58.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:58:59.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:59.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:58:59.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:58:59.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:00.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:59:00.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:00.079691+0000) 2019-10-23T12:59:00.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:00.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:00.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:00.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:01.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:01.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:01.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:01.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:02.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:02.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:02.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:02.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:03.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:03.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:03.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:03.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:04.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:04.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:04.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:04.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:04.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:59:04.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:04.596815+0000) 2019-10-23T12:59:04.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:59:04.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:04.595424+0000) 2019-10-23T12:59:05.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:05.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:05.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:05.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:05.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:59:05.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:05.556389+0000) 2019-10-23T12:59:06.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:06.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:06.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:06.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:06.596 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:59:06.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:06.594129+0000) 2019-10-23T12:59:07.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:07.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:07.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:07.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:08.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:59:08.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:08.073724+0000) 2019-10-23T12:59:08.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:08.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:08.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:08.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:09.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:09.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:09.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:09.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:10.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:59:10.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:10.079788+0000) 2019-10-23T12:59:10.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:10.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:10.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:10.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:11.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:11.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:11.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:11.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:12.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:12.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:12.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:12.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:13.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:13.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:13.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:13.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:14.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:14.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:14.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:14.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:14.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:59:14.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:14.596912+0000) 2019-10-23T12:59:14.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:59:14.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:14.595513+0000) 2019-10-23T12:59:15.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:15.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:15.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:15.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:15.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:59:15.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:15.556481+0000) 2019-10-23T12:59:16.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:16.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:16.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:16.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:16.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:59:16.592+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:16.594229+0000) 2019-10-23T12:59:17.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:17.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:17.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:17.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:18.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:59:18.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:18.073820+0000) 2019-10-23T12:59:18.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:18.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:18.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:18.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:19.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:19.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:19.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:19.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:20.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:59:20.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:20.079886+0000) 2019-10-23T12:59:20.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:20.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:20.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:20.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:21.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:21.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:21.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:21.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:22.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:22.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:22.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:22.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:23.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:23.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:23.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:23.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:24.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:24.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:24.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:24.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:24.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:59:24.595+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:24.597013+0000) 2019-10-23T12:59:24.600 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:59:24.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:24.595605+0000) 2019-10-23T12:59:25.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:25.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:25.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:25.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:25.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:59:25.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:25.556573+0000) 2019-10-23T12:59:26.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:26.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:26.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:26.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:26.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:59:26.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:26.594324+0000) 2019-10-23T12:59:27.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:27.478+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:27.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:27.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:28.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:59:28.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:28.073914+0000) 2019-10-23T12:59:28.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:28.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:28.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:28.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:29.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:29.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:29.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:29.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:30.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:59:30.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:30.079986+0000) 2019-10-23T12:59:30.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:30.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:30.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:30.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:31.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:31.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:31.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:31.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:32.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:32.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:32.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:32.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:33.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:33.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:33.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:33.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:34.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:34.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:34.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:34.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:34.599 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:59:34.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:34.597109+0000) 2019-10-23T12:59:34.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:59:34.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:34.595697+0000) 2019-10-23T12:59:35.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:35.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:35.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:35.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:35.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:59:35.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:35.556664+0000) 2019-10-23T12:59:36.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:36.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:36.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:36.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:36.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:59:36.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:36.594417+0000) 2019-10-23T12:59:37.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:37.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:37.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:37.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:38.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:59:38.072+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:38.074006+0000) 2019-10-23T12:59:38.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:38.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:38.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:38.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:39.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:39.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:39.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:39.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:40.082 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:59:40.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:40.080082+0000) 2019-10-23T12:59:40.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:40.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:40.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:40.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:41.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:41.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:41.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:41.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:42.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:42.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:42.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:42.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:43.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:43.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:43.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:43.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:44.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:44.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:44.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:44.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:44.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:59:44.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:44.597201+0000) 2019-10-23T12:59:44.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:59:44.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:44.595786+0000) 2019-10-23T12:59:45.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:45.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:45.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:45.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:45.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:59:45.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:45.556760+0000) 2019-10-23T12:59:46.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:46.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:46.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:46.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:46.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:59:46.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:46.594510+0000) 2019-10-23T12:59:47.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:47.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:47.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:47.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:48.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:59:48.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:48.074109+0000) 2019-10-23T12:59:48.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:48.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:48.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:48.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:49.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:49.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:49.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:49.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:50.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T12:59:50.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:50.080178+0000) 2019-10-23T12:59:50.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:50.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:50.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:50.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:51.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:51.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:51.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:51.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:52.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:52.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:52.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:52.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:53.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:53.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:53.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:53.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:54.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:54.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:54.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:54.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:54.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T12:59:54.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:54.595879+0000) 2019-10-23T12:59:54.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T12:59:54.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:54.597297+0000) 2019-10-23T12:59:55.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:55.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:55.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:55.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:55.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T12:59:55.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:55.556852+0000) 2019-10-23T12:59:56.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:56.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:56.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:56.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:56.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T12:59:56.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:56.594605+0000) 2019-10-23T12:59:57.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:57.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:57.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:57.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:58.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T12:59:58.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T11:59:58.074206+0000) 2019-10-23T12:59:58.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:58.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:58.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:58.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T12:59:59.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:59.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T12:59:59.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T12:59:59.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:00.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:00:00.078+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:00.080271+0000) 2019-10-23T13:00:00.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:00.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:00.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:00.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:01.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:01.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:01.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:01.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:02.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:02.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:02.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:02.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:03.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:03.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:03.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:03.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:04.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:04.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:04.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:04.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:04.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:00:04.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:04.597392+0000) 2019-10-23T13:00:04.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:00:04.594+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:04.595970+0000) 2019-10-23T13:00:05.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:05.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:05.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:05.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:05.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:00:05.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:05.556947+0000) 2019-10-23T13:00:06.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:06.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:06.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:06.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:06.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:00:06.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:06.594696+0000) 2019-10-23T13:00:07.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:07.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:07.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:07.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:08.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:00:08.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:08.074307+0000) 2019-10-23T13:00:08.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:08.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:08.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:08.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:09.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:09.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:09.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:09.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:10.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:00:10.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:10.080374+0000) 2019-10-23T13:00:10.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:10.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:10.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:10.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:11.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:11.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:11.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:11.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:12.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:12.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:12.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:12.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:13.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:13.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:13.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:13.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:14.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:14.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:14.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:14.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:14.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:00:14.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:14.597488+0000) 2019-10-23T13:00:14.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:00:14.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:14.596063+0000) 2019-10-23T13:00:15.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:15.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:15.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:15.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:15.559 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:00:15.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:15.557044+0000) 2019-10-23T13:00:16.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:16.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:16.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:16.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:16.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:00:16.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:16.594790+0000) 2019-10-23T13:00:17.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:17.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:17.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:17.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:18.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:00:18.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:18.074401+0000) 2019-10-23T13:00:18.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:18.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:18.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:18.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:19.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:19.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:19.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:19.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:20.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:00:20.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:20.080470+0000) 2019-10-23T13:00:20.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:20.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:20.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:20.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:21.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:21.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:21.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:21.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:22.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:22.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:22.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:22.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:23.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:23.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:23.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:23.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:24.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:24.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:24.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:24.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:24.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:00:24.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:24.597584+0000) 2019-10-23T13:00:24.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:00:24.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:24.596158+0000) 2019-10-23T13:00:25.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:25.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:25.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:25.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:25.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:00:25.555+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:25.557134+0000) 2019-10-23T13:00:26.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:26.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:26.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:26.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:26.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:00:26.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:26.594882+0000) 2019-10-23T13:00:27.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:27.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:27.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:27.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:28.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:00:28.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:28.074498+0000) 2019-10-23T13:00:28.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:28.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:28.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:28.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:29.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:29.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:29.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:29.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:30.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:00:30.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:30.080568+0000) 2019-10-23T13:00:30.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:30.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:30.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:30.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:31.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:31.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:31.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:31.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:32.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:32.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:32.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:32.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:33.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:33.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:33.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:33.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:34.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:34.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:34.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:34.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:34.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:00:34.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:34.597677+0000) 2019-10-23T13:00:34.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:00:34.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:34.596248+0000) 2019-10-23T13:00:35.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:35.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:35.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:35.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:35.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:00:35.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:35.557224+0000) 2019-10-23T13:00:36.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:36.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:36.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:36.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:36.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:00:36.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:36.594974+0000) 2019-10-23T13:00:37.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:37.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:37.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:37.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:38.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:00:38.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:38.074596+0000) 2019-10-23T13:00:38.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:38.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:38.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:38.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:39.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:39.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:39.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:39.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:40.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:00:40.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:40.080668+0000) 2019-10-23T13:00:40.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:40.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:40.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:40.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:41.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:41.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:41.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:41.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:42.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:42.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:42.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:42.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:43.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:43.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:43.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:43.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:44.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:44.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:44.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:44.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:44.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:00:44.597+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:44.597772+0000) 2019-10-23T13:00:44.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:00:44.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:44.596340+0000) 2019-10-23T13:00:45.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:45.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:45.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:45.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:45.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:00:45.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:45.557321+0000) 2019-10-23T13:00:46.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:46.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:46.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:46.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:46.597 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:00:46.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:46.595071+0000) 2019-10-23T13:00:47.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:47.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:47.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:47.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:48.079 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:00:48.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:48.074694+0000) 2019-10-23T13:00:48.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:48.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:48.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:48.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:49.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:49.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:49.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:49.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:50.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:00:50.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:50.080764+0000) 2019-10-23T13:00:50.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:50.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:50.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:50.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:51.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:51.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:51.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:51.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:52.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:52.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:52.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:52.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:53.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:53.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:53.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:53.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:54.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:54.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:54.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:54.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:54.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:00:54.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:54.597871+0000) 2019-10-23T13:00:54.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:00:54.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:54.596431+0000) 2019-10-23T13:00:55.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:55.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:55.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:55.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:55.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:00:55.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:55.557417+0000) 2019-10-23T13:00:56.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:56.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:56.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:56.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:56.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:00:56.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:56.595164+0000) 2019-10-23T13:00:57.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:57.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:57.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:57.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:58.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:00:58.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:00:58.074792+0000) 2019-10-23T13:00:58.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:58.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:58.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:58.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:00:59.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:59.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:00:59.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:00:59.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:00.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:01:00.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:00.080857+0000) 2019-10-23T13:01:00.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:00.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:00.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:00.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:01.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:01.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:01.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:01.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:02.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:02.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:02.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:02.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:03.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:03.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:03.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:03.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:04.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:04.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:04.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:04.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:04.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:01:04.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:04.597972+0000) 2019-10-23T13:01:04.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:01:04.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:04.596524+0000) 2019-10-23T13:01:05.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:05.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:05.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:05.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:05.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:01:05.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:05.557513+0000) 2019-10-23T13:01:06.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:06.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:06.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:06.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:06.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:01:06.593+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:06.595256+0000) 2019-10-23T13:01:07.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:07.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:07.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:07.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:08.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:01:08.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:08.074887+0000) 2019-10-23T13:01:08.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:08.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:08.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:08.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:09.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:09.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:09.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:09.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:10.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:01:10.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:10.080956+0000) 2019-10-23T13:01:10.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:10.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:10.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:10.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:11.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:11.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:11.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:11.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:12.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:12.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:12.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:12.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:13.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:13.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:13.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:13.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:14.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:14.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:14.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:14.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:14.600 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:01:14.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:14.598072+0000) 2019-10-23T13:01:14.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:01:14.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:14.596618+0000) 2019-10-23T13:01:15.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:15.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:15.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:15.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:15.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:01:15.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:15.557607+0000) 2019-10-23T13:01:16.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:16.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:16.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:16.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:16.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:01:16.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:16.595352+0000) 2019-10-23T13:01:17.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:17.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:17.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:17.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:18.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:18.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:18.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:18.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:18.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:01:18.073+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:18.074986+0000) 2019-10-23T13:01:19.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:19.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:19.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:19.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:20.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:20.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:20.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:20.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:20.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:01:20.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:20.081054+0000) 2019-10-23T13:01:21.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:21.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:21.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:21.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:22.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:22.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:22.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:22.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:23.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:23.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:23.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:23.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:24.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:24.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:24.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:24.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:24.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:01:24.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:24.598170+0000) 2019-10-23T13:01:24.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:01:24.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:24.596714+0000) 2019-10-23T13:01:25.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:25.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:25.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:25.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:25.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:01:25.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:25.557697+0000) 2019-10-23T13:01:26.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:26.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:26.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:26.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:26.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:01:26.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:26.595446+0000) 2019-10-23T13:01:27.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:27.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:27.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:27.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:28.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:28.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:28.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:28.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:28.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:01:28.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:28.075087+0000) 2019-10-23T13:01:29.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:29.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:29.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:29.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:30.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:30.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:30.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:30.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:30.083 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:01:30.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:30.081151+0000) 2019-10-23T13:01:31.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:31.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:31.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:31.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:31.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:31.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:31.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:31.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:32.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:32.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:32.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:32.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:34.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:34.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:34.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:34.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:34.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:01:34.596+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:34.598269+0000) 2019-10-23T13:01:34.601 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:01:34.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:34.596807+0000) 2019-10-23T13:01:35.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:35.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:35.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:35.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:35.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:01:35.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:35.557794+0000) 2019-10-23T13:01:36.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:36.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:36.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:36.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:36.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:01:36.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:36.595541+0000) 2019-10-23T13:01:37.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:37.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:37.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:37.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:38.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:38.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:38.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:38.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:38.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:01:38.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:38.075182+0000) 2019-10-23T13:01:39.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:39.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:39.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:39.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:40.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:40.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:40.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:40.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:40.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:01:40.079+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:40.081252+0000) 2019-10-23T13:01:40.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:40.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:40.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:40.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:41.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:41.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:41.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:41.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:42.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:42.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:42.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:42.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:43.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:43.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:43.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:43.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:44.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:01:44.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:44.598369+0000) 2019-10-23T13:01:44.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:01:44.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:44.596904+0000) 2019-10-23T13:01:45.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:45.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:45.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:45.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:45.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:01:45.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:45.557882+0000) 2019-10-23T13:01:46.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:46.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:46.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:46.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:46.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:01:46.595+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:46.595635+0000) 2019-10-23T13:01:47.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:47.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:47.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:47.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:48.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:48.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:48.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:01:48.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:48.075279+0000) 2019-10-23T13:01:49.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:49.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:49.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:49.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:49.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:49.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:49.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:49.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:50.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:01:50.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:50.081351+0000) 2019-10-23T13:01:50.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:50.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:50.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:50.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:51.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:51.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:51.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:51.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:52.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:52.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:52.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:52.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:53.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:53.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:53.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:53.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:54.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:01:54.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:54.598465+0000) 2019-10-23T13:01:54.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:01:54.595+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:54.596998+0000) 2019-10-23T13:01:54.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:54.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:54.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:54.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:55.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:01:55.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:55.557978+0000) 2019-10-23T13:01:55.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:55.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:55.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:55.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:56.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:01:56.595+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:56.595728+0000) 2019-10-23T13:01:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:56.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:56.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:57.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:57.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:57.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:57.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:58.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:01:58.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:01:58.075371+0000) 2019-10-23T13:01:58.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:58.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:58.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:58.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:01:59.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:59.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:01:59.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:01:59.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:00.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:02:00.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:00.081449+0000) 2019-10-23T13:02:00.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:00.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:00.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:00.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:01.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:01.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:01.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:01.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:02.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:02.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:02.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:02.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:03.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:03.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:03.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:03.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:04.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:02:04.597+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:04.598559+0000) 2019-10-23T13:02:04.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:02:04.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:04.597097+0000) 2019-10-23T13:02:04.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:04.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:04.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:04.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:05.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:02:05.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:05.558069+0000) 2019-10-23T13:02:05.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:05.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:05.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:05.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:06.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:06.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:06.595823+0000) 2019-10-23T13:02:06.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:06.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:06.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:06.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:07.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:07.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:07.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:07.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:08.080 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:02:08.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:08.075465+0000) 2019-10-23T13:02:08.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:08.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:08.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:08.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:09.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:09.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:09.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:09.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:10.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:02:10.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:10.081551+0000) 2019-10-23T13:02:10.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:10.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:10.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:10.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:11.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:11.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:11.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:11.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:12.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:12.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:12.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:12.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:13.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:13.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:13.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:13.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:14.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:02:14.597+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:14.598652+0000) 2019-10-23T13:02:14.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:02:14.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:14.597189+0000) 2019-10-23T13:02:14.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:14.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:14.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:14.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:15.560 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:02:15.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:15.558163+0000) 2019-10-23T13:02:15.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:15.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:15.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:15.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:16.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:16.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:16.595920+0000) 2019-10-23T13:02:16.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:16.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:16.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:16.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:17.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:17.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:17.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:17.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:18.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:02:18.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:18.075563+0000) 2019-10-23T13:02:18.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:18.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:18.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:18.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:19.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:19.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:19.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:19.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:20.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:02:20.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:20.081646+0000) 2019-10-23T13:02:20.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:20.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:20.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:20.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:21.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:21.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:21.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:21.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:22.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:22.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:22.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:22.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:23.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:23.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:23.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:23.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:24.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:02:24.597+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:24.598751+0000) 2019-10-23T13:02:24.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:02:24.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:24.597282+0000) 2019-10-23T13:02:24.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:24.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:24.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:24.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:25.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:02:25.556+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:25.558259+0000) 2019-10-23T13:02:25.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:25.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:25.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:25.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:26.598 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:26.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:26.596016+0000) 2019-10-23T13:02:26.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:26.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:26.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:26.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:27.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:27.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:27.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:27.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:28.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:02:28.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:28.075658+0000) 2019-10-23T13:02:28.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:28.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:28.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:28.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:29.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:29.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:29.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:29.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:30.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:02:30.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:30.081744+0000) 2019-10-23T13:02:30.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:30.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:30.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:30.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:31.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:31.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:31.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:31.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:32.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:32.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:32.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:32.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:33.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:33.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:33.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:33.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:34.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:02:34.597+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:34.598849+0000) 2019-10-23T13:02:34.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:02:34.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:34.597376+0000) 2019-10-23T13:02:34.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:34.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:34.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:34.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:35.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:02:35.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:35.558359+0000) 2019-10-23T13:02:35.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:35.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:35.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:35.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:36.600 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:36.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:36.596101+0000) 2019-10-23T13:02:36.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:36.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:36.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:36.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:37.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:37.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:37.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:37.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:38.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:02:38.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:38.075753+0000) 2019-10-23T13:02:38.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:38.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:38.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:38.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:39.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:39.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:39.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:39.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:40.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:02:40.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:40.081843+0000) 2019-10-23T13:02:40.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:40.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:40.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:40.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:41.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:41.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:41.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:41.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:42.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:42.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:42.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:42.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:43.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:43.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:43.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:43.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:44.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:02:44.597+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:44.598948+0000) 2019-10-23T13:02:44.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:02:44.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:44.597471+0000) 2019-10-23T13:02:44.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:44.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:44.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:44.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:45.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:02:45.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:45.558452+0000) 2019-10-23T13:02:45.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:45.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:45.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:45.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:46.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:46.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:46.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:46.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:46.599 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:46.594+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:46.596189+0000) 2019-10-23T13:02:46.599 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:46.595+0000 7f9e31290700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:46.596823+0000) 2019-10-23T13:02:47.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:47.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:47.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:47.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:48.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:02:48.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:48.075847+0000) 2019-10-23T13:02:48.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:48.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:48.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:48.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:49.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:49.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:49.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:49.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:50.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:02:50.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:50.081941+0000) 2019-10-23T13:02:50.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:50.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:50.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:50.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:51.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:02:51.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:51.096398+0000) 2019-10-23T13:02:51.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:51.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:51.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:51.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:52.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:52.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:52.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:52.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:53.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:53.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:53.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:53.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:54.601 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:02:54.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:54.599048+0000) 2019-10-23T13:02:54.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:02:54.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:54.597563+0000) 2019-10-23T13:02:54.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:54.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:54.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:54.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:55.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:02:55.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:55.558544+0000) 2019-10-23T13:02:55.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:55.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:55.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:55.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:56.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:56.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:56.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:56.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:57.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:57.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:57.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:57.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:58.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:02:58.074+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:02:58.075947+0000) 2019-10-23T13:02:58.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:58.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:58.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:58.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:02:59.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:59.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:02:59.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:02:59.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:00.084 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:03:00.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:00.082035+0000) 2019-10-23T13:03:00.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:00.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:00.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:00.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:01.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:03:01.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:01.096497+0000) 2019-10-23T13:03:01.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:01.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:01.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:01.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:02.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:02.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:02.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:02.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:03.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:03.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:03.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:03.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:04.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:03:04.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:04.599156+0000) 2019-10-23T13:03:04.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:03:04.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:04.597654+0000) 2019-10-23T13:03:04.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:04.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:04.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:04.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:05.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:03:05.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:05.558638+0000) 2019-10-23T13:03:05.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:05.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:05.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:05.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:06.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:06.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:06.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:06.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:07.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:07.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:07.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:07.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:08.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:03:08.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:08.076043+0000) 2019-10-23T13:03:08.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:08.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:08.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:08.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:09.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:09.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:09.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:09.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:10.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:03:10.080+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:10.082168+0000) 2019-10-23T13:03:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:10.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:10.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:11.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:03:11.095+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:11.096594+0000) 2019-10-23T13:03:11.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:11.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:11.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:11.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:12.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:12.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:12.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:12.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:13.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:13.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:13.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:13.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:14.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:03:14.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:14.599298+0000) 2019-10-23T13:03:14.602 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:03:14.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:14.597744+0000) 2019-10-23T13:03:14.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:14.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:14.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:14.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:15.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:03:15.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:15.558733+0000) 2019-10-23T13:03:15.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:15.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:15.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:15.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:16.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:16.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:16.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:16.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:17.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:17.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:17.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:17.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:18.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:03:18.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:18.076138+0000) 2019-10-23T13:03:18.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:18.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:18.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:18.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:19.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:19.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:19.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:19.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:20.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:03:20.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:20.082301+0000) 2019-10-23T13:03:20.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:20.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:20.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:20.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:21.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:03:21.095+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:21.096692+0000) 2019-10-23T13:03:21.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:21.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:21.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:21.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:22.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:22.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:22.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:22.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:23.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:23.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:23.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:23.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:24.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:03:24.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:24.599393+0000) 2019-10-23T13:03:24.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:03:24.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:24.597833+0000) 2019-10-23T13:03:24.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:24.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:24.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:24.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:25.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:03:25.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:25.558829+0000) 2019-10-23T13:03:25.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:25.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:25.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:25.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:26.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:26.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:26.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:26.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:27.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:27.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:27.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:27.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:28.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:03:28.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:28.076236+0000) 2019-10-23T13:03:28.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:28.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:28.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:28.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:29.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:29.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:29.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:29.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:30.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:03:30.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:30.082393+0000) 2019-10-23T13:03:30.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:30.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:30.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:30.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:31.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:03:31.095+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:31.096791+0000) 2019-10-23T13:03:31.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:31.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:31.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:31.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:32.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:32.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:32.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:32.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:34.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:34.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:34.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:34.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:34.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:03:34.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:34.599496+0000) 2019-10-23T13:03:34.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:03:34.596+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:34.597925+0000) 2019-10-23T13:03:35.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:35.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:35.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:35.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:35.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:03:35.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:35.558923+0000) 2019-10-23T13:03:36.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:36.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:36.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:36.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:37.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:37.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:37.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:37.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:38.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:03:38.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:38.076331+0000) 2019-10-23T13:03:38.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:38.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:38.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:38.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:39.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:39.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:39.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:39.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:40.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:40.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:40.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:40.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:03:40.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:40.082493+0000) 2019-10-23T13:03:41.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:41.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:41.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:41.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:41.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:03:41.095+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:41.096883+0000) 2019-10-23T13:03:42.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:42.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:42.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:42.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:43.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:43.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:43.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:43.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:44.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:44.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:44.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:44.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:44.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:03:44.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:44.599590+0000) 2019-10-23T13:03:44.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:03:44.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:44.598020+0000) 2019-10-23T13:03:45.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:45.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:45.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:45.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:45.561 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:03:45.557+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:45.559019+0000) 2019-10-23T13:03:46.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:46.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:46.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:46.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:47.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:47.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:47.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:47.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:48.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:48.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:48.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:48.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:48.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:03:48.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:48.076427+0000) 2019-10-23T13:03:49.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:49.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:49.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:49.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:50.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:03:50.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:50.082588+0000) 2019-10-23T13:03:50.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:50.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:50.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:50.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:51.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:51.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:51.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:51.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:51.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:03:51.095+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:51.096974+0000) 2019-10-23T13:03:52.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:52.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:52.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:52.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:53.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:53.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:53.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:53.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:54.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:54.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T12:53:24.000272+0000 (oldest deadline 2019-10-23T12:53:44.000272+0000) 2019-10-23T13:03:54.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:54.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:54.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:03:54.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:54.599680+0000) 2019-10-23T13:03:54.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:03:54.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:54.598126+0000) 2019-10-23T13:03:55.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:55.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:55.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:03:55.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:55.559110+0000) 2019-10-23T13:03:56.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:56.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:57.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:57.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:58.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:03:58.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:03:58.076522+0000) 2019-10-23T13:03:58.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:58.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:03:59.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:03:59.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:00.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:04:00.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:00.082686+0000) 2019-10-23T13:04:00.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:00.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:01.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:04:01.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:01.097070+0000) 2019-10-23T13:04:01.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:01.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:02.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:02.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:03.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:03.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:04.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:04.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:04.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:04:04.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:04.599774+0000) 2019-10-23T13:04:04.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:04:04.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:04.598219+0000) 2019-10-23T13:04:05.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:05.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:05.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:04:05.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:05.559202+0000) 2019-10-23T13:04:06.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:06.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:07.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:07.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:08.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:04:08.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:08.076617+0000) 2019-10-23T13:04:08.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:08.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:09.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:09.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:10.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:04:10.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:10.082780+0000) 2019-10-23T13:04:10.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:10.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:11.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:11.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:11.099 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:04:11.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:11.097164+0000) 2019-10-23T13:04:12.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:12.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:13.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:13.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:14.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:14.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:14.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:04:14.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:14.599868+0000) 2019-10-23T13:04:14.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:04:14.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:14.598312+0000) 2019-10-23T13:04:15.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:15.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:15.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:04:15.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:15.559299+0000) 2019-10-23T13:04:16.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:16.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:17.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:17.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:18.081 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:04:18.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:18.076708+0000) 2019-10-23T13:04:18.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:18.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:18.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:18.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:19.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:19.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:19.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:19.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:20.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:04:20.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:20.082875+0000) 2019-10-23T13:04:20.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:20.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:20.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:20.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:21.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:21.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:21.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:21.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:21.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:04:21.095+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:21.097256+0000) 2019-10-23T13:04:22.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:22.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:22.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:22.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:23.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:22.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:23.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:22.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:24.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:24.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:24.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:24.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:24.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:04:24.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:24.599964+0000) 2019-10-23T13:04:24.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:04:24.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:24.598405+0000) 2019-10-23T13:04:25.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:25.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:25.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:25.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:25.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:04:25.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:25.559391+0000) 2019-10-23T13:04:26.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:26.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:26.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:26.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:27.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:27.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:27.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:27.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:28.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:27.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:28.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:27.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:28.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:04:28.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:28.076807+0000) 2019-10-23T13:04:28.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:28.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:28.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:28.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:30.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:29.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:30.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:29.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:30.085 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:04:30.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:30.082973+0000) 2019-10-23T13:04:31.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:31.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:31.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:31.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:31.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:04:31.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:31.097347+0000) 2019-10-23T13:04:32.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:32.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:32.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:32.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:32.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:32.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:32.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:32.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:34.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:34.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:34.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:34.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:34.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:04:34.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:34.600061+0000) 2019-10-23T13:04:34.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:04:34.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:34.598499+0000) 2019-10-23T13:04:34.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:34.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:34.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:34.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:35.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:04:35.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:35.559489+0000) 2019-10-23T13:04:35.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:35.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:35.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:35.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:37.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:37.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:37.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:37.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:38.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:38.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:38.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:38.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:38.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:04:38.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:38.076904+0000) 2019-10-23T13:04:39.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:39.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:39.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:39.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:40.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:40.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:40.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:40.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:40.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:04:40.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:40.083076+0000) 2019-10-23T13:04:41.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:41.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:41.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:41.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:41.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:04:41.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:41.097440+0000) 2019-10-23T13:04:42.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:42.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:42.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:42.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:43.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:43.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:43.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:43.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:43.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:43.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:43.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:43.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:44.602 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:04:44.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:44.600152+0000) 2019-10-23T13:04:44.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:04:44.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:44.598595+0000) 2019-10-23T13:04:44.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:44.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:44.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:44.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:45.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:04:45.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:45.559584+0000) 2019-10-23T13:04:45.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:45.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:45.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:45.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:46.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:46.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:46.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:46.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:47.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:47.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:47.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:47.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:48.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:04:48.075+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:48.076998+0000) 2019-10-23T13:04:48.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:48.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:48.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:48.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:49.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:49.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:49.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:49.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:50.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:04:50.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:50.083172+0000) 2019-10-23T13:04:50.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:50.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:50.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:50.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:51.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:04:51.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:51.097536+0000) 2019-10-23T13:04:51.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:51.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:51.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:51.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:52.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:52.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:52.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:52.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:53.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:53.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:53.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:53.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:54.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:04:54.598+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:54.600250+0000) 2019-10-23T13:04:54.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:04:54.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:54.598689+0000) 2019-10-23T13:04:54.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:54.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:54.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:54.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:55.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:04:55.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:55.559679+0000) 2019-10-23T13:04:55.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:55.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:55.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:55.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:56.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:56.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:56.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:56.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:57.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:57.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:57.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:57.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:58.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:04:58.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:04:58.077092+0000) 2019-10-23T13:04:58.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:58.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:58.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:58.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:04:59.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:59.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:04:59.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:04:59.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:00.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:05:00.081+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:00.083269+0000) 2019-10-23T13:05:00.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:00.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:00.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:00.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:01.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:05:01.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:01.097631+0000) 2019-10-23T13:05:01.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:01.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:01.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:01.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:02.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:02.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:02.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:02.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:03.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:03.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:03.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:03.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:04.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:05:04.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:04.600350+0000) 2019-10-23T13:05:04.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:05:04.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:04.598780+0000) 2019-10-23T13:05:04.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:04.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:04.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:04.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:05.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:05:05.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:05.559776+0000) 2019-10-23T13:05:05.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:05.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:05.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:05.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:06.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:06.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:06.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:06.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:07.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:07.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:07.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:07.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:08.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:05:08.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:08.077183+0000) 2019-10-23T13:05:08.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:08.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:08.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:08.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:09.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:09.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:09.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:09.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:10.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:05:10.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:10.083372+0000) 2019-10-23T13:05:10.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:10.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:10.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:10.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:11.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:05:11.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:11.097726+0000) 2019-10-23T13:05:11.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:11.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:11.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:11.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:12.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:12.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:12.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:12.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:13.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:13.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:13.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:13.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:14.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:05:14.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:14.600448+0000) 2019-10-23T13:05:14.603 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:05:14.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:14.598871+0000) 2019-10-23T13:05:14.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:14.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:14.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:14.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:15.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:05:15.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:15.559868+0000) 2019-10-23T13:05:15.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:15.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:15.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:15.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:16.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:16.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:16.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:16.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:17.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:17.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:17.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:17.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:18.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:05:18.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:18.077274+0000) 2019-10-23T13:05:18.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:18.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:18.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:18.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:19.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:19.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:19.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:19.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:20.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:05:20.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:20.083471+0000) 2019-10-23T13:05:20.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:20.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:20.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:20.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:21.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:05:21.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:21.097815+0000) 2019-10-23T13:05:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:21.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:21.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:22.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:22.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:22.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:22.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:23.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:23.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:23.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:23.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:24.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:05:24.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:24.600548+0000) 2019-10-23T13:05:24.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:05:24.597+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:24.598961+0000) 2019-10-23T13:05:24.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:24.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:24.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:24.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:25.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:05:25.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:25.559965+0000) 2019-10-23T13:05:25.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:25.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:25.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:25.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:26.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:26.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:26.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:26.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:27.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:27.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:27.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:27.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:28.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:05:28.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:28.077369+0000) 2019-10-23T13:05:28.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:28.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:28.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:28.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:29.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:29.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:29.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:29.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:30.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:05:30.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:30.083567+0000) 2019-10-23T13:05:30.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:30.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:30.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:30.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:31.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:05:31.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:31.097911+0000) 2019-10-23T13:05:31.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:31.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:31.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:31.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:32.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:32.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:32.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:32.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:33.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:33.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:33.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:33.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:34.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:05:34.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:34.600646+0000) 2019-10-23T13:05:34.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:05:34.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:34.599051+0000) 2019-10-23T13:05:34.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:34.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:34.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:34.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:35.562 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:05:35.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:35.560060+0000) 2019-10-23T13:05:35.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:35.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:35.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:35.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:36.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:36.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:36.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:36.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:37.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:37.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:37.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:37.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:38.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:05:38.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:38.077465+0000) 2019-10-23T13:05:38.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:38.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:38.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:38.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:39.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:39.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:39.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:39.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:40.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:05:40.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:40.083664+0000) 2019-10-23T13:05:40.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:40.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:40.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:40.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:41.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:05:41.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:41.098004+0000) 2019-10-23T13:05:41.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:41.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:41.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:41.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:42.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:42.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:42.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:42.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:43.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:43.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:43.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:43.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:44.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:05:44.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:44.600739+0000) 2019-10-23T13:05:44.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:05:44.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:44.599144+0000) 2019-10-23T13:05:44.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:44.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:44.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:44.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:45.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:05:45.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:45.560153+0000) 2019-10-23T13:05:45.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:45.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:45.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:45.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:46.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:46.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:46.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:46.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:47.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:47.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:47.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:47.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:48.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:05:48.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:48.077559+0000) 2019-10-23T13:05:48.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:48.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:48.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:48.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:49.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:49.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:49.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:49.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:50.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:05:50.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:50.083763+0000) 2019-10-23T13:05:50.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:50.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:50.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:50.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:51.100 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:05:51.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:51.098100+0000) 2019-10-23T13:05:51.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:51.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:51.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:51.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:52.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:52.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:52.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:52.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:53.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:53.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:53.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:53.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:54.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:05:54.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:54.600833+0000) 2019-10-23T13:05:54.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:05:54.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:54.599238+0000) 2019-10-23T13:05:54.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:54.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:54.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:54.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:55.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:05:55.558+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:55.560245+0000) 2019-10-23T13:05:55.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:55.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:55.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:55.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:56.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:56.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:56.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:56.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:57.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:57.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:57.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:57.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:58.082 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:05:58.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:05:58.077652+0000) 2019-10-23T13:05:58.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:58.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:58.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:58.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:05:59.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:59.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:05:59.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:05:59.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:00.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:06:00.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:00.083860+0000) 2019-10-23T13:06:00.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:00.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:00.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:00.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:01.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:06:01.096+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:01.098195+0000) 2019-10-23T13:06:01.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:01.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:01.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:01.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:02.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:02.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:02.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:02.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:03.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:03.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:03.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:03.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:04.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:06:04.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:04.600924+0000) 2019-10-23T13:06:04.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:06:04.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:04.599331+0000) 2019-10-23T13:06:04.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:04.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:04.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:04.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:05.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:06:05.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:05.560336+0000) 2019-10-23T13:06:05.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:05.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:05.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:05.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:06.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:06.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:06.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:06.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:07.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:07.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:07.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:07.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:08.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:06:08.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:08.077747+0000) 2019-10-23T13:06:08.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:08.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:08.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:08.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:09.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:09.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:09.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:09.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:10.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:06:10.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:10.083959+0000) 2019-10-23T13:06:10.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:10.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:10.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:10.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:11.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:06:11.098+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:11.098295+0000) 2019-10-23T13:06:11.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:11.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:11.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:11.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:12.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:12.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:12.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:12.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:13.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:13.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:13.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:13.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:14.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:06:14.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:14.601016+0000) 2019-10-23T13:06:14.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:06:14.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:14.599424+0000) 2019-10-23T13:06:14.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:14.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:14.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:14.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:15.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:06:15.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:15.560427+0000) 2019-10-23T13:06:15.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:15.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:15.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:15.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:16.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:16.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:16.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:16.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:17.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:17.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:17.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:17.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:18.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:06:18.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:18.077839+0000) 2019-10-23T13:06:18.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:18.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:18.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:18.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:19.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:19.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:19.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:19.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:20.086 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:06:20.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:20.084058+0000) 2019-10-23T13:06:20.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:20.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:20.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:20.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:21.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:06:21.098+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:21.098385+0000) 2019-10-23T13:06:21.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:21.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:21.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:21.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:22.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:22.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:22.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:22.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:23.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:23.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:23.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:23.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:24.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:06:24.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:24.601110+0000) 2019-10-23T13:06:24.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:06:24.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:24.599515+0000) 2019-10-23T13:06:24.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:24.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:24.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:24.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:25.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:06:25.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:25.560522+0000) 2019-10-23T13:06:25.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:25.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:25.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:25.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:26.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:26.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:26.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:26.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:27.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:27.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:27.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:27.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:28.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:06:28.076+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:28.077937+0000) 2019-10-23T13:06:28.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:28.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:28.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:28.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:29.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:29.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:29.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:29.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:30.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:06:30.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:30.084152+0000) 2019-10-23T13:06:30.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:30.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:30.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:30.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:31.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:06:31.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:31.098484+0000) 2019-10-23T13:06:31.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:31.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:31.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:31.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:32.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:32.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:32.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:32.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:33.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:33.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:33.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:33.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:34.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:34.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:34.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:34.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:34.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:06:34.599+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:34.601206+0000) 2019-10-23T13:06:34.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:06:34.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:34.599606+0000) 2019-10-23T13:06:35.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:35.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:35.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:35.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:35.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:06:35.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:35.560614+0000) 2019-10-23T13:06:36.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:36.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:36.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:36.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:37.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:37.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:37.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:37.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:38.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:06:38.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:38.078035+0000) 2019-10-23T13:06:38.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:38.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:38.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:38.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:39.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:39.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:39.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:39.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:40.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:06:40.082+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:40.084252+0000) 2019-10-23T13:06:40.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:40.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:40.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:40.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:41.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:06:41.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:41.098579+0000) 2019-10-23T13:06:41.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:41.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:41.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:41.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:42.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:42.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:42.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:42.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:43.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:43.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:43.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:43.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:44.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:44.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:44.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:44.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:44.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:06:44.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:44.601296+0000) 2019-10-23T13:06:44.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:06:44.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:44.599698+0000) 2019-10-23T13:06:45.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:06:45.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:45.560710+0000) 2019-10-23T13:06:45.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:45.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:45.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:45.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:46.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:46.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:46.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:46.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:47.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:47.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:47.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:47.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:48.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:06:48.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:48.078129+0000) 2019-10-23T13:06:48.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:48.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:48.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:48.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:49.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:49.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:49.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:49.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:50.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:06:50.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:50.084354+0000) 2019-10-23T13:06:50.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:50.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:50.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:50.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:51.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:06:51.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:51.098672+0000) 2019-10-23T13:06:51.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:51.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:51.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:51.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:52.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:52.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:52.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:52.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:53.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:53.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:53.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:53.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:54.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:06:54.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:54.601393+0000) 2019-10-23T13:06:54.604 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:06:54.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:54.599791+0000) 2019-10-23T13:06:54.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:54.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:54.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:54.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:55.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:06:55.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:55.560803+0000) 2019-10-23T13:06:55.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:55.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:55.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:55.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:56.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:56.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:56.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:56.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:57.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:57.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:57.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:57.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:58.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:06:58.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:06:58.078227+0000) 2019-10-23T13:06:58.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:58.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:58.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:58.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:06:59.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:59.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:06:59.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:06:59.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:00.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:07:00.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:00.084454+0000) 2019-10-23T13:07:00.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:00.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:00.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:00.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:01.101 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:01.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:01.098763+0000) 2019-10-23T13:07:01.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:01.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:01.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:01.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:02.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:02.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:02.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:02.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:03.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:03.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:03.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:03.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:04.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:04.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:04.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:04.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:04.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:07:04.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:04.601488+0000) 2019-10-23T13:07:04.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:07:04.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:04.599885+0000) 2019-10-23T13:07:05.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:07:05.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:05.560898+0000) 2019-10-23T13:07:05.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:05.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:05.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:05.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:06.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:06.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:06.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:06.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:07.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:07.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:07.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:07.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:08.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:07:08.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:08.078320+0000) 2019-10-23T13:07:08.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:08.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:08.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:08.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:09.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:09.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:09.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:09.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:10.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:07:10.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:10.084553+0000) 2019-10-23T13:07:10.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:10.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:10.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:10.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:11.109 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:11.097+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:11.098855+0000) 2019-10-23T13:07:11.109 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:11.098+0000 7f9e31a91700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:11.099487+0000) 2019-10-23T13:07:11.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:11.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:11.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:11.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:12.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:12.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:12.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:12.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:13.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:13.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:13.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:13.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:14.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:14.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:14.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:14.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:14.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:07:14.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:14.601582+0000) 2019-10-23T13:07:14.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:07:14.598+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:14.599981+0000) 2019-10-23T13:07:15.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:15.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:15.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:15.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:15.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:07:15.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:15.560987+0000) 2019-10-23T13:07:15.601 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:15.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:15.599043+0000) 2019-10-23T13:07:16.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:16.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:16.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:16.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:17.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:17.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:17.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:17.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:18.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:07:18.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:18.078412+0000) 2019-10-23T13:07:18.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:18.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:18.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:18.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:19.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:19.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:19.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:19.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:20.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:07:20.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:20.084649+0000) 2019-10-23T13:07:20.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:20.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:20.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:20.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:21.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:21.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:21.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:21.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:22.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:22.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:22.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:22.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:23.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:23.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:23.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:23.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:24.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:24.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:24.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:24.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:24.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:07:24.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:24.601681+0000) 2019-10-23T13:07:24.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:07:24.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:24.600076+0000) 2019-10-23T13:07:25.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:25.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:25.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:25.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:25.563 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:07:25.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:25.561082+0000) 2019-10-23T13:07:25.601 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:25.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:25.599138+0000) 2019-10-23T13:07:26.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:26.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:26.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:26.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:27.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:27.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:27.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:27.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:28.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:07:28.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:28.078510+0000) 2019-10-23T13:07:28.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:28.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:28.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:28.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:29.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:29.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:29.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:29.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:30.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:07:30.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:30.084750+0000) 2019-10-23T13:07:30.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:30.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:30.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:30.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:31.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:31.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:31.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:31.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:32.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:32.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:32.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:32.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:33.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:33.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:33.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:33.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:34.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:34.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:34.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:34.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:34.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:07:34.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:34.601782+0000) 2019-10-23T13:07:34.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:07:34.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:34.600169+0000) 2019-10-23T13:07:35.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:35.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:35.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:35.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:35.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:07:35.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:35.561175+0000) 2019-10-23T13:07:35.601 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:35.597+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:35.599234+0000) 2019-10-23T13:07:36.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:36.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:36.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:36.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:37.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:37.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:37.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:37.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:38.083 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:07:38.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:38.078606+0000) 2019-10-23T13:07:38.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:38.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:38.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:38.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:39.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:39.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:39.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:39.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:40.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:07:40.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:40.084852+0000) 2019-10-23T13:07:40.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:40.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:40.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:40.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:41.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:41.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:41.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:41.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:42.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:42.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:42.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:42.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:43.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:43.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:43.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:43.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:44.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:44.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:44.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:44.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:44.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:07:44.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:44.601886+0000) 2019-10-23T13:07:44.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:07:44.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:44.600263+0000) 2019-10-23T13:07:45.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:45.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:45.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:45.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:45.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:07:45.559+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:45.561268+0000) 2019-10-23T13:07:45.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:45.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:45.599295+0000) 2019-10-23T13:07:46.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:46.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:46.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:46.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:47.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:47.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:47.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:47.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:48.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:07:48.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:48.078700+0000) 2019-10-23T13:07:48.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:48.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:48.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:48.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:49.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:49.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:49.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:49.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:50.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:07:50.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:50.084948+0000) 2019-10-23T13:07:50.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:50.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:50.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:50.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:51.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:51.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:51.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:51.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:52.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:52.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:52.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:52.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:53.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:53.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:53.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:53.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:54.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:54.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:54.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:54.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:54.604 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:07:54.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:54.601985+0000) 2019-10-23T13:07:54.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:07:54.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:54.600355+0000) 2019-10-23T13:07:55.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:55.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:55.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:55.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:55.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:07:55.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:55.561365+0000) 2019-10-23T13:07:55.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:07:55.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:55.599386+0000) 2019-10-23T13:07:56.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:56.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:56.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:56.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:57.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:57.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:57.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:57.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:58.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:07:58.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:07:58.078793+0000) 2019-10-23T13:07:58.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:58.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:58.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:58.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:07:59.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:59.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:07:59.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:07:59.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:00.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:08:00.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:00.085043+0000) 2019-10-23T13:08:00.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:00.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:00.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:00.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:01.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:01.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:01.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:01.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:02.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:02.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:02.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:02.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:03.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:03.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:03.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:03.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:04.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:08:04.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:04.600449+0000) 2019-10-23T13:08:04.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:08:04.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:04.602084+0000) 2019-10-23T13:08:04.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:04.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:04.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:04.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:05.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:08:05.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:05.561455+0000) 2019-10-23T13:08:05.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:08:05.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:05.599479+0000) 2019-10-23T13:08:05.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:05.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:05.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:05.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:06.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:06.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:06.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:06.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:07.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:07.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:07.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:07.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:08.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:08:08.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:08.078888+0000) 2019-10-23T13:08:08.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:08.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:08.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:08.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:09.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:09.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:09.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:09.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:10.087 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:08:10.083+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:10.085142+0000) 2019-10-23T13:08:10.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:10.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:10.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:10.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:11.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:11.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:11.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:11.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:12.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:12.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:12.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:12.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:13.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:13.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:13.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:13.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:14.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:08:14.600+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:14.602183+0000) 2019-10-23T13:08:14.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:08:14.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:14.600541+0000) 2019-10-23T13:08:14.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:14.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:14.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:14.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:15.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:08:15.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:15.561550+0000) 2019-10-23T13:08:15.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:08:15.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:15.599571+0000) 2019-10-23T13:08:15.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:15.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:15.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:15.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:16.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:16.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:16.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:16.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:17.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:17.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:17.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:17.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:18.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:08:18.077+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:18.078979+0000) 2019-10-23T13:08:18.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:18.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:18.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:18.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:19.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:19.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:19.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:19.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:20.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:08:20.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:20.085238+0000) 2019-10-23T13:08:20.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:20.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:20.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:20.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:21.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:21.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:21.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:21.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:22.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:22.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:22.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:22.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:23.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:23.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:23.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:23.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:24.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:24.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:24.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:24.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:24.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:08:24.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:24.602286+0000) 2019-10-23T13:08:24.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:08:24.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:24.600637+0000) 2019-10-23T13:08:25.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:25.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:25.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:25.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:25.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:08:25.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:25.561647+0000) 2019-10-23T13:08:25.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:08:25.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:25.599659+0000) 2019-10-23T13:08:26.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:26.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:26.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:26.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:27.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:27.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:27.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:27.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:28.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:08:28.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:28.079075+0000) 2019-10-23T13:08:28.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:28.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:28.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:28.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:29.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:29.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:29.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:29.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:30.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:08:30.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:30.085334+0000) 2019-10-23T13:08:30.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:30.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:30.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:30.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:31.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:31.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:31.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:31.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:32.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:32.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:32.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:32.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:33.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:33.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:33.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:33.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:34.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:34.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:34.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:34.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:34.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:08:34.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:34.602385+0000) 2019-10-23T13:08:34.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:08:34.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:34.600732+0000) 2019-10-23T13:08:35.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:35.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:35.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:35.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:35.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:08:35.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:35.561741+0000) 2019-10-23T13:08:35.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:08:35.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:35.599751+0000) 2019-10-23T13:08:36.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:36.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:36.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:36.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:37.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:37.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:37.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:37.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:38.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:08:38.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:38.079171+0000) 2019-10-23T13:08:38.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:38.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:38.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:38.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:39.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:39.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:39.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:39.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:40.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:08:40.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:40.085437+0000) 2019-10-23T13:08:40.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:40.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:40.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:40.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:41.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:41.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:41.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:41.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:42.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:42.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:42.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:42.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:43.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:43.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:43.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:43.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:44.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:44.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:44.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:44.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:44.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:08:44.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:44.602483+0000) 2019-10-23T13:08:44.605 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:08:44.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:44.600826+0000) 2019-10-23T13:08:45.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:45.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:45.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:45.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:45.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:08:45.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:45.561835+0000) 2019-10-23T13:08:45.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:08:45.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:45.599845+0000) 2019-10-23T13:08:46.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:46.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:46.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:46.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:47.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:47.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:47.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:47.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:48.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:08:48.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:48.079266+0000) 2019-10-23T13:08:48.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:48.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:48.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:48.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:49.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:49.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:49.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:49.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:50.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:08:50.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:50.085538+0000) 2019-10-23T13:08:50.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:50.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:50.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:50.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:51.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:51.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:51.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:51.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:52.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:52.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:52.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:52.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:53.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:53.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:53.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:53.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:54.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:54.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:54.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:54.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:54.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:08:54.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:54.602582+0000) 2019-10-23T13:08:54.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:08:54.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:54.600919+0000) 2019-10-23T13:08:55.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:55.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:55.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:55.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:55.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:08:55.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:55.561932+0000) 2019-10-23T13:08:55.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:08:55.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:55.599936+0000) 2019-10-23T13:08:56.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:56.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:56.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:56.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:57.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:57.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:57.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:57.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:58.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:08:58.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:08:58.079360+0000) 2019-10-23T13:08:58.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:58.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:58.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:58.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:08:59.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:59.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:08:59.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:08:59.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:00.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:09:00.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:00.085633+0000) 2019-10-23T13:09:00.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:00.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:00.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:00.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:01.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:01.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:01.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:01.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:02.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:02.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:02.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:02.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:03.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:03.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:03.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:03.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:04.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:04.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:04.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:04.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:04.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:09:04.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:04.602680+0000) 2019-10-23T13:09:04.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:09:04.599+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:04.601012+0000) 2019-10-23T13:09:05.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:05.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:05.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:05.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:05.564 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:09:05.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:05.562027+0000) 2019-10-23T13:09:05.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:09:05.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:05.600026+0000) 2019-10-23T13:09:06.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:06.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:06.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:06.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:07.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:07.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:07.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:07.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:08.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:09:08.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:08.079454+0000) 2019-10-23T13:09:08.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:08.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:08.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:08.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:09.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:09.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:09.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:09.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:10.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:09:10.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:10.085735+0000) 2019-10-23T13:09:10.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:10.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:10.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:10.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:11.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:11.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:11.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:11.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:12.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:12.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:12.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:12.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:13.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:13.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:13.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:13.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:14.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:14.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:14.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:14.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:14.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:09:14.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:14.602780+0000) 2019-10-23T13:09:14.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:09:14.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:14.601114+0000) 2019-10-23T13:09:15.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:09:15.560+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:15.562120+0000) 2019-10-23T13:09:15.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:15.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:15.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:15.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:15.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:09:15.598+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:15.600121+0000) 2019-10-23T13:09:16.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:16.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:16.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:16.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:17.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:17.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:17.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:17.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:18.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:09:18.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:18.079550+0000) 2019-10-23T13:09:18.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:18.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:18.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:18.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:19.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:19.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:19.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:19.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:20.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:09:20.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:20.085837+0000) 2019-10-23T13:09:20.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:20.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:20.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:20.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:21.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:21.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:21.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:21.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:22.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:22.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:22.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:22.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:23.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:23.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:23.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:23.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:24.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:24.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:24.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:24.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:24.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:09:24.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:24.602879+0000) 2019-10-23T13:09:24.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:09:24.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:24.601209+0000) 2019-10-23T13:09:25.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:25.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:25.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:25.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:25.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:09:25.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:25.562210+0000) 2019-10-23T13:09:25.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:09:25.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:25.600212+0000) 2019-10-23T13:09:26.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:26.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:26.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:26.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:27.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:27.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:27.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:27.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:28.084 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:09:28.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:28.079645+0000) 2019-10-23T13:09:28.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:28.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:28.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:28.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:29.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:29.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:29.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:29.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:30.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:09:30.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:30.085935+0000) 2019-10-23T13:09:30.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:30.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:30.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:30.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:31.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:31.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:31.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:31.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:32.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:32.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:32.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:32.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:33.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:33.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:33.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:33.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:34.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:34.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:34.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:34.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:34.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:09:34.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:34.602973+0000) 2019-10-23T13:09:34.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:09:34.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:34.601302+0000) 2019-10-23T13:09:35.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:35.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:35.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:35.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:35.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:09:35.562+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:35.562300+0000) 2019-10-23T13:09:35.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:09:35.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:35.600297+0000) 2019-10-23T13:09:36.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:36.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:36.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:36.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:37.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:37.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:37.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:37.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:38.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:09:38.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:38.079738+0000) 2019-10-23T13:09:38.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:38.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:38.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:38.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:39.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:39.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:39.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:39.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:40.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:09:40.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:40.086033+0000) 2019-10-23T13:09:40.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:40.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:40.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:40.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:41.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:41.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:41.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:41.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:42.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:42.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:42.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:42.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:43.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:43.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:43.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:43.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:44.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:44.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:44.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:44.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:44.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:09:44.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:44.603071+0000) 2019-10-23T13:09:44.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:09:44.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:44.601397+0000) 2019-10-23T13:09:45.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:45.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:45.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:45.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:45.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:09:45.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:45.562392+0000) 2019-10-23T13:09:45.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:09:45.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:45.600392+0000) 2019-10-23T13:09:46.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:46.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:46.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:46.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:47.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:47.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:47.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:47.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:48.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:09:48.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:48.079829+0000) 2019-10-23T13:09:48.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:48.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:48.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:48.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:49.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:49.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:49.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:49.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:50.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:09:50.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:50.086134+0000) 2019-10-23T13:09:50.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:50.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:50.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:50.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:51.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:51.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:51.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:51.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:52.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:52.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:52.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:52.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:53.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:53.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:53.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:53.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:54.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:54.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:54.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:54.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:54.605 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:09:54.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:54.603171+0000) 2019-10-23T13:09:54.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:09:54.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:54.601492+0000) 2019-10-23T13:09:55.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:55.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:55.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:55.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:55.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:09:55.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:55.562483+0000) 2019-10-23T13:09:55.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:09:55.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:55.600484+0000) 2019-10-23T13:09:56.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:56.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:56.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:56.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:57.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:57.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:57.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:57.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:58.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:09:58.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:09:58.079921+0000) 2019-10-23T13:09:58.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:58.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:58.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:58.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:09:59.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:59.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:09:59.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:09:59.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:00.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:10:00.084+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:00.086238+0000) 2019-10-23T13:10:00.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:00.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:00.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:00.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:01.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:01.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:01.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:01.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:02.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:02.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:02.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:02.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:03.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:03.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:03.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:03.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:04.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:04.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:04.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:04.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:04.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:10:04.601+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:04.603269+0000) 2019-10-23T13:10:04.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:10:04.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:04.601588+0000) 2019-10-23T13:10:05.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:05.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:05.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:05.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:05.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:10:05.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:05.562576+0000) 2019-10-23T13:10:05.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:10:05.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:05.600576+0000) 2019-10-23T13:10:06.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:06.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:06.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:06.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:07.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:07.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:07.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:07.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:08.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:10:08.078+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:08.080016+0000) 2019-10-23T13:10:08.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:08.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:08.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:08.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:09.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:09.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:09.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:09.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:10.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:10:10.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:10.086340+0000) 2019-10-23T13:10:10.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:10.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:10.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:10.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:11.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:11.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:11.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:11.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:12.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:12.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:12.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:12.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:13.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:13.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:13.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:13.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:14.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:14.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:14.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:14.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:14.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:10:14.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:14.603369+0000) 2019-10-23T13:10:14.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:10:14.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:14.601680+0000) 2019-10-23T13:10:15.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:15.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:15.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:15.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:15.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:10:15.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:15.562670+0000) 2019-10-23T13:10:15.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:10:15.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:15.600671+0000) 2019-10-23T13:10:16.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:16.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:16.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:16.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:17.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:17.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:17.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:17.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:18.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:10:18.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:18.080116+0000) 2019-10-23T13:10:18.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:18.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:18.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:18.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:19.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:19.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:19.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:19.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:20.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:10:20.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:20.086441+0000) 2019-10-23T13:10:20.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:20.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:20.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:20.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:21.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:21.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:21.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:21.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:22.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:22.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:22.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:22.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:23.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:23.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:23.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:23.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:24.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:24.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:24.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:24.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:24.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:10:24.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:24.603468+0000) 2019-10-23T13:10:24.606 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:10:24.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:24.601774+0000) 2019-10-23T13:10:25.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:25.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:25.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:25.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:25.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:10:25.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:25.562767+0000) 2019-10-23T13:10:25.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:10:25.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:25.600763+0000) 2019-10-23T13:10:26.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:26.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:26.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:26.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:27.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:27.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:27.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:27.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:28.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:10:28.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:28.080216+0000) 2019-10-23T13:10:28.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:28.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:28.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:28.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:29.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:29.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:29.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:29.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:30.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:10:30.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:30.086531+0000) 2019-10-23T13:10:30.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:30.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:30.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:30.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:31.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:31.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:31.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:31.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:32.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:32.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:32.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:32.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:33.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:33.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:33.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:33.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:34.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:34.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:34.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:34.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:34.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:10:34.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:34.603563+0000) 2019-10-23T13:10:34.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:10:34.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:34.601867+0000) 2019-10-23T13:10:35.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:35.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:35.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:35.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:35.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:10:35.562+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:35.562863+0000) 2019-10-23T13:10:35.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:10:35.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:35.600858+0000) 2019-10-23T13:10:36.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:36.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:36.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:36.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:37.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:37.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:37.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:37.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:38.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:10:38.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:38.080310+0000) 2019-10-23T13:10:38.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:38.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:38.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:38.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:39.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:39.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:39.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:39.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:40.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:10:40.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:40.086631+0000) 2019-10-23T13:10:40.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:40.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:40.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:40.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:41.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:41.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:41.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:41.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:42.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:42.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:42.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:42.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:43.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:43.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:43.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:43.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:44.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:44.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:44.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:44.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:44.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:10:44.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:44.603665+0000) 2019-10-23T13:10:44.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:10:44.600+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:44.601959+0000) 2019-10-23T13:10:45.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:45.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:45.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:45.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:45.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:10:45.562+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:45.562953+0000) 2019-10-23T13:10:45.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:10:45.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:45.600949+0000) 2019-10-23T13:10:46.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:46.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:46.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:46.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:47.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:47.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:47.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:47.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:48.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:10:48.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:48.080406+0000) 2019-10-23T13:10:48.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:48.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:48.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:48.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:49.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:49.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:49.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:49.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:50.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:10:50.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:50.086733+0000) 2019-10-23T13:10:50.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:50.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:50.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:50.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:51.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:51.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:51.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:51.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:52.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:52.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:52.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:52.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:53.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:53.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:53.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:53.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:54.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:54.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:54.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:54.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:54.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:10:54.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:54.603760+0000) 2019-10-23T13:10:54.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:10:54.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:54.602054+0000) 2019-10-23T13:10:55.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:55.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:55.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:55.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:55.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:10:55.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:55.563045+0000) 2019-10-23T13:10:55.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:10:55.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:55.601045+0000) 2019-10-23T13:10:56.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:56.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:56.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:56.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:57.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:57.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:57.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:57.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:58.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:10:58.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:10:58.080503+0000) 2019-10-23T13:10:58.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:58.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:58.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:58.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:10:59.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:59.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:10:59.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:10:59.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:00.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:11:00.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:00.086834+0000) 2019-10-23T13:11:00.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:00.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:00.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:00.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:01.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:01.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:01.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:01.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:02.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:02.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:02.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:02.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:03.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:03.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:03.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:03.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:04.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:04.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:04.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:04.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:04.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:11:04.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:04.603857+0000) 2019-10-23T13:11:04.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:11:04.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:04.602148+0000) 2019-10-23T13:11:05.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:05.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:05.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:05.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:05.565 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:05.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:05.563131+0000) 2019-10-23T13:11:05.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:11:05.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:05.601137+0000) 2019-10-23T13:11:06.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:06.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:06.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:06.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:07.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:07.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:07.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:07.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:08.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:11:08.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:08.080600+0000) 2019-10-23T13:11:08.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:08.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:08.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:08.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:09.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:09.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:09.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:09.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:10.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:11:10.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:10.086936+0000) 2019-10-23T13:11:10.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:10.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:10.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:10.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:11.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:11.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:11.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:11.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:12.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:12.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:12.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:12.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:13.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:13.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:13.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:13.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:14.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:11:14.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:14.603955+0000) 2019-10-23T13:11:14.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:11:14.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:14.602244+0000) 2019-10-23T13:11:14.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:14.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:14.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:14.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:15.566 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:15.561+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:15.563220+0000) 2019-10-23T13:11:15.566 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:15.562+0000 7f0f60258700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:15.563894+0000) 2019-10-23T13:11:15.603 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:11:15.599+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:15.601230+0000) 2019-10-23T13:11:15.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:15.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:15.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:15.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:16.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:16.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:16.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:16.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:17.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:17.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:17.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:17.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:18.085 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:11:18.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:18.080694+0000) 2019-10-23T13:11:18.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:18.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:18.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:18.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:19.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:19.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:19.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:19.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:20.066 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:20.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:20.063411+0000) 2019-10-23T13:11:20.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:11:20.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:20.087034+0000) 2019-10-23T13:11:20.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:20.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:20.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:20.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:21.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:21.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:21.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:21.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:22.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:22.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:22.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:22.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:23.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:23.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:23.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:23.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:24.606 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:11:24.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:24.604053+0000) 2019-10-23T13:11:24.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:11:24.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:24.602340+0000) 2019-10-23T13:11:24.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:24.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:24.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:24.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:25.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:11:25.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:25.601325+0000) 2019-10-23T13:11:25.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:25.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:25.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:25.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:26.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:26.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:26.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:26.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:27.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:27.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:27.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:27.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:28.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:11:28.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:28.080789+0000) 2019-10-23T13:11:28.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:28.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:28.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:28.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:29.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:29.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:29.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:29.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:30.066 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:30.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:30.063509+0000) 2019-10-23T13:11:30.089 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:11:30.085+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:30.087124+0000) 2019-10-23T13:11:30.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:30.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:30.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:30.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:31.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:31.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:31.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:31.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:32.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:32.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:32.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:32.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:33.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:33.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:33.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:33.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:34.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:11:34.602+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:34.604148+0000) 2019-10-23T13:11:34.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:11:34.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:34.602435+0000) 2019-10-23T13:11:34.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:34.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:34.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:34.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:35.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:11:35.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:35.601420+0000) 2019-10-23T13:11:35.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:35.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:35.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:35.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:36.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:36.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:36.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:36.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:37.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:37.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:37.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:37.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:38.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:11:38.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:38.080879+0000) 2019-10-23T13:11:38.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:38.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:38.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:38.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:39.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:39.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:39.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:39.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:40.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:40.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:40.063610+0000) 2019-10-23T13:11:40.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:11:40.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:40.087219+0000) 2019-10-23T13:11:40.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:40.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:40.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:40.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:41.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:41.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:41.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:41.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:42.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:42.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:42.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:42.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:43.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:43.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:43.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:43.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:44.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:11:44.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:44.604243+0000) 2019-10-23T13:11:44.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:11:44.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:44.602534+0000) 2019-10-23T13:11:44.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:44.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:44.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:44.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:45.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:11:45.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:45.601509+0000) 2019-10-23T13:11:45.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:45.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:45.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:45.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:46.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:46.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:47.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:47.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:47.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:47.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:48.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:11:48.079+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:48.080975+0000) 2019-10-23T13:11:48.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:48.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:48.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:48.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:49.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:49.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:49.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:49.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:50.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:11:50.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:50.063708+0000) 2019-10-23T13:11:50.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:11:50.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:50.087297+0000) 2019-10-23T13:11:50.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:50.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:50.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:50.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:51.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:51.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:51.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:51.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:52.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:52.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:52.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:52.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:53.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:53.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:53.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:53.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:54.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:11:54.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:54.604297+0000) 2019-10-23T13:11:54.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:11:54.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:54.602628+0000) 2019-10-23T13:11:54.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:54.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:54.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:54.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:55.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:11:55.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:55.601600+0000) 2019-10-23T13:11:55.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:55.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:55.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:55.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:56.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:56.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:56.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:56.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:57.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:57.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:57.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:57.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:58.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:11:58.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:11:58.081101+0000) 2019-10-23T13:11:58.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:58.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:58.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:58.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:11:59.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:59.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:11:59.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:11:59.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:00.066 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:12:00.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:00.063803+0000) 2019-10-23T13:12:00.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:12:00.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:00.087389+0000) 2019-10-23T13:12:00.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:00.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:00.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:00.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:01.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:01.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:01.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:01.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:02.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:02.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:02.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:02.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:03.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:03.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:03.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:03.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:04.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:12:04.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:04.604441+0000) 2019-10-23T13:12:04.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:12:04.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:04.602720+0000) 2019-10-23T13:12:04.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:04.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:04.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:04.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:05.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:12:05.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:05.601692+0000) 2019-10-23T13:12:05.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:05.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:05.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:05.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:06.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:06.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:06.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:06.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:08.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:07.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:08.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:07.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:08.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:12:08.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:08.081217+0000) 2019-10-23T13:12:09.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:09.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:09.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:09.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:10.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:10.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:10.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:10.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:10.066 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:12:10.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:10.063897+0000) 2019-10-23T13:12:10.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:12:10.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:10.087510+0000) 2019-10-23T13:12:10.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:10.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:10.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:10.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:12.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:11.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:12.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:11.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:12.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:12.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:12.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:12.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:13.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:13.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:13.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:13.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:14.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:12:14.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:14.604584+0000) 2019-10-23T13:12:14.607 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:12:14.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:14.602817+0000) 2019-10-23T13:12:15.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:15.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:15.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:15.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:15.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:12:15.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:15.601786+0000) 2019-10-23T13:12:15.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:15.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:15.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:15.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:16.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:16.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:17.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:16.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:17.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:17.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:17.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:17.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:18.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:12:18.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:18.081333+0000) 2019-10-23T13:12:19.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:19.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:19.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:19.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:19.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:19.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:19.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:19.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:20.066 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:12:20.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:20.063992+0000) 2019-10-23T13:12:20.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:12:20.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:20.087604+0000) 2019-10-23T13:12:21.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:21.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:21.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:21.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:21.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:21.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:21.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:21.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:22.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:22.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:22.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:22.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:23.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:23.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:23.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:23.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:24.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:12:24.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:24.604682+0000) 2019-10-23T13:12:24.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:12:24.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:24.602909+0000) 2019-10-23T13:12:25.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:24.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:25.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:24.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:25.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:12:25.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:25.601881+0000) 2019-10-23T13:12:25.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:25.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:25.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:25.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:26.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:26.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:26.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:26.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:28.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:27.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:28.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:27.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:28.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:12:28.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:28.081447+0000) 2019-10-23T13:12:29.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:28.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:29.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:28.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:30.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:29.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:30.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:29.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:30.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:12:30.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:30.064089+0000) 2019-10-23T13:12:30.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:12:30.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:30.087697+0000) 2019-10-23T13:12:30.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:30.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:30.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:30.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:31.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:31.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:31.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:31.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:32.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:32.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:32.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:32.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:34.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:34.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:34.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:34.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:34.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:12:34.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:34.604777+0000) 2019-10-23T13:12:34.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:12:34.601+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:34.603005+0000) 2019-10-23T13:12:34.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:34.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:34.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:34.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:35.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:12:35.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:35.601973+0000) 2019-10-23T13:12:35.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:35.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:35.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:35.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:36.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:36.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:36.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:36.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:37.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:37.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:37.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:37.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:38.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:12:38.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:38.081562+0000) 2019-10-23T13:12:38.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:38.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:38.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:38.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:39.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:39.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:39.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:39.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:40.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:12:40.062+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:40.064183+0000) 2019-10-23T13:12:40.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:12:40.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:40.087799+0000) 2019-10-23T13:12:40.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:40.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:40.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:40.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:41.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:41.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:41.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:41.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:42.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:42.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:42.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:42.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:43.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:43.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:43.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:43.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:44.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:12:44.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:44.604878+0000) 2019-10-23T13:12:44.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:12:44.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:44.603105+0000) 2019-10-23T13:12:44.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:44.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:44.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:44.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:45.604 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:12:45.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:45.602065+0000) 2019-10-23T13:12:45.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:45.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:45.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:45.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:46.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:46.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:46.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:46.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:47.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:47.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:47.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:47.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:48.086 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:12:48.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:48.081674+0000) 2019-10-23T13:12:48.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:48.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:48.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:48.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:49.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:49.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:49.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:49.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:50.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:12:50.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:50.064279+0000) 2019-10-23T13:12:50.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:12:50.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:50.087892+0000) 2019-10-23T13:12:50.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:50.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:50.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:50.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:51.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:51.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:51.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:51.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:53.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:53.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:53.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:53.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:54.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:54.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:54.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:54.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:54.607 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:12:54.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:54.604977+0000) 2019-10-23T13:12:54.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:12:54.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:54.603201+0000) 2019-10-23T13:12:55.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:55.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:55.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:55.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:55.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:12:55.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:55.602160+0000) 2019-10-23T13:12:56.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:56.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:56.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:56.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:57.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:57.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:57.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:57.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:58.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:58.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:58.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:58.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:12:58.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:12:58.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:12:58.081783+0000) 2019-10-23T13:12:59.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:59.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:12:59.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:12:59.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:00.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:13:00.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:00.064374+0000) 2019-10-23T13:13:00.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:00.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:00.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:00.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:00.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:13:00.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:00.087988+0000) 2019-10-23T13:13:01.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:01.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:01.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:01.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:02.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:02.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:02.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:02.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:03.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:03.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:03.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:03.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:04.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:04.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:04.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:04.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:04.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:13:04.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:04.605074+0000) 2019-10-23T13:13:04.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:13:04.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:04.603292+0000) 2019-10-23T13:13:05.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:05.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:05.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:05.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:05.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:13:05.600+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:05.602255+0000) 2019-10-23T13:13:06.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:06.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:06.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:06.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:07.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:07.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:07.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:07.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:08.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:08.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:08.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:08.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:08.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:13:08.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:08.081891+0000) 2019-10-23T13:13:09.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:09.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:09.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:09.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:10.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:13:10.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:10.064470+0000) 2019-10-23T13:13:10.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:10.082+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:10.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:10.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:10.090 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:13:10.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:10.088083+0000) 2019-10-23T13:13:11.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:11.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:11.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:11.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:12.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:12.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:12.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:12.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:13.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:13.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:13.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:13.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:14.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:14.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:14.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:14.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:14.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:13:14.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:14.605166+0000) 2019-10-23T13:13:14.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:13:14.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:14.603388+0000) 2019-10-23T13:13:15.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:15.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:15.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:15.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:15.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:13:15.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:15.602344+0000) 2019-10-23T13:13:16.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:16.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:16.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:16.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:17.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:17.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:17.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:17.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:18.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:13:18.080+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:18.082000+0000) 2019-10-23T13:13:18.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:18.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:18.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:18.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:19.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:19.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:19.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:19.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:20.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:13:20.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:20.064564+0000) 2019-10-23T13:13:20.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:13:20.086+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:20.088181+0000) 2019-10-23T13:13:20.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:20.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:20.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:20.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:21.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:21.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:21.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:21.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:22.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:22.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:22.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:22.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:23.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:23.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:23.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:23.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:24.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:24.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:24.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:24.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:24.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:13:24.603+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:24.605260+0000) 2019-10-23T13:13:24.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:13:24.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:24.603482+0000) 2019-10-23T13:13:25.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:25.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:25.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:25.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:25.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:13:25.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:25.602433+0000) 2019-10-23T13:13:26.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:26.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:26.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:26.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:27.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:27.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:27.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:27.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:28.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:28.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:28.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:28.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:28.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:13:28.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:28.082111+0000) 2019-10-23T13:13:29.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:29.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:29.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:29.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:29.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:29.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:29.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:29.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:30.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:13:30.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:30.064664+0000) 2019-10-23T13:13:30.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:13:30.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:30.088278+0000) 2019-10-23T13:13:31.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:31.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:31.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:31.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:31.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:31.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:31.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:31.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:33.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:33.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:33.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:33.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:33.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:33.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:33.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:33.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:34.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:13:34.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:34.605363+0000) 2019-10-23T13:13:34.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:13:34.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:34.603610+0000) 2019-10-23T13:13:35.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:35.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:35.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:35.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:35.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:13:35.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:35.602529+0000) 2019-10-23T13:13:36.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:36.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:36.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:36.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:36.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:36.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:36.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:36.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:37.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:37.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:37.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:37.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:38.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:13:38.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:38.082298+0000) 2019-10-23T13:13:38.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:38.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:38.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:38.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:40.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:40.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:40.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:40.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:40.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:13:40.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:40.064763+0000) 2019-10-23T13:13:40.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:13:40.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:40.088375+0000) 2019-10-23T13:13:41.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:41.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:41.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:41.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:42.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:42.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:42.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:42.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:42.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:42.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:42.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:42.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:43.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:43.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:43.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:43.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:44.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:13:44.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:44.605459+0000) 2019-10-23T13:13:44.608 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:13:44.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:44.603733+0000) 2019-10-23T13:13:44.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:44.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:44.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:44.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:45.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:13:45.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:45.602619+0000) 2019-10-23T13:13:45.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:45.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:45.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:45.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:46.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:46.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:46.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:46.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:47.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:47.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:47.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:47.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:48.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:13:48.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:48.082445+0000) 2019-10-23T13:13:48.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:48.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:48.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:48.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:49.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:49.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:49.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:50.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:13:50.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:50.064857+0000) 2019-10-23T13:13:50.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:13:50.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:50.088467+0000) 2019-10-23T13:13:50.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:50.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:50.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:50.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:51.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:51.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:51.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:51.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:52.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:52.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:52.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:52.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:53.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:53.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:53.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:53.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:54.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:13:54.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:54.605556+0000) 2019-10-23T13:13:54.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:13:54.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:54.603820+0000) 2019-10-23T13:13:54.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:54.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:54.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:54.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:55.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:13:55.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:55.602716+0000) 2019-10-23T13:13:55.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:55.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:55.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:55.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:57.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:56.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:57.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:56.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:58.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:58.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:58.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:58.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:58.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:13:58.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:13:58.082558+0000) 2019-10-23T13:13:59.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:59.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:59.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:59.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:13:59.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:59.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:13:59.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:13:59.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:00.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:14:00.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:00.064952+0000) 2019-10-23T13:14:00.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:14:00.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:00.088562+0000) 2019-10-23T13:14:01.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:00.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:01.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:00.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:02.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:02.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:02.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:02.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:02.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:02.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:02.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:02.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:03.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:03.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:03.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:03.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:04.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:14:04.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:04.605655+0000) 2019-10-23T13:14:04.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:14:04.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:04.603912+0000) 2019-10-23T13:14:04.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:04.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:04.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:04.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:05.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:14:05.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:05.602808+0000) 2019-10-23T13:14:05.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:05.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:05.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:05.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:06.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:06.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:06.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:06.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:07.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:07.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:07.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:07.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:08.087 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:14:08.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:08.082672+0000) 2019-10-23T13:14:08.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:08.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:08.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:08.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:09.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:09.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:09.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:09.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:10.067 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:14:10.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:10.065051+0000) 2019-10-23T13:14:10.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:14:10.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:10.088655+0000) 2019-10-23T13:14:10.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:10.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:10.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:10.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:11.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:11.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:11.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:11.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:12.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:12.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:12.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:12.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:13.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:13.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:13.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:13.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:14.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:14:14.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:14.605779+0000) 2019-10-23T13:14:14.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:14:14.602+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:14.604006+0000) 2019-10-23T13:14:14.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:14.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:14.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:14.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:15.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:14:15.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:15.602901+0000) 2019-10-23T13:14:15.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:15.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:15.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:15.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:16.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:16.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:16.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:16.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:17.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:17.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:17.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:17.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:18.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:14:18.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:18.082788+0000) 2019-10-23T13:14:18.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:18.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:18.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:18.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:19.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:19.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:19.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:19.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:20.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:14:20.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:20.065149+0000) 2019-10-23T13:14:20.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:14:20.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:20.088745+0000) 2019-10-23T13:14:20.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:20.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:20.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:20.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:21.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:21.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:21.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:21.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:22.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:22.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:22.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:22.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:23.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:23.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:23.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:23.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:24.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:14:24.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:24.605892+0000) 2019-10-23T13:14:24.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:14:24.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:24.604105+0000) 2019-10-23T13:14:24.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:24.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:24.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:24.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:25.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:14:25.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:25.602997+0000) 2019-10-23T13:14:25.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:25.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:25.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:25.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:26.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:26.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:26.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:26.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:27.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:27.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:27.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:27.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:28.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:14:28.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:28.082898+0000) 2019-10-23T13:14:28.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:28.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:28.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:28.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:30.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:30.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:03:57.525930+0000 (oldest deadline 2019-10-23T13:04:17.525930+0000) 2019-10-23T13:14:30.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:30.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:30.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:14:30.063+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:30.065242+0000) 2019-10-23T13:14:30.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:14:30.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:30.088841+0000) 2019-10-23T13:14:31.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:31.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:32.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:32.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:33.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:33.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:34.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:34.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:34.608 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:14:34.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:34.606003+0000) 2019-10-23T13:14:34.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:14:34.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:34.604198+0000) 2019-10-23T13:14:34.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:34.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:35.605 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:14:35.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:35.603088+0000) 2019-10-23T13:14:35.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:35.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:36.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:36.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:38.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:38.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:38.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:14:38.081+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:38.083008+0000) 2019-10-23T13:14:39.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:39.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:40.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:40.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:40.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:14:40.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:40.065297+0000) 2019-10-23T13:14:40.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:14:40.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:40.088934+0000) 2019-10-23T13:14:41.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:41.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:42.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:42.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:43.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:43.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:44.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:44.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:44.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:14:44.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:44.606113+0000) 2019-10-23T13:14:44.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:14:44.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:44.604292+0000) 2019-10-23T13:14:45.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:45.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:45.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:14:45.601+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:45.603184+0000) 2019-10-23T13:14:46.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:46.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:47.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:47.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:48.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:14:48.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:48.083126+0000) 2019-10-23T13:14:48.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:48.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:49.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:49.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:50.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:14:50.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:50.065368+0000) 2019-10-23T13:14:50.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:14:50.087+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:50.089027+0000) 2019-10-23T13:14:50.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:50.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:51.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:51.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:52.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:52.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:53.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:53.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:54.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:54.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:54.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:14:54.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:54.604386+0000) 2019-10-23T13:14:54.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:14:54.604+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:54.606223+0000) 2019-10-23T13:14:55.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:55.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:55.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:14:55.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:55.603281+0000) 2019-10-23T13:14:56.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:56.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:14:56.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:56.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:57.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:57.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:14:57.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:57.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:58.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:14:58.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:14:58.083236+0000) 2019-10-23T13:14:58.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:58.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:14:58.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:58.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:14:59.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:59.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:14:59.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:14:59.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:00.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:15:00.065+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:00.065462+0000) 2019-10-23T13:15:00.091 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:15:00.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:00.089116+0000) 2019-10-23T13:15:00.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:00.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:00.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:00.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:01.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:01.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:01.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:01.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:02.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:02.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:02.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:02.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:03.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:03.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:03.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:03.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:04.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:04.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:04.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:04.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:04.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:15:04.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:04.606334+0000) 2019-10-23T13:15:04.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:15:04.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:04.604476+0000) 2019-10-23T13:15:05.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:05.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:05.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:05.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:05.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:15:05.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:05.603380+0000) 2019-10-23T13:15:06.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:06.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:06.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:06.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:07.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:07.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:07.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:07.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:08.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:15:08.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:08.083352+0000) 2019-10-23T13:15:08.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:08.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:08.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:08.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:09.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:09.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:09.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:09.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:10.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:15:10.065+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:10.065558+0000) 2019-10-23T13:15:10.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:15:10.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:10.089211+0000) 2019-10-23T13:15:10.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:10.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:10.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:10.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:11.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:11.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:11.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:11.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:12.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:12.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:12.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:12.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:13.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:13.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:13.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:13.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:14.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:14.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:14.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:14.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:14.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:15:14.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:14.606447+0000) 2019-10-23T13:15:14.609 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:15:14.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:14.604574+0000) 2019-10-23T13:15:15.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:15.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:15.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:15.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:15.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:15:15.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:15.603473+0000) 2019-10-23T13:15:16.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:16.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:16.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:16.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:17.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:17.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:17.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:17.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:18.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:18.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:18.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:18.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:18.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:15:18.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:18.083467+0000) 2019-10-23T13:15:19.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:19.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:19.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:19.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:20.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:15:20.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:20.065689+0000) 2019-10-23T13:15:20.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:15:20.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:20.089337+0000) 2019-10-23T13:15:20.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:20.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:20.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:20.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:21.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:21.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:21.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:21.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:22.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:22.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:22.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:22.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:23.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:23.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:23.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:23.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:24.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:24.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:24.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:24.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:24.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:15:24.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:24.606611+0000) 2019-10-23T13:15:24.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:15:24.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:24.604669+0000) 2019-10-23T13:15:25.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:25.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:25.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:25.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:25.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:15:25.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:25.603585+0000) 2019-10-23T13:15:26.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:26.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:26.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:26.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:27.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:27.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:27.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:27.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:28.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:15:28.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:28.083583+0000) 2019-10-23T13:15:28.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:28.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:28.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:28.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:29.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:29.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:29.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:29.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:30.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:15:30.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:30.065830+0000) 2019-10-23T13:15:30.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:15:30.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:30.089478+0000) 2019-10-23T13:15:30.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:30.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:30.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:30.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:31.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:31.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:31.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:31.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:32.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:32.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:32.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:32.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:33.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:33.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:33.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:33.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:34.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:34.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:34.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:34.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:34.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:15:34.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:34.606749+0000) 2019-10-23T13:15:34.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:15:34.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:34.604764+0000) 2019-10-23T13:15:35.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:35.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:35.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:35.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:35.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:15:35.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:35.603721+0000) 2019-10-23T13:15:36.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:36.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:36.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:36.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:37.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:37.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:37.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:37.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:38.088 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:15:38.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:38.083698+0000) 2019-10-23T13:15:38.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:38.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:38.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:38.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:39.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:39.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:39.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:39.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:40.070 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:15:40.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:40.065933+0000) 2019-10-23T13:15:40.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:15:40.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:40.089575+0000) 2019-10-23T13:15:40.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:40.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:40.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:40.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:41.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:41.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:41.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:41.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:42.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:42.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:42.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:42.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:43.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:43.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:43.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:43.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:44.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:44.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:44.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:44.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:44.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:15:44.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:44.606864+0000) 2019-10-23T13:15:44.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:15:44.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:44.604858+0000) 2019-10-23T13:15:45.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:45.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:45.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:45.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:45.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:15:45.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:45.603814+0000) 2019-10-23T13:15:46.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:46.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:46.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:46.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:47.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:47.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:47.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:47.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:48.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:15:48.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:48.083809+0000) 2019-10-23T13:15:48.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:48.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:48.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:48.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:49.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:49.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:49.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:49.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:50.068 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:15:50.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:50.066035+0000) 2019-10-23T13:15:50.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:15:50.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:50.089671+0000) 2019-10-23T13:15:50.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:50.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:50.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:50.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:51.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:51.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:51.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:51.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:52.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:52.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:52.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:52.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:53.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:53.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:53.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:53.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:54.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:54.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:54.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:54.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:54.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:15:54.605+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:54.606978+0000) 2019-10-23T13:15:54.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:15:54.603+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:54.604955+0000) 2019-10-23T13:15:55.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:55.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:55.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:55.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:55.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:15:55.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:55.603903+0000) 2019-10-23T13:15:56.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:56.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:56.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:56.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:57.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:57.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:57.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:57.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:58.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:15:58.082+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:15:58.083920+0000) 2019-10-23T13:15:58.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:58.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:58.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:58.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:15:59.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:59.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:15:59.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:15:59.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:00.069 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:00.064+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:00.066131+0000) 2019-10-23T13:16:00.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:16:00.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:00.089770+0000) 2019-10-23T13:16:00.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:00.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:00.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:00.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:01.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:01.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:01.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:01.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:02.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:02.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:02.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:02.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:03.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:03.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:03.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:03.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:04.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:04.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:04.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:04.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:04.609 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:16:04.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:04.607089+0000) 2019-10-23T13:16:04.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:16:04.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:04.605043+0000) 2019-10-23T13:16:05.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:05.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:05.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:05.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:05.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:16:05.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:05.603994+0000) 2019-10-23T13:16:06.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:06.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:06.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:06.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:07.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:07.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:07.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:07.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:08.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:16:08.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:08.084041+0000) 2019-10-23T13:16:08.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:08.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:08.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:08.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:09.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:09.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:09.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:09.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:10.069 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:10.065+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:10.066221+0000) 2019-10-23T13:16:10.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:16:10.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:10.089865+0000) 2019-10-23T13:16:10.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:10.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:10.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:10.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:11.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:11.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:11.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:11.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:12.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:12.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:12.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:12.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:13.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:13.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:13.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:13.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:14.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:14.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:14.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:16:14.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:14.605134+0000) 2019-10-23T13:16:14.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:16:14.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:14.607202+0000) 2019-10-23T13:16:15.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:15.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:15.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:15.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:15.606 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:16:15.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:15.604082+0000) 2019-10-23T13:16:16.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:16.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:16.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:16.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:17.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:17.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:17.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:17.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:18.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:16:18.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:18.084157+0000) 2019-10-23T13:16:18.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:18.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:18.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:18.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:19.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:19.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:19.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:19.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:20.069 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:20.065+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:20.066312+0000) 2019-10-23T13:16:20.069 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:20.065+0000 7f0f5f256700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:20.066887+0000) 2019-10-23T13:16:20.092 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:16:20.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:20.089960+0000) 2019-10-23T13:16:20.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:20.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:20.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:20.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:21.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:21.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:21.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:21.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:22.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:22.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:22.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:22.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:23.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:23.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:23.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:23.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:24.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:24.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:24.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:24.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:24.569 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:24.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:24.566488+0000) 2019-10-23T13:16:24.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:16:24.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:24.607324+0000) 2019-10-23T13:16:24.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:16:24.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:24.605229+0000) 2019-10-23T13:16:25.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:25.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:25.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:25.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:25.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:16:25.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:25.604175+0000) 2019-10-23T13:16:26.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:26.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:26.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:26.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:27.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:27.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:27.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:27.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:28.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:16:28.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:28.084269+0000) 2019-10-23T13:16:28.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:28.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:28.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:28.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:29.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:29.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:29.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:29.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:30.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:16:30.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:30.090053+0000) 2019-10-23T13:16:30.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:30.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:30.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:30.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:31.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:31.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:31.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:31.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:32.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:32.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:32.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:32.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:33.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:33.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:33.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:33.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:34.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:34.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:34.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:34.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:34.569 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:34.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:34.566584+0000) 2019-10-23T13:16:34.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:16:34.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:34.605323+0000) 2019-10-23T13:16:34.611 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:16:34.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:34.607440+0000) 2019-10-23T13:16:35.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:35.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:35.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:35.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:35.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:16:35.602+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:35.604269+0000) 2019-10-23T13:16:36.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:36.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:36.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:36.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:37.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:37.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:37.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:37.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:38.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:16:38.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:38.084390+0000) 2019-10-23T13:16:38.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:38.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:38.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:38.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:39.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:39.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:39.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:39.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:40.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:16:40.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:40.090151+0000) 2019-10-23T13:16:40.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:40.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:40.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:40.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:41.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:41.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:41.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:41.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:42.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:42.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:42.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:42.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:43.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:43.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:43.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:43.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:44.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:44.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:44.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:44.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:44.569 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:44.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:44.566680+0000) 2019-10-23T13:16:44.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:16:44.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:44.607550+0000) 2019-10-23T13:16:44.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:16:44.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:44.605417+0000) 2019-10-23T13:16:45.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:45.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:45.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:45.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:45.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:16:45.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:45.604365+0000) 2019-10-23T13:16:46.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:46.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:46.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:46.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:47.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:47.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:47.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:47.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:48.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:16:48.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:48.084507+0000) 2019-10-23T13:16:48.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:48.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:48.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:48.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:49.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:49.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:49.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:49.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:50.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:16:50.088+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:50.090248+0000) 2019-10-23T13:16:50.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:50.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:50.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:50.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:51.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:51.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:51.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:51.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:52.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:52.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:52.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:52.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:53.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:53.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:53.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:53.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:54.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:54.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:54.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:54.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:54.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:16:54.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:54.566776+0000) 2019-10-23T13:16:54.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:16:54.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:54.607664+0000) 2019-10-23T13:16:54.610 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:16:54.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:54.605512+0000) 2019-10-23T13:16:55.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:55.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:55.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:55.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:55.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:16:55.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:55.604457+0000) 2019-10-23T13:16:56.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:56.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:56.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:56.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:57.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:57.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:57.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:57.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:58.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:16:58.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:16:58.084618+0000) 2019-10-23T13:16:58.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:58.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:58.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:58.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:16:59.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:59.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:16:59.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:16:59.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:00.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:17:00.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:00.090344+0000) 2019-10-23T13:17:00.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:00.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:00.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:00.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:01.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:01.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:01.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:01.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:02.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:02.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:02.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:02.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:03.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:03.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:03.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:03.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:04.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:04.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:04.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:04.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:04.569 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:17:04.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:04.566865+0000) 2019-10-23T13:17:04.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:17:04.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:04.607778+0000) 2019-10-23T13:17:04.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:17:04.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:04.605604+0000) 2019-10-23T13:17:05.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:05.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:05.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:05.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:05.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:17:05.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:05.604549+0000) 2019-10-23T13:17:06.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:06.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:06.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:06.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:07.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:07.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:07.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:07.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:08.089 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:17:08.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:08.084734+0000) 2019-10-23T13:17:08.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:08.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:08.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:08.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:09.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:09.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:09.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:09.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:10.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:17:10.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:10.090443+0000) 2019-10-23T13:17:10.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:10.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:10.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:10.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:11.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:11.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:11.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:11.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:12.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:12.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:12.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:12.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:13.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:13.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:13.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:13.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:14.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:14.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:14.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:14.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:14.569 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:17:14.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:14.566961+0000) 2019-10-23T13:17:14.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:17:14.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:14.607886+0000) 2019-10-23T13:17:14.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:17:14.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:14.605696+0000) 2019-10-23T13:17:15.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:15.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:15.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:15.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:15.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:17:15.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:15.604642+0000) 2019-10-23T13:17:16.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:16.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:16.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:16.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:17.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:17.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:17.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:17.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:18.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:17:18.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:18.084848+0000) 2019-10-23T13:17:18.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:18.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:18.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:18.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:19.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:19.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:19.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:19.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:20.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:17:20.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:20.090539+0000) 2019-10-23T13:17:20.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:20.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:20.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:20.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:21.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:21.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:21.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:21.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:22.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:22.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:22.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:22.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:23.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:23.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:23.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:23.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:24.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:24.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:24.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:24.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:24.569 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:17:24.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:24.567058+0000) 2019-10-23T13:17:24.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:17:24.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:24.607996+0000) 2019-10-23T13:17:24.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:17:24.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:24.605786+0000) 2019-10-23T13:17:25.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:25.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:25.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:25.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:25.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:17:25.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:25.604734+0000) 2019-10-23T13:17:26.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:26.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:26.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:26.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:27.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:27.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:27.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:27.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:28.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:17:28.083+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:28.084958+0000) 2019-10-23T13:17:28.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:28.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:28.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:28.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:29.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:29.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:29.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:29.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:30.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:17:30.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:30.090636+0000) 2019-10-23T13:17:30.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:30.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:30.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:30.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:31.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:31.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:31.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:31.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:32.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:32.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:32.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:32.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:33.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:33.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:33.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:33.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:34.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:34.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:34.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:34.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:34.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:17:34.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:34.567154+0000) 2019-10-23T13:17:34.610 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:17:34.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:34.608105+0000) 2019-10-23T13:17:34.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:17:34.604+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:34.605881+0000) 2019-10-23T13:17:35.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:35.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:35.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:35.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:35.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:17:35.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:35.604825+0000) 2019-10-23T13:17:36.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:36.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:36.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:36.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:37.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:37.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:37.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:37.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:38.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:17:38.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:38.085074+0000) 2019-10-23T13:17:38.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:38.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:38.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:38.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:39.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:39.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:39.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:39.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:40.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:17:40.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:40.090734+0000) 2019-10-23T13:17:40.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:40.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:40.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:40.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:41.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:41.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:41.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:41.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:42.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:42.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:42.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:42.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:43.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:43.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:43.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:43.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:44.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:44.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:44.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:44.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:44.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:17:44.565+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:44.567252+0000) 2019-10-23T13:17:44.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:17:44.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:44.605976+0000) 2019-10-23T13:17:44.611 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:17:44.606+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:44.608210+0000) 2019-10-23T13:17:45.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:45.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:45.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:45.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:45.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:17:45.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:45.604921+0000) 2019-10-23T13:17:46.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:46.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:46.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:46.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:47.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:47.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:47.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:47.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:48.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:17:48.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:48.085186+0000) 2019-10-23T13:17:48.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:48.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:48.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:48.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:49.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:49.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:49.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:49.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:50.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:17:50.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:50.090864+0000) 2019-10-23T13:17:50.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:50.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:50.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:50.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:51.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:51.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:51.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:51.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:52.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:52.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:52.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:52.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:53.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:53.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:53.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:53.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:54.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:54.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:54.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:54.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:54.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:17:54.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:54.567352+0000) 2019-10-23T13:17:54.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:17:54.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:54.606067+0000) 2019-10-23T13:17:54.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:17:54.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:54.608323+0000) 2019-10-23T13:17:55.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:55.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:55.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:55.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:55.607 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:17:55.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:55.605013+0000) 2019-10-23T13:17:56.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:56.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:56.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:56.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:57.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:57.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:57.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:57.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:58.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:17:58.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:17:58.085299+0000) 2019-10-23T13:17:58.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:58.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:58.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:58.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:17:59.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:59.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:17:59.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:17:59.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:00.093 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:18:00.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:00.090987+0000) 2019-10-23T13:18:00.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:00.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:00.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:00.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:01.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:01.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:01.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:01.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:02.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:02.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:02.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:02.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:03.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:03.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:03.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:03.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:04.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:04.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:04.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:04.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:04.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:18:04.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:04.567448+0000) 2019-10-23T13:18:04.611 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:18:04.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:04.608433+0000) 2019-10-23T13:18:04.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:18:04.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:04.606160+0000) 2019-10-23T13:18:05.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:05.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:05.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:05.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:05.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:18:05.603+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:05.605105+0000) 2019-10-23T13:18:06.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:06.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:06.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:06.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:07.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:07.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:07.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:07.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:08.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:18:08.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:08.085410+0000) 2019-10-23T13:18:08.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:08.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:08.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:08.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:09.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:09.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:09.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:09.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:10.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:18:10.089+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:10.091086+0000) 2019-10-23T13:18:10.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:10.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:10.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:10.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:11.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:11.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:11.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:11.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:12.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:12.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:12.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:12.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:13.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:13.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:13.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:13.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:14.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:14.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:14.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:14.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:14.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:18:14.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:14.567543+0000) 2019-10-23T13:18:14.611 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:18:14.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:14.608543+0000) 2019-10-23T13:18:14.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:18:14.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:14.606256+0000) 2019-10-23T13:18:15.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:15.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:15.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:15.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:15.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:18:15.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:15.605195+0000) 2019-10-23T13:18:16.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:16.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:16.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:16.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:17.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:17.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:17.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:17.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:18.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:18:18.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:18.085519+0000) 2019-10-23T13:18:18.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:18.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:18.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:18.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:19.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:19.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:19.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:19.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:20.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:18:20.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:20.091182+0000) 2019-10-23T13:18:20.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:20.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:20.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:20.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:21.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:21.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:21.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:21.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:22.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:22.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:22.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:22.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:23.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:23.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:23.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:23.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:24.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:24.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:24.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:24.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:24.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:18:24.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:24.567644+0000) 2019-10-23T13:18:24.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:18:24.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:24.606348+0000) 2019-10-23T13:18:24.611 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:18:24.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:24.608654+0000) 2019-10-23T13:18:25.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:25.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:25.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:25.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:25.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:18:25.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:25.605289+0000) 2019-10-23T13:18:26.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:26.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:26.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:26.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:27.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:27.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:27.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:27.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:28.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:18:28.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:28.085630+0000) 2019-10-23T13:18:28.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:28.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:28.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:28.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:29.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:29.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:29.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:29.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:30.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:18:30.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:30.091273+0000) 2019-10-23T13:18:30.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:30.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:30.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:30.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:31.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:31.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:31.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:31.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:32.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:32.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:32.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:32.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:33.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:33.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:33.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:33.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:34.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:34.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:34.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:34.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:34.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:18:34.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:34.567737+0000) 2019-10-23T13:18:34.611 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:18:34.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:34.608767+0000) 2019-10-23T13:18:34.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:18:34.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:34.606441+0000) 2019-10-23T13:18:35.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:35.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:35.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:35.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:35.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:18:35.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:35.605379+0000) 2019-10-23T13:18:36.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:36.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:36.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:36.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:37.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:37.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:37.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:37.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:38.090 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:18:38.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:38.085743+0000) 2019-10-23T13:18:38.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:38.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:38.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:38.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:39.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:39.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:39.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:39.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:40.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:18:40.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:40.091374+0000) 2019-10-23T13:18:40.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:40.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:40.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:40.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:41.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:41.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:41.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:41.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:42.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:42.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:42.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:42.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:43.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:43.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:43.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:43.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:44.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:44.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:44.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:44.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:44.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:18:44.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:44.567837+0000) 2019-10-23T13:18:44.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:18:44.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:44.608878+0000) 2019-10-23T13:18:44.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:18:44.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:44.606536+0000) 2019-10-23T13:18:45.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:45.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:45.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:45.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:45.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:18:45.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:45.605473+0000) 2019-10-23T13:18:46.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:46.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:46.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:46.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:47.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:47.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:47.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:47.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:48.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:18:48.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:48.085855+0000) 2019-10-23T13:18:48.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:48.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:48.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:48.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:49.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:49.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:49.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:49.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:50.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:18:50.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:50.091468+0000) 2019-10-23T13:18:50.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:50.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:50.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:50.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:51.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:51.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:51.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:51.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:52.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:52.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:52.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:52.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:53.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:53.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:53.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:53.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:54.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:54.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:54.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:54.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:54.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:18:54.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:54.567931+0000) 2019-10-23T13:18:54.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:18:54.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:54.606629+0000) 2019-10-23T13:18:54.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:18:54.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:54.608987+0000) 2019-10-23T13:18:55.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:55.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:55.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:55.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:55.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:18:55.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:55.605567+0000) 2019-10-23T13:18:56.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:56.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:56.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:56.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:57.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:57.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:57.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:57.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:58.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:18:58.084+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:18:58.085963+0000) 2019-10-23T13:18:58.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:58.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:58.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:58.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:18:59.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:59.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:18:59.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:18:59.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:00.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:19:00.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:00.091563+0000) 2019-10-23T13:19:00.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:00.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:00.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:00.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:01.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:01.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:01.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:01.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:02.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:02.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:02.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:02.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:03.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:03.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:03.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:03.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:04.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:04.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:04.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:04.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:04.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:19:04.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:04.568026+0000) 2019-10-23T13:19:04.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:19:04.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:04.606723+0000) 2019-10-23T13:19:04.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:19:04.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:04.609093+0000) 2019-10-23T13:19:05.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:05.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:05.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:05.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:05.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:19:05.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:05.605659+0000) 2019-10-23T13:19:06.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:06.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:06.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:06.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:07.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:07.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:07.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:07.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:08.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:19:08.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:08.086075+0000) 2019-10-23T13:19:08.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:08.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:08.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:08.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:09.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:09.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:09.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:09.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:10.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:19:10.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:10.091661+0000) 2019-10-23T13:19:10.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:10.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:10.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:10.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:11.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:11.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:11.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:11.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:12.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:12.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:12.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:12.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:13.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:13.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:13.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:13.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:14.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:14.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:14.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:14.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:14.570 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:19:14.566+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:14.568121+0000) 2019-10-23T13:19:14.611 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:19:14.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:14.606814+0000) 2019-10-23T13:19:14.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:19:14.607+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:14.609203+0000) 2019-10-23T13:19:15.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:15.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:15.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:15.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:15.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:19:15.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:15.605754+0000) 2019-10-23T13:19:16.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:16.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:16.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:16.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:17.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:17.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:17.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:17.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:18.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:19:18.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:18.086187+0000) 2019-10-23T13:19:18.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:18.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:18.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:18.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:19.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:19.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:19.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:19.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:20.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:19:20.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:20.091758+0000) 2019-10-23T13:19:20.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:20.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:20.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:20.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:21.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:21.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:21.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:21.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:22.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:22.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:22.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:22.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:23.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:23.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:23.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:23.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:24.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:24.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:24.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:24.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:24.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:19:24.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:24.568220+0000) 2019-10-23T13:19:24.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:19:24.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:24.606906+0000) 2019-10-23T13:19:24.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:19:24.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:24.609325+0000) 2019-10-23T13:19:25.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:25.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:25.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:25.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:25.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:19:25.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:25.605807+0000) 2019-10-23T13:19:26.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:26.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:26.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:26.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:27.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:27.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:27.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:27.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:28.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:19:28.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:28.086304+0000) 2019-10-23T13:19:28.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:28.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:28.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:28.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:29.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:29.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:29.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:29.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:30.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:19:30.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:30.091853+0000) 2019-10-23T13:19:30.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:30.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:30.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:30.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:31.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:31.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:31.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:31.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:32.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:32.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:32.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:32.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:33.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:33.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:33.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:33.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:34.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:34.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:34.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:34.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:34.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:19:34.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:34.568317+0000) 2019-10-23T13:19:34.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:19:34.605+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:34.607000+0000) 2019-10-23T13:19:34.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:19:34.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:34.609435+0000) 2019-10-23T13:19:35.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:35.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:35.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:35.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:35.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:19:35.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:35.605901+0000) 2019-10-23T13:19:36.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:36.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:36.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:36.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:37.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:37.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:37.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:37.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:38.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:19:38.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:38.086417+0000) 2019-10-23T13:19:38.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:38.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:38.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:38.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:39.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:39.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:39.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:39.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:40.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:19:40.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:40.091952+0000) 2019-10-23T13:19:40.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:40.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:40.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:40.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:41.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:41.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:41.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:41.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:42.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:42.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:42.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:42.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:43.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:43.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:43.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:43.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:44.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:44.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:44.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:44.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:44.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:19:44.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:44.568414+0000) 2019-10-23T13:19:44.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:19:44.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:44.607102+0000) 2019-10-23T13:19:44.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:19:44.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:44.609546+0000) 2019-10-23T13:19:45.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:45.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:45.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:45.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:45.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:19:45.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:45.605994+0000) 2019-10-23T13:19:46.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:46.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:46.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:46.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:47.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:47.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:47.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:47.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:48.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:19:48.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:48.086526+0000) 2019-10-23T13:19:48.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:48.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:48.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:48.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:49.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:49.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:49.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:49.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:50.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:19:50.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:50.092048+0000) 2019-10-23T13:19:50.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:50.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:50.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:50.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:51.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:51.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:51.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:51.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:52.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:52.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:52.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:52.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:53.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:53.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:53.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:53.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:54.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:54.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:54.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:54.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:54.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:19:54.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:54.568507+0000) 2019-10-23T13:19:54.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:19:54.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:54.607198+0000) 2019-10-23T13:19:54.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:19:54.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:54.609658+0000) 2019-10-23T13:19:55.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:55.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:55.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:55.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:55.608 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:19:55.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:55.606088+0000) 2019-10-23T13:19:56.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:56.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:56.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:56.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:57.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:57.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:57.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:57.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:58.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:19:58.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:19:58.086636+0000) 2019-10-23T13:19:58.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:58.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:58.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:58.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:19:59.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:59.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:19:59.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:19:59.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:00.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:00.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:00.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:00.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:00.094 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:20:00.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:00.092140+0000) 2019-10-23T13:20:01.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:01.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:01.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:01.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:02.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:02.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:02.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:02.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:03.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:03.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:03.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:03.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:04.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:04.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:04.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:04.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:04.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:20:04.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:04.568603+0000) 2019-10-23T13:20:04.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:20:04.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:04.607293+0000) 2019-10-23T13:20:04.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:20:04.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:04.609772+0000) 2019-10-23T13:20:05.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:05.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:05.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:05.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:05.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:20:05.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:05.606181+0000) 2019-10-23T13:20:06.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:06.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:06.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:06.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:07.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:07.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:07.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:07.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:08.091 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:20:08.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:08.086755+0000) 2019-10-23T13:20:08.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:08.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:08.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:08.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:09.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:09.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:09.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:09.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:10.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:10.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:10.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:10.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:10.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:20:10.090+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:10.092239+0000) 2019-10-23T13:20:11.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:11.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:11.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:11.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:12.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:12.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:12.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:12.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:13.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:13.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:13.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:13.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:14.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:14.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:14.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:14.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:14.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:20:14.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:14.568701+0000) 2019-10-23T13:20:14.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:20:14.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:14.607389+0000) 2019-10-23T13:20:14.612 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:20:14.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:14.609886+0000) 2019-10-23T13:20:15.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:15.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:15.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:15.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:15.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:20:15.604+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:15.606233+0000) 2019-10-23T13:20:16.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:16.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:16.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:16.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:17.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:17.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:17.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:17.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:18.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:20:18.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:18.086873+0000) 2019-10-23T13:20:18.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:18.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:18.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:18.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:19.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:19.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:19.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:19.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:20.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:20:20.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:20.092335+0000) 2019-10-23T13:20:20.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:20.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:20.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:20.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:21.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:21.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:21.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:21.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:22.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:22.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:22.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:22.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:23.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:23.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:23.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:23.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:24.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:24.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:24.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:24.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:24.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:20:24.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:24.568801+0000) 2019-10-23T13:20:24.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:20:24.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:24.607482+0000) 2019-10-23T13:20:24.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:20:24.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:24.609996+0000) 2019-10-23T13:20:25.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:25.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:25.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:25.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:25.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:20:25.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:25.606295+0000) 2019-10-23T13:20:26.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:26.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:26.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:26.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:26.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:26.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:26.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:26.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:27.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:27.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:27.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:27.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:28.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:20:28.085+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:28.086988+0000) 2019-10-23T13:20:28.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:28.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:28.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:28.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:29.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:29.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:29.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:29.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:30.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:20:30.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:30.092431+0000) 2019-10-23T13:20:30.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:30.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:30.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:30.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:31.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:31.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:31.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:31.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:32.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:32.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:32.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:32.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:33.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:33.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:33.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:33.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:34.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:20:34.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:34.568897+0000) 2019-10-23T13:20:34.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:20:34.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:34.607572+0000) 2019-10-23T13:20:34.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:20:34.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:34.610105+0000) 2019-10-23T13:20:34.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:34.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:34.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:34.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:35.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:20:35.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:35.606389+0000) 2019-10-23T13:20:35.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:35.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:35.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:35.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:36.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:36.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:36.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:36.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:37.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:37.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:37.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:37.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:38.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:20:38.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:38.087070+0000) 2019-10-23T13:20:38.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:38.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:38.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:38.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:39.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:39.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:39.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:39.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:40.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:20:40.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:40.092527+0000) 2019-10-23T13:20:40.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:40.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:40.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:40.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:41.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:41.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:41.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:41.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:42.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:42.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:42.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:42.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:43.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:43.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:43.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:43.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:44.571 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:20:44.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:44.568998+0000) 2019-10-23T13:20:44.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:20:44.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:44.607665+0000) 2019-10-23T13:20:44.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:20:44.608+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:44.610217+0000) 2019-10-23T13:20:44.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:44.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:44.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:44.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:45.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:20:45.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:45.606480+0000) 2019-10-23T13:20:45.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:45.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:45.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:45.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:46.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:46.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:46.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:46.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:47.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:47.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:47.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:47.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:48.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:20:48.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:48.087184+0000) 2019-10-23T13:20:48.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:48.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:48.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:48.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:49.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:49.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:49.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:49.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:50.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:20:50.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:50.092626+0000) 2019-10-23T13:20:50.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:50.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:50.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:50.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:51.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:51.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:51.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:51.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:52.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:52.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:52.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:52.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:53.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:53.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:53.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:53.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:54.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:20:54.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:54.569097+0000) 2019-10-23T13:20:54.612 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:20:54.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:54.607755+0000) 2019-10-23T13:20:54.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:20:54.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:54.610326+0000) 2019-10-23T13:20:54.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:54.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:54.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:54.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:55.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:20:55.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:55.606578+0000) 2019-10-23T13:20:55.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:55.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:55.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:55.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:56.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:56.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:56.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:56.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:57.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:57.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:57.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:57.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:58.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:20:58.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:20:58.087298+0000) 2019-10-23T13:20:58.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:58.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:58.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:58.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:20:59.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:59.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:20:59.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:20:59.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:00.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:21:00.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:00.092717+0000) 2019-10-23T13:21:00.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:00.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:00.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:00.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:01.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:01.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:01.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:01.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:02.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:02.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:02.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:02.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:03.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:03.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:03.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:03.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:04.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:21:04.567+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:04.569196+0000) 2019-10-23T13:21:04.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:21:04.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:04.607849+0000) 2019-10-23T13:21:04.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:21:04.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:04.610434+0000) 2019-10-23T13:21:04.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:04.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:04.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:04.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:05.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:21:05.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:05.606671+0000) 2019-10-23T13:21:05.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:05.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:05.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:05.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:06.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:06.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:06.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:06.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:07.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:07.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:07.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:07.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:08.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:21:08.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:08.087417+0000) 2019-10-23T13:21:08.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:08.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:08.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:08.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:09.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:09.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:09.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:09.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:10.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:21:10.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:10.092811+0000) 2019-10-23T13:21:10.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:10.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:10.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:10.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:11.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:11.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:11.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:11.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:12.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:12.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:12.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:12.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:13.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:13.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:13.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:13.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:14.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:21:14.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:14.569297+0000) 2019-10-23T13:21:14.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:21:14.606+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:14.607941+0000) 2019-10-23T13:21:14.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:21:14.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:14.610543+0000) 2019-10-23T13:21:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:14.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:14.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:15.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:21:15.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:15.606766+0000) 2019-10-23T13:21:15.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:15.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:15.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:15.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:16.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:16.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:16.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:16.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:17.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:17.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:17.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:17.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:18.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:21:18.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:18.087529+0000) 2019-10-23T13:21:18.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:18.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:18.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:18.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:19.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:19.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:19.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:19.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:20.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:21:20.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:20.092911+0000) 2019-10-23T13:21:20.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:20.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:20.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:20.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:21.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:21.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:21.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:21.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:22.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:22.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:22.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:22.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:23.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:23.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:23.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:23.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:24.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:21:24.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:24.569395+0000) 2019-10-23T13:21:24.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:21:24.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:24.608033+0000) 2019-10-23T13:21:24.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:21:24.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:24.610699+0000) 2019-10-23T13:21:24.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:24.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:24.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:24.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:25.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:21:25.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:25.606863+0000) 2019-10-23T13:21:25.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:25.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:25.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:25.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:26.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:26.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:26.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:26.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:27.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:27.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:27.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:27.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:28.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:21:28.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:28.087626+0000) 2019-10-23T13:21:28.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:28.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:28.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:28.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:29.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:29.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:29.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:29.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:30.095 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:21:30.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:30.093004+0000) 2019-10-23T13:21:30.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:30.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:30.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:30.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:31.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:31.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:31.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:31.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:32.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:32.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:32.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:32.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:33.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:33.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:33.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:33.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:34.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:21:34.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:34.569493+0000) 2019-10-23T13:21:34.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:21:34.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:34.608127+0000) 2019-10-23T13:21:34.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:21:34.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:34.610808+0000) 2019-10-23T13:21:34.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:34.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:34.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:34.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:35.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:21:35.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:35.606958+0000) 2019-10-23T13:21:35.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:35.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:35.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:35.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:36.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:36.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:36.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:36.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:37.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:37.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:37.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:37.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:38.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:21:38.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:38.087743+0000) 2019-10-23T13:21:38.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:38.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:38.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:38.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:39.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:39.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:39.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:39.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:40.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:21:40.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:40.093100+0000) 2019-10-23T13:21:40.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:40.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:40.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:40.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:41.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:41.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:41.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:41.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:42.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:42.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:42.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:42.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:43.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:43.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:43.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:43.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:44.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:21:44.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:44.569590+0000) 2019-10-23T13:21:44.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:21:44.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:44.608221+0000) 2019-10-23T13:21:44.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:21:44.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:44.610917+0000) 2019-10-23T13:21:44.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:44.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:44.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:44.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:45.609 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:21:45.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:45.607053+0000) 2019-10-23T13:21:45.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:45.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:45.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:45.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:46.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:46.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:46.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:46.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:47.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:47.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:47.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:47.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:48.092 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:21:48.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:48.087857+0000) 2019-10-23T13:21:48.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:48.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:48.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:48.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:49.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:49.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:49.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:49.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:50.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:21:50.091+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:50.093197+0000) 2019-10-23T13:21:50.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:50.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:50.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:50.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:51.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:51.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:51.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:51.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:52.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:52.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:52.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:52.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:53.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:53.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:53.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:53.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:54.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:21:54.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:54.569687+0000) 2019-10-23T13:21:54.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:21:54.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:54.608314+0000) 2019-10-23T13:21:54.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:21:54.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:54.611027+0000) 2019-10-23T13:21:54.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:54.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:54.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:54.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:55.610 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:21:55.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:55.607147+0000) 2019-10-23T13:21:55.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:55.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:55.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:55.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:56.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:56.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:56.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:56.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:57.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:57.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:57.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:57.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:58.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:21:58.086+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:21:58.087973+0000) 2019-10-23T13:21:58.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:58.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:58.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:58.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:21:59.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:59.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:21:59.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:21:59.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:00.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:22:00.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:00.093295+0000) 2019-10-23T13:22:00.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:00.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:00.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:00.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:01.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:01.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:01.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:01.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:02.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:02.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:02.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:02.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:03.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:03.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:03.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:03.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:04.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:22:04.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:04.569782+0000) 2019-10-23T13:22:04.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:22:04.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:04.608407+0000) 2019-10-23T13:22:04.613 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:22:04.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:04.611138+0000) 2019-10-23T13:22:04.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:04.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:04.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:04.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:05.610 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:05.605+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:05.607241+0000) 2019-10-23T13:22:05.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:05.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:05.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:05.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:06.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:06.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:06.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:06.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:07.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:07.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:07.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:07.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:08.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:22:08.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:08.088094+0000) 2019-10-23T13:22:08.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:08.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:08.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:08.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:09.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:09.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:09.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:09.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:10.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:22:10.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:10.093395+0000) 2019-10-23T13:22:10.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:10.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:10.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:10.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:11.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:11.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:11.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:11.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:12.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:12.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:12.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:12.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:13.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:13.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:13.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:13.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:14.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:22:14.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:14.569876+0000) 2019-10-23T13:22:14.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:22:14.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:14.608504+0000) 2019-10-23T13:22:14.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:22:14.609+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:14.611248+0000) 2019-10-23T13:22:14.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:14.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:14.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:14.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:15.610 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:15.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:15.607334+0000) 2019-10-23T13:22:15.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:15.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:15.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:15.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:16.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:16.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:16.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:16.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:17.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:17.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:17.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:17.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 144 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:18.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:22:18.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:18.088216+0000) 2019-10-23T13:22:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:18.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:18.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:18.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:19.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:19.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:19.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:19.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:20.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:22:20.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:20.093492+0000) 2019-10-23T13:22:20.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:20.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:20.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:20.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:21.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:21.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:21.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:21.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:22.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:22.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:22.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:22.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:23.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:23.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:23.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:23.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:24.572 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:22:24.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:24.569974+0000) 2019-10-23T13:22:24.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:22:24.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:24.608598+0000) 2019-10-23T13:22:24.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:22:24.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:24.611322+0000) 2019-10-23T13:22:24.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:24.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:24.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:24.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:25.610 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:25.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:25.607422+0000) 2019-10-23T13:22:25.610 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:25.606+0000 7f9e30a8f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:25.608083+0000) 2019-10-23T13:22:25.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:25.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:25.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:25.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:26.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:26.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:26.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:26.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:27.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:27.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:27.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:27.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:28.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:22:28.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:28.088329+0000) 2019-10-23T13:22:28.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:28.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:28.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:28.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:29.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:29.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:29.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:29.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:30.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:22:30.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:30.093581+0000) 2019-10-23T13:22:30.110 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:30.106+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:30.107620+0000) 2019-10-23T13:22:30.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:30.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:30.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:30.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:31.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:31.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:31.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:31.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:32.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:32.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:32.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:32.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:33.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:33.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:33.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:33.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:34.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:22:34.568+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:34.570071+0000) 2019-10-23T13:22:34.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:22:34.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:34.608692+0000) 2019-10-23T13:22:34.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:22:34.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:34.611436+0000) 2019-10-23T13:22:34.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:34.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:34.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:34.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:35.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:35.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:35.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:35.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:36.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:36.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:36.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:36.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:37.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:37.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:37.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:37.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:38.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:22:38.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:38.088443+0000) 2019-10-23T13:22:38.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:38.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:38.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:38.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:39.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:39.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:39.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:39.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:40.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:22:40.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:40.093686+0000) 2019-10-23T13:22:40.110 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:40.107+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:40.107714+0000) 2019-10-23T13:22:40.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:40.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:40.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:40.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:41.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:41.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:41.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:41.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:42.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:42.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:42.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:42.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:43.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:43.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:43.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:43.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:44.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:44.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:44.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:44.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:44.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:22:44.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:44.570165+0000) 2019-10-23T13:22:44.613 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:22:44.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:44.608786+0000) 2019-10-23T13:22:44.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:22:44.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:44.611543+0000) 2019-10-23T13:22:45.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:45.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:45.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:45.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:46.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:46.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:46.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:46.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:47.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:47.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:47.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:47.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:48.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:22:48.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:48.088554+0000) 2019-10-23T13:22:48.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:48.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:48.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:48.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:49.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:49.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:49.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:49.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:50.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:22:50.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:50.093787+0000) 2019-10-23T13:22:50.110 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:22:50.107+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:50.107806+0000) 2019-10-23T13:22:50.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:50.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:50.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:50.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:51.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:51.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:51.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:51.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:52.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:52.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:52.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:52.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:53.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:53.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:53.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:53.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:54.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:22:54.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:54.570264+0000) 2019-10-23T13:22:54.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:22:54.607+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:54.608891+0000) 2019-10-23T13:22:54.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:22:54.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:54.611655+0000) 2019-10-23T13:22:54.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:54.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:54.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:54.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:55.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:55.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:55.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:55.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:56.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:56.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:56.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:56.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:57.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:57.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:57.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:57.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:58.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:22:58.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:22:58.088671+0000) 2019-10-23T13:22:58.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:58.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:58.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:58.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:22:59.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:59.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:22:59.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:22:59.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:00.096 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:23:00.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:00.093884+0000) 2019-10-23T13:23:00.110 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:00.106+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:00.107901+0000) 2019-10-23T13:23:00.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:00.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:00.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:00.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:01.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:01.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:01.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:01.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:02.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:02.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:02.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:02.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:03.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:03.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:03.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:03.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:04.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:23:04.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:04.570361+0000) 2019-10-23T13:23:04.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:23:04.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:04.609018+0000) 2019-10-23T13:23:04.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:23:04.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:04.611765+0000) 2019-10-23T13:23:04.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:04.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:04.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:04.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:05.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:05.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:05.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:05.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:06.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:06.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:06.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:06.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:07.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:07.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:07.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:07.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:08.093 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:23:08.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:08.088785+0000) 2019-10-23T13:23:08.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:08.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:08.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:08.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:09.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:09.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:09.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:09.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:10.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:23:10.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:10.093986+0000) 2019-10-23T13:23:10.110 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:10.106+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:10.107995+0000) 2019-10-23T13:23:10.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:10.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:10.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:10.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:11.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:11.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:11.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:11.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:12.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:12.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:12.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:12.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:13.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:13.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:13.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:13.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:14.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:23:14.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:14.570460+0000) 2019-10-23T13:23:14.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:23:14.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:14.609115+0000) 2019-10-23T13:23:14.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:23:14.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:14.611879+0000) 2019-10-23T13:23:14.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:14.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:14.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:14.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:15.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:15.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:15.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:16.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:16.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:16.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:16.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:17.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:17.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:17.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:17.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:18.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:23:18.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:18.088902+0000) 2019-10-23T13:23:18.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:18.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:18.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:18.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:19.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:19.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:19.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:19.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:20.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:23:20.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:20.094081+0000) 2019-10-23T13:23:20.111 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:20.106+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:20.108084+0000) 2019-10-23T13:23:20.111 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:20.107+0000 7f9e31a91700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:20.108762+0000) 2019-10-23T13:23:20.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:20.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:20.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:20.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:21.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:21.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:21.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:21.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:22.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:22.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:22.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:22.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:23.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:23.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:23.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:23.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:24.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:23:24.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:24.570557+0000) 2019-10-23T13:23:24.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:24.606+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:24.608267+0000) 2019-10-23T13:23:24.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:23:24.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:24.609209+0000) 2019-10-23T13:23:24.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:23:24.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:24.611990+0000) 2019-10-23T13:23:24.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:24.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:24.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:24.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:25.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:25.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:25.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:25.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:26.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:26.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:26.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:26.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:27.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:27.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:27.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:27.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:28.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:23:28.087+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:28.089016+0000) 2019-10-23T13:23:28.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:28.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:28.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:28.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:29.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:29.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:29.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:29.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:30.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:23:30.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:30.094176+0000) 2019-10-23T13:23:30.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:30.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:30.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:30.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:31.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:31.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:31.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:31.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:32.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:32.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:32.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:32.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:33.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:33.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:33.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:33.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:34.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:23:34.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:34.570653+0000) 2019-10-23T13:23:34.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:34.607+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:34.608366+0000) 2019-10-23T13:23:34.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:23:34.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:34.609304+0000) 2019-10-23T13:23:34.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:23:34.610+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:34.612099+0000) 2019-10-23T13:23:34.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:34.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:34.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:34.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:35.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:35.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:35.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:35.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:36.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:36.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:36.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:36.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:37.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:37.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:37.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:37.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:38.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:23:38.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:38.089144+0000) 2019-10-23T13:23:38.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:38.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:38.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:38.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:39.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:39.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:39.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:39.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:40.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:23:40.092+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:40.094268+0000) 2019-10-23T13:23:40.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:40.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:40.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:40.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:41.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:41.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:41.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:41.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:42.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:42.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:42.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:42.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:43.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:43.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:43.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:43.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:44.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:23:44.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:44.570752+0000) 2019-10-23T13:23:44.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:44.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:44.608458+0000) 2019-10-23T13:23:44.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:23:44.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:44.609400+0000) 2019-10-23T13:23:44.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:23:44.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:44.612206+0000) 2019-10-23T13:23:44.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:44.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:44.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:44.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:45.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:45.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:45.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:45.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:46.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:46.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:46.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:46.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:47.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:47.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:47.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:47.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:48.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:23:48.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:48.089258+0000) 2019-10-23T13:23:48.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:48.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:48.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:48.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:49.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:49.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:49.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:49.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:50.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:23:50.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:50.094382+0000) 2019-10-23T13:23:50.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:50.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:50.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:50.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:51.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:51.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:51.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:51.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:52.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:52.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:52.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:52.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:53.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:53.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:53.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:53.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:54.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:23:54.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:54.570850+0000) 2019-10-23T13:23:54.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:23:54.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:54.608553+0000) 2019-10-23T13:23:54.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:23:54.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:54.609494+0000) 2019-10-23T13:23:54.614 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:23:54.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:54.612320+0000) 2019-10-23T13:23:54.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:54.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:54.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:54.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:55.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:55.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:55.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:55.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:56.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:56.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:56.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:56.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:57.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:57.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:57.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:57.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:58.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:23:58.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:23:58.089376+0000) 2019-10-23T13:23:58.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:58.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:58.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:58.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:23:59.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:59.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:23:59.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:23:59.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:00.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:24:00.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:00.094482+0000) 2019-10-23T13:24:00.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:00.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:00.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:00.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:01.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:01.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:01.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:01.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:02.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:02.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:02.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:02.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:03.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:03.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:03.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:03.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:04.573 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:24:04.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:04.570946+0000) 2019-10-23T13:24:04.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:24:04.607+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:04.608647+0000) 2019-10-23T13:24:04.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:24:04.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:04.609589+0000) 2019-10-23T13:24:04.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:24:04.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:04.612424+0000) 2019-10-23T13:24:04.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:04.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:04.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:04.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:05.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:05.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:05.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:05.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:06.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:06.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:06.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:06.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:07.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:07.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:07.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:07.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:08.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:24:08.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:08.089491+0000) 2019-10-23T13:24:08.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:08.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:08.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:08.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:09.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:09.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:09.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:09.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:10.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:24:10.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:10.094583+0000) 2019-10-23T13:24:10.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:10.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:10.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:10.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:11.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:11.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:11.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:11.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:12.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:12.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:12.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:12.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:13.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:13.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:13.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:13.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:14.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:24:14.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:14.571043+0000) 2019-10-23T13:24:14.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:24:14.607+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:14.608744+0000) 2019-10-23T13:24:14.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:24:14.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:14.609684+0000) 2019-10-23T13:24:14.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:24:14.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:14.612535+0000) 2019-10-23T13:24:14.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:14.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:14.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:14.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:15.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:15.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:15.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:15.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:16.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:16.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:16.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:16.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:17.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:17.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:17.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:17.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:18.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:24:18.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:18.089608+0000) 2019-10-23T13:24:18.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:18.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:18.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:18.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:19.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:19.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:19.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:19.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:20.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:24:20.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:20.094685+0000) 2019-10-23T13:24:20.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:20.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:20.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:20.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:21.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:21.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:21.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:21.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:22.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:22.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:22.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:22.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:23.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:23.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:23.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:23.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:24.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:24:24.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:24.571140+0000) 2019-10-23T13:24:24.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:24:24.607+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:24.608842+0000) 2019-10-23T13:24:24.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:24:24.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:24.609780+0000) 2019-10-23T13:24:24.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:24:24.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:24.612647+0000) 2019-10-23T13:24:24.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:24.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:24.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:24.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:25.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:25.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:25.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:25.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:26.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:26.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:26.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:26.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:27.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:27.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:27.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:27.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:28.094 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:24:28.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:28.089724+0000) 2019-10-23T13:24:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:28.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:28.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:29.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:29.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:29.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:29.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:30.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:24:30.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:30.094777+0000) 2019-10-23T13:24:30.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:30.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:30.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:30.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:31.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:31.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:31.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:31.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:32.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:32.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:32.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:32.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:33.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:33.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:33.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:33.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:34.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:24:34.569+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:34.571239+0000) 2019-10-23T13:24:34.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:24:34.607+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:34.608940+0000) 2019-10-23T13:24:34.614 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:24:34.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:34.609875+0000) 2019-10-23T13:24:34.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:24:34.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:34.612754+0000) 2019-10-23T13:24:34.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:34.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:34.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:34.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:35.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:35.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:35.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:35.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:36.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:36.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:36.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:36.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:37.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:37.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:37.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:37.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:38.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:24:38.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:38.089840+0000) 2019-10-23T13:24:38.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:38.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:38.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:38.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:39.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:39.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:39.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:39.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:40.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:24:40.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:40.094875+0000) 2019-10-23T13:24:40.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:40.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:40.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:40.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:41.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:41.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:41.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:41.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:42.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:42.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:42.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:42.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:43.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:43.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:43.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:43.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:44.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:24:44.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:44.571297+0000) 2019-10-23T13:24:44.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:24:44.607+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:44.609037+0000) 2019-10-23T13:24:44.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:24:44.608+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:44.609987+0000) 2019-10-23T13:24:44.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:24:44.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:44.612860+0000) 2019-10-23T13:24:44.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:44.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:44.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:44.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:45.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:45.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:45.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:45.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:46.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:46.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:46.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:46.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:47.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:47.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:47.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:47.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:48.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:24:48.088+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:48.089951+0000) 2019-10-23T13:24:48.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:48.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:48.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:48.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:49.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:49.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:49.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:49.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:50.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:24:50.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:50.094971+0000) 2019-10-23T13:24:50.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:50.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:50.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:50.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:51.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:51.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:51.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:51.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:52.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:52.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:52.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:52.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:53.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:53.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:53.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:53.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:54.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:24:54.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:54.571392+0000) 2019-10-23T13:24:54.611 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:24:54.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:54.609133+0000) 2019-10-23T13:24:54.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:24:54.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:54.610080+0000) 2019-10-23T13:24:54.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:24:54.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:54.612972+0000) 2019-10-23T13:24:54.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:54.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:54.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:54.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:55.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:55.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:55.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:55.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:56.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:56.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:56.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:56.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:57.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:57.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:57.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:57.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:58.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:24:58.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:24:58.090063+0000) 2019-10-23T13:24:58.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:58.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:58.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:58.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:24:59.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:59.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:24:59.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:24:59.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:00.097 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:25:00.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:00.095062+0000) 2019-10-23T13:25:00.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:00.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:25:00.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:00.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:01.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:01.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:25:01.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:01.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:02.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:02.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:25:02.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:02.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:03.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:03.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:25:03.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:03.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:04.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:25:04.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:04.571484+0000) 2019-10-23T13:25:04.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:25:04.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:04.609226+0000) 2019-10-23T13:25:04.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:25:04.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:04.610176+0000) 2019-10-23T13:25:04.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:25:04.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:04.613083+0000) 2019-10-23T13:25:04.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:04.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:14:35.253814+0000 (oldest deadline 2019-10-23T13:14:55.253814+0000) 2019-10-23T13:25:04.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:04.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:05.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:05.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:07.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:07.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:08.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:08.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:08.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:25:08.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:08.090179+0000) 2019-10-23T13:25:09.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:09.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:10.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:10.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:10.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:25:10.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:10.095154+0000) 2019-10-23T13:25:11.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:11.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:12.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:12.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:13.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:13.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:14.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:14.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:14.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:25:14.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:14.571583+0000) 2019-10-23T13:25:14.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:25:14.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:14.609296+0000) 2019-10-23T13:25:14.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:25:14.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:14.610271+0000) 2019-10-23T13:25:14.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:25:14.611+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:14.613189+0000) 2019-10-23T13:25:15.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:15.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:16.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:16.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:17.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:17.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:18.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:18.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:18.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:25:18.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:18.090299+0000) 2019-10-23T13:25:19.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:19.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:20.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:20.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:20.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:25:20.093+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:20.095246+0000) 2019-10-23T13:25:21.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:21.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:22.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:22.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:23.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:23.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:24.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:24.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:24.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:25:24.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:24.571679+0000) 2019-10-23T13:25:24.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:25:24.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:24.609389+0000) 2019-10-23T13:25:24.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:25:24.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:24.610365+0000) 2019-10-23T13:25:24.615 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:25:24.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:24.613296+0000) 2019-10-23T13:25:25.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:25.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:26.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:26.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:27.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:27.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:28.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:25:28.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:28.090413+0000) 2019-10-23T13:25:28.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:28.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:29.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:29.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:29.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:29.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:30.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:25:30.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:30.095340+0000) 2019-10-23T13:25:30.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:30.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:30.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:30.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:31.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:31.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:31.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:31.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:32.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:32.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:32.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:32.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:33.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:33.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:33.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:33.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:34.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:34.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:34.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:34.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:34.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:25:34.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:34.571773+0000) 2019-10-23T13:25:34.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:25:34.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:34.609485+0000) 2019-10-23T13:25:34.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:25:34.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:34.610459+0000) 2019-10-23T13:25:34.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:25:34.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:34.613404+0000) 2019-10-23T13:25:35.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:35.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:35.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:35.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:36.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:36.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:36.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:36.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:37.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:37.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:37.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:37.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:38.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:25:38.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:38.090533+0000) 2019-10-23T13:25:38.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:38.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:38.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:38.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:39.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:39.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:39.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:39.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:40.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:25:40.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:40.095439+0000) 2019-10-23T13:25:40.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:40.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:40.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:40.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:41.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:41.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:41.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:41.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:42.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:42.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:42.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:42.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:43.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:43.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:43.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:43.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:44.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:44.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:44.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:44.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:44.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:25:44.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:44.571869+0000) 2019-10-23T13:25:44.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:25:44.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:44.609577+0000) 2019-10-23T13:25:44.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:25:44.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:44.610553+0000) 2019-10-23T13:25:44.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:25:44.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:44.613508+0000) 2019-10-23T13:25:45.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:45.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:45.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:45.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:46.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:46.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:46.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:46.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:47.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:47.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:47.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:47.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:48.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:25:48.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:48.090640+0000) 2019-10-23T13:25:48.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:48.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:48.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:48.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:49.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:49.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:49.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:49.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:50.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:25:50.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:50.095534+0000) 2019-10-23T13:25:50.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:50.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:50.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:50.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:51.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:51.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:51.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:51.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:52.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:52.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:52.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:52.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:53.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:53.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:53.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:53.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:54.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:54.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:54.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:54.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:54.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:25:54.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:54.571964+0000) 2019-10-23T13:25:54.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:25:54.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:54.609675+0000) 2019-10-23T13:25:54.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:25:54.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:54.610647+0000) 2019-10-23T13:25:54.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:25:54.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:54.613615+0000) 2019-10-23T13:25:55.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:55.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:55.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:55.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:56.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:56.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:56.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:56.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:57.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:57.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:57.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:57.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:58.095 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:25:58.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:25:58.090748+0000) 2019-10-23T13:25:58.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:58.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:58.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:58.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:25:59.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:59.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:25:59.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:25:59.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:00.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:26:00.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:00.095630+0000) 2019-10-23T13:26:00.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:00.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:00.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:00.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:01.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:01.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:01.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:01.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:02.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:02.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:02.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:02.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:03.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:03.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:03.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:03.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:04.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:04.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:04.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:04.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:04.574 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:26:04.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:04.572073+0000) 2019-10-23T13:26:04.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:26:04.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:04.609779+0000) 2019-10-23T13:26:04.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:26:04.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:04.610742+0000) 2019-10-23T13:26:04.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:26:04.613+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:04.613725+0000) 2019-10-23T13:26:05.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:05.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:05.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:05.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:06.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:06.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:06.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:06.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:07.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:07.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:07.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:07.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:08.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:26:08.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:08.090864+0000) 2019-10-23T13:26:08.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:08.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:08.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:08.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:09.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:09.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:09.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:09.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:10.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:26:10.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:10.095729+0000) 2019-10-23T13:26:10.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:10.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:10.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:10.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:11.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:11.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:11.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:11.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:12.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:12.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:12.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:12.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:13.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:13.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:13.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:13.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:14.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:14.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:14.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:14.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:26:14.570+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:14.572218+0000) 2019-10-23T13:26:14.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:26:14.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:14.609901+0000) 2019-10-23T13:26:14.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:26:14.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:14.610835+0000) 2019-10-23T13:26:14.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:26:14.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:14.613831+0000) 2019-10-23T13:26:15.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:15.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:15.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:15.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:16.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:16.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:16.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:16.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:17.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:17.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:17.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:17.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:18.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:26:18.089+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:18.090980+0000) 2019-10-23T13:26:18.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:18.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:18.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:18.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:19.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:19.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:19.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:19.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:20.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:26:20.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:20.095826+0000) 2019-10-23T13:26:20.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:20.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:20.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:20.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:21.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:21.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:21.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:21.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:22.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:22.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:22.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:22.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:23.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:23.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:23.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:23.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:24.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:24.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:24.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:24.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:24.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:26:24.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:24.572311+0000) 2019-10-23T13:26:24.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:26:24.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:24.609996+0000) 2019-10-23T13:26:24.615 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:26:24.609+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:24.610931+0000) 2019-10-23T13:26:24.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:26:24.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:24.613940+0000) 2019-10-23T13:26:25.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:25.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:25.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:25.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:26.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:26.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:26.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:26.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:27.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:27.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:27.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:27.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:28.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:26:28.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:28.091089+0000) 2019-10-23T13:26:28.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:28.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:28.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:28.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:29.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:29.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:29.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:29.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:30.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:26:30.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:30.095925+0000) 2019-10-23T13:26:30.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:30.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:30.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:30.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:31.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:31.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:31.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:31.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:32.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:32.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:32.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:32.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:33.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:33.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:33.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:33.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:34.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:34.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:34.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:34.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:34.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:26:34.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:34.572408+0000) 2019-10-23T13:26:34.612 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:26:34.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:34.610087+0000) 2019-10-23T13:26:34.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:26:34.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:34.611029+0000) 2019-10-23T13:26:34.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:26:34.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:34.614049+0000) 2019-10-23T13:26:35.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:35.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:35.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:35.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:36.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:36.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:36.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:36.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:37.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:37.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:37.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:37.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:38.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:26:38.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:38.091202+0000) 2019-10-23T13:26:38.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:38.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:38.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:38.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:39.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:39.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:39.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:39.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:40.098 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:26:40.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:40.096024+0000) 2019-10-23T13:26:40.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:40.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:40.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:40.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:41.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:41.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:41.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:41.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:42.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:42.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:42.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:42.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:43.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:43.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:43.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:43.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:44.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:26:44.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:44.572502+0000) 2019-10-23T13:26:44.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:26:44.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:44.610181+0000) 2019-10-23T13:26:44.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:26:44.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:44.611124+0000) 2019-10-23T13:26:44.616 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:26:44.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:44.614161+0000) 2019-10-23T13:26:44.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:44.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:44.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:44.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:45.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:45.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:45.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:45.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:46.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:46.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:46.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:46.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:47.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:47.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:47.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:47.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:48.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:26:48.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:48.091315+0000) 2019-10-23T13:26:48.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:48.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:48.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:48.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:49.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:49.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:49.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:49.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:50.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:26:50.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:50.096121+0000) 2019-10-23T13:26:50.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:50.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:50.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:50.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:51.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:51.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:51.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:51.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:52.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:52.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:52.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:52.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:53.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:53.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:53.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:53.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:54.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:26:54.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:54.572597+0000) 2019-10-23T13:26:54.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:54.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:54.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:54.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:54.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:26:54.608+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:54.610271+0000) 2019-10-23T13:26:54.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:26:54.612+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:54.614274+0000) 2019-10-23T13:26:54.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:26:54.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:54.611216+0000) 2019-10-23T13:26:55.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:55.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:55.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:55.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:56.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:56.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:56.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:56.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:57.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:57.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:57.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:57.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:58.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:26:58.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:26:58.091421+0000) 2019-10-23T13:26:58.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:58.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:58.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:58.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:26:59.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:59.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:26:59.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:26:59.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:00.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:27:00.094+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:00.096215+0000) 2019-10-23T13:27:00.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:00.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:00.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:00.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:01.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:01.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:01.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:01.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:02.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:02.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:02.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:02.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:03.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:03.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:03.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:03.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:04.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:27:04.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:04.572691+0000) 2019-10-23T13:27:04.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:04.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:04.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:04.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:04.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:27:04.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:04.610368+0000) 2019-10-23T13:27:04.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:27:04.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:04.611314+0000) 2019-10-23T13:27:04.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:27:04.614+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:04.614390+0000) 2019-10-23T13:27:05.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:05.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:05.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:05.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:06.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:06.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:06.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:06.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:07.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:07.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:07.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:07.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:08.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:27:08.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:08.091528+0000) 2019-10-23T13:27:08.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:08.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:08.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:08.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:09.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:09.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:09.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:09.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:10.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:27:10.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:10.096298+0000) 2019-10-23T13:27:10.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:10.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:10.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:10.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:11.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:11.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:11.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:11.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:12.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:12.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:12.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:12.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:13.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:13.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:13.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:13.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:14.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:27:14.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:14.572786+0000) 2019-10-23T13:27:14.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:27:14.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:14.610460+0000) 2019-10-23T13:27:14.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:14.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:14.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:14.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:14.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:27:14.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:14.611409+0000) 2019-10-23T13:27:14.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:27:14.614+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:14.614495+0000) 2019-10-23T13:27:15.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:15.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:15.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:15.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:16.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:16.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:16.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:16.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:17.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:17.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:17.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:17.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:18.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:27:18.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:18.091638+0000) 2019-10-23T13:27:18.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:18.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:18.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:18.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:19.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:19.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:19.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:19.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:20.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:27:20.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:20.096395+0000) 2019-10-23T13:27:20.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:20.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:20.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:20.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:21.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:21.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:21.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:21.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:22.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:22.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:22.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:22.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:23.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:23.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:23.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:23.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:24.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:27:24.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:24.572879+0000) 2019-10-23T13:27:24.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:27:24.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:24.610553+0000) 2019-10-23T13:27:24.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:27:24.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:24.611503+0000) 2019-10-23T13:27:24.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:27:24.613+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:24.614605+0000) 2019-10-23T13:27:24.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:24.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:24.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:24.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:25.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:25.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:25.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:25.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:26.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:26.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:26.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:26.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:27.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:27.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:27.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:27.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:28.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:27:28.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:28.091754+0000) 2019-10-23T13:27:28.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:28.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:28.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:28.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:29.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:29.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:29.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:29.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:30.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:27:30.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:30.096499+0000) 2019-10-23T13:27:30.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:30.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:30.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:30.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:31.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:31.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:31.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:31.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:32.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:32.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:32.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:32.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:33.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:33.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:33.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:33.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:34.575 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:27:34.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:34.572972+0000) 2019-10-23T13:27:34.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:27:34.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:34.610649+0000) 2019-10-23T13:27:34.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:27:34.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:34.611597+0000) 2019-10-23T13:27:34.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:27:34.613+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:34.614716+0000) 2019-10-23T13:27:34.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:34.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:34.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:34.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:35.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:35.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:35.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:35.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:36.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:36.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:36.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:36.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:37.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:37.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:37.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:37.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:38.096 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:27:38.090+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:38.091870+0000) 2019-10-23T13:27:38.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:38.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:38.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:38.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:39.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:39.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:39.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:39.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:40.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:27:40.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:40.096600+0000) 2019-10-23T13:27:40.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:40.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:40.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:40.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:41.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:41.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:41.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:41.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:42.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:42.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:42.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:42.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:43.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:43.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:43.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:43.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:44.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:27:44.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:44.573066+0000) 2019-10-23T13:27:44.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:27:44.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:44.610744+0000) 2019-10-23T13:27:44.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:27:44.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:44.611689+0000) 2019-10-23T13:27:44.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:27:44.613+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:44.614823+0000) 2019-10-23T13:27:44.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:44.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:44.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:44.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:45.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:45.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:45.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:45.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:46.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:46.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:46.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:46.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:47.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:47.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:47.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:47.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:48.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:27:48.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:48.092090+0000) 2019-10-23T13:27:48.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:48.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:48.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:48.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:49.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:49.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:49.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:49.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:50.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:27:50.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:50.096696+0000) 2019-10-23T13:27:50.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:50.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:50.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:50.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:51.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:51.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:51.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:51.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:52.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:52.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:52.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:52.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:53.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:53.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:53.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:53.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:54.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:54.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:54.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:54.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:54.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:27:54.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:54.573160+0000) 2019-10-23T13:27:54.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:27:54.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:54.610842+0000) 2019-10-23T13:27:54.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:27:54.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:54.611784+0000) 2019-10-23T13:27:54.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:27:54.613+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:54.614928+0000) 2019-10-23T13:27:55.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:55.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:55.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:55.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:56.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:56.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:56.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:56.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:57.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:57.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:57.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:57.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:58.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:27:58.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:27:58.092209+0000) 2019-10-23T13:27:58.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:58.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:58.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:58.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:27:59.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:59.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:27:59.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:27:59.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:00.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:28:00.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:00.096792+0000) 2019-10-23T13:28:00.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:00.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:00.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:00.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:01.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:01.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:01.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:01.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:02.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:02.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:02.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:02.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:03.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:03.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:03.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:03.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:04.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:04.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:04.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:04.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:04.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:28:04.571+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:04.573256+0000) 2019-10-23T13:28:04.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:28:04.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:04.610936+0000) 2019-10-23T13:28:04.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:28:04.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:04.611880+0000) 2019-10-23T13:28:04.617 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:04.613+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:04.615030+0000) 2019-10-23T13:28:04.618 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:04.614+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:04.615709+0000) 2019-10-23T13:28:05.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:05.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:05.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:05.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:06.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:06.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:06.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:06.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:07.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:07.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:07.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:07.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:08.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:28:08.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:08.092319+0000) 2019-10-23T13:28:08.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:08.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:08.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:08.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:09.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:09.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:09.115201+0000) 2019-10-23T13:28:09.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:09.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:09.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:09.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:10.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:28:10.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:10.096893+0000) 2019-10-23T13:28:10.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:10.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:10.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:10.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:11.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:11.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:11.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:11.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:12.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:12.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:12.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:12.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:13.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:13.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:13.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:13.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:14.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:14.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:14.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:14.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:14.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:28:14.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:14.573356+0000) 2019-10-23T13:28:14.613 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:28:14.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:14.611034+0000) 2019-10-23T13:28:14.616 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:28:14.610+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:14.611974+0000) 2019-10-23T13:28:15.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:15.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:15.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:15.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:16.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:16.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:16.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:16.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:17.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:17.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:17.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:17.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:18.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:28:18.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:18.092433+0000) 2019-10-23T13:28:18.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:18.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:18.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:18.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:19.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:19.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:19.115299+0000) 2019-10-23T13:28:19.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:19.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:19.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:19.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:20.099 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:28:20.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:20.096986+0000) 2019-10-23T13:28:20.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:20.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:20.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:20.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:21.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:21.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:21.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:21.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:22.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:22.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:22.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:22.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:23.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:23.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:23.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:23.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:24.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:24.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:24.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:24.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:24.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:28:24.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:24.573451+0000) 2019-10-23T13:28:24.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:28:24.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:24.611128+0000) 2019-10-23T13:28:24.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:28:24.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:24.612065+0000) 2019-10-23T13:28:25.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:25.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:25.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:25.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:26.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:26.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:26.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:26.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:27.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:27.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:27.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:27.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:28.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:28:28.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:28.092543+0000) 2019-10-23T13:28:28.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:28.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:28.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:28.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:29.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:29.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:29.115398+0000) 2019-10-23T13:28:29.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:29.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:29.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:29.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:30.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:28:30.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:30.097079+0000) 2019-10-23T13:28:30.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:30.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:30.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:30.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:31.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:31.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:31.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:31.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:32.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:32.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:32.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:32.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:33.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:33.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:33.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:33.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:34.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:34.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:34.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:34.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:34.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:28:34.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:34.573551+0000) 2019-10-23T13:28:34.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:28:34.609+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:34.611223+0000) 2019-10-23T13:28:34.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:28:34.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:34.612161+0000) 2019-10-23T13:28:35.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:35.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:35.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:35.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:36.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:36.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:36.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:36.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:37.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:37.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:37.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:37.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:38.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:28:38.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:38.092655+0000) 2019-10-23T13:28:38.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:38.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:38.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:38.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:39.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:39.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:39.115492+0000) 2019-10-23T13:28:39.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:39.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:39.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:39.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:40.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:28:40.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:40.097173+0000) 2019-10-23T13:28:40.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:40.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:40.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:40.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:41.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:41.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:41.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:41.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:42.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:42.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:42.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:42.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:43.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:43.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:43.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:43.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:44.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:28:44.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:44.573646+0000) 2019-10-23T13:28:44.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:44.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:44.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:44.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:44.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:28:44.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:44.611322+0000) 2019-10-23T13:28:44.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:28:44.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:44.612257+0000) 2019-10-23T13:28:45.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:45.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:45.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:45.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:46.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:46.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:46.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:46.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:47.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:47.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:47.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:47.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:48.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:28:48.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:48.092770+0000) 2019-10-23T13:28:48.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:48.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:48.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:48.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:49.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:49.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:49.115590+0000) 2019-10-23T13:28:49.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:49.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:49.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:49.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:50.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:28:50.095+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:50.097274+0000) 2019-10-23T13:28:50.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:50.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:50.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:50.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:51.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:51.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:51.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:51.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:52.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:52.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:52.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:52.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:53.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:53.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:53.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:53.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:54.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:28:54.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:54.573739+0000) 2019-10-23T13:28:54.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:28:54.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:54.611415+0000) 2019-10-23T13:28:54.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:28:54.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:54.612346+0000) 2019-10-23T13:28:54.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:54.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:54.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:54.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:55.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:55.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:55.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:55.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:56.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:56.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:56.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:56.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:57.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:57.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:57.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:57.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:58.097 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:28:58.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:58.092882+0000) 2019-10-23T13:28:58.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:58.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:58.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:58.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:28:59.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:28:59.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:28:59.115688+0000) 2019-10-23T13:28:59.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:59.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:28:59.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:28:59.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:00.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:29:00.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:00.097372+0000) 2019-10-23T13:29:00.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:00.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:00.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:00.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:01.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:01.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:01.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:01.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:02.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:02.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:02.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:02.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:03.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:03.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:03.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:03.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:04.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:29:04.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:04.573833+0000) 2019-10-23T13:29:04.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:29:04.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:04.611507+0000) 2019-10-23T13:29:04.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:29:04.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:04.612443+0000) 2019-10-23T13:29:04.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:04.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:04.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:04.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:05.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:05.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:05.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:05.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:06.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:06.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:06.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:06.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:07.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:07.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:07.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:07.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:08.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:29:08.091+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:08.092994+0000) 2019-10-23T13:29:08.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:08.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:08.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:08.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:09.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:29:09.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:09.115789+0000) 2019-10-23T13:29:09.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:09.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:09.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:09.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:10.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:29:10.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:10.097468+0000) 2019-10-23T13:29:10.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:10.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:10.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:10.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:11.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:11.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:11.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:11.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:12.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:12.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:12.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:12.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:13.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:13.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:13.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:13.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:14.576 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:29:14.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:14.574045+0000) 2019-10-23T13:29:14.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:29:14.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:14.611601+0000) 2019-10-23T13:29:14.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:29:14.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:14.612536+0000) 2019-10-23T13:29:14.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:14.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:14.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:14.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:15.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:15.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:15.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:15.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:16.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:16.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:16.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:16.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:17.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:17.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:17.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:17.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:18.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:29:18.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:18.093109+0000) 2019-10-23T13:29:18.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:18.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:18.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:18.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:19.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:29:19.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:19.115887+0000) 2019-10-23T13:29:19.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:19.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:19.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:19.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:20.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:29:20.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:20.097562+0000) 2019-10-23T13:29:20.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:20.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:20.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:20.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:21.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:21.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:21.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:21.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:22.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:22.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:22.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:22.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:23.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:23.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:23.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:23.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:24.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:29:24.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:24.574143+0000) 2019-10-23T13:29:24.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:29:24.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:24.611696+0000) 2019-10-23T13:29:24.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:29:24.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:24.612630+0000) 2019-10-23T13:29:24.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:24.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:24.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:24.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:25.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:25.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:25.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:26.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:26.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:26.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:26.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:27.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:27.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:27.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:27.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:28.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:29:28.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:28.093221+0000) 2019-10-23T13:29:28.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:28.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:28.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:28.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:29.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:29:29.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:29.115983+0000) 2019-10-23T13:29:29.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:29.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:29.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:29.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:30.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:29:30.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:30.097655+0000) 2019-10-23T13:29:30.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:30.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:30.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:30.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:32.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:32.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:32.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:32.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:33.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:33.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:33.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:33.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:34.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:34.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:34.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:34.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:34.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:29:34.572+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:34.574239+0000) 2019-10-23T13:29:34.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:29:34.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:34.611787+0000) 2019-10-23T13:29:34.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:29:34.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:34.612723+0000) 2019-10-23T13:29:35.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:35.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:35.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:35.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:36.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:36.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:36.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:36.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:37.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:37.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:37.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:37.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:38.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:38.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:38.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:38.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:38.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:29:38.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:38.093333+0000) 2019-10-23T13:29:39.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:39.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:39.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:39.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:39.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:29:39.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:39.116081+0000) 2019-10-23T13:29:40.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:40.059+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:40.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:40.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:40.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:29:40.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:40.097754+0000) 2019-10-23T13:29:41.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:41.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:41.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:41.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:42.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:42.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:42.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:42.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:43.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:43.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:43.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:43.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:44.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:44.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:44.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:44.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:44.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:29:44.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:44.574336+0000) 2019-10-23T13:29:44.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:29:44.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:44.611885+0000) 2019-10-23T13:29:44.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:29:44.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:44.612814+0000) 2019-10-23T13:29:45.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:45.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:45.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:45.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:46.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:46.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:46.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:46.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:47.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:47.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:47.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:47.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:48.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:48.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:48.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:48.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:48.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:29:48.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:48.093448+0000) 2019-10-23T13:29:49.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:49.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:49.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:49.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:49.118 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:29:49.114+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:49.116184+0000) 2019-10-23T13:29:50.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:50.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:50.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:50.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:50.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:29:50.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:50.097846+0000) 2019-10-23T13:29:51.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:51.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:51.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:51.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:52.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:52.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:52.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:52.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:53.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:53.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:53.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:53.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:54.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:54.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:54.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:54.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:54.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:29:54.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:54.574438+0000) 2019-10-23T13:29:54.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:29:54.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:54.611982+0000) 2019-10-23T13:29:54.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:29:54.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:54.612908+0000) 2019-10-23T13:29:54.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:54.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:54.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:54.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:56.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:56.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:56.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:56.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:57.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:57.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:57.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:57.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:58.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:58.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:58.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:58.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:29:58.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:29:58.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:58.093563+0000) 2019-10-23T13:29:59.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:29:59.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:29:59.116283+0000) 2019-10-23T13:29:59.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:59.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:29:59.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:29:59.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:00.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:00.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:00.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:00.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:00.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:30:00.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:00.097941+0000) 2019-10-23T13:30:01.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:01.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:01.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:01.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:02.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:02.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:02.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:02.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:03.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:03.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:03.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:03.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:03.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:03.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:03.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:03.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:04.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:30:04.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:04.574530+0000) 2019-10-23T13:30:04.614 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:30:04.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:04.612073+0000) 2019-10-23T13:30:04.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:30:04.611+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:04.613002+0000) 2019-10-23T13:30:05.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:05.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:05.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:05.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:06.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:06.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:06.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:06.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:07.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:07.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:07.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:07.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:08.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:07.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:08.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:07.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:08.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:30:08.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:08.093675+0000) 2019-10-23T13:30:09.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:09.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:09.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:09.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:09.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:30:09.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:09.116387+0000) 2019-10-23T13:30:10.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:09.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:10.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:09.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:10.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:30:10.096+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:10.098039+0000) 2019-10-23T13:30:10.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:10.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:10.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:10.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:11.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:11.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:11.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:11.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:12.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:12.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:12.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:12.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:14.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:14.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:14.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:14.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:14.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:30:14.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:14.574626+0000) 2019-10-23T13:30:14.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:30:14.610+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:14.612162+0000) 2019-10-23T13:30:14.617 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:30:14.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:14.613099+0000) 2019-10-23T13:30:15.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:15.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:15.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:15.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:16.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:16.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:16.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:16.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:17.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:17.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:17.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:17.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:18.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:18.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:18.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:18.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:18.100 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:30:18.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:18.093785+0000) 2019-10-23T13:30:19.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:19.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:19.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:19.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:19.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:30:19.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:19.116482+0000) 2019-10-23T13:30:20.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:20.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:20.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:20.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:20.100 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:30:20.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:20.098137+0000) 2019-10-23T13:30:21.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:21.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:21.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:21.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:21.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:21.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:21.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:21.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:22.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:22.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:22.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:22.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:23.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:23.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:23.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:23.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:24.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:30:24.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:24.574718+0000) 2019-10-23T13:30:24.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:30:24.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:24.612256+0000) 2019-10-23T13:30:24.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:30:24.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:24.613192+0000) 2019-10-23T13:30:24.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:24.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:24.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:24.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:25.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:25.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:25.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:25.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:26.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:26.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:26.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:26.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:27.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:27.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:27.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:27.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:28.098 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:30:28.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:28.093896+0000) 2019-10-23T13:30:29.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:29.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:29.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:29.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:29.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:30:29.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:29.116580+0000) 2019-10-23T13:30:30.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:29.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:30.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:29.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:30.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:30:30.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:30.098236+0000) 2019-10-23T13:30:31.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:31.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:31.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:31.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:31.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:31.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:31.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:31.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:33.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:33.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:33.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:33.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:34.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:34.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:34.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:34.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:34.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:30:34.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:34.574815+0000) 2019-10-23T13:30:34.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:30:34.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:34.612350+0000) 2019-10-23T13:30:34.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:30:34.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:34.613282+0000) 2019-10-23T13:30:35.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:35.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:35.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:35.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:36.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:35.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:36.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:35.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:36.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:36.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:36.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:36.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:37.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:37.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:37.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:37.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:38.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:30:38.092+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:38.094004+0000) 2019-10-23T13:30:38.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:38.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:38.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:38.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:39.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:30:39.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:39.116673+0000) 2019-10-23T13:30:40.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:40.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:40.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:40.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:40.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:30:40.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:40.098334+0000) 2019-10-23T13:30:40.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:40.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:40.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:40.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:41.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:41.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:41.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:41.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:42.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:42.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:42.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:42.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:43.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:43.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:43.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:43.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:44.577 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:30:44.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:44.574911+0000) 2019-10-23T13:30:44.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:30:44.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:44.612446+0000) 2019-10-23T13:30:44.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:30:44.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:44.613376+0000) 2019-10-23T13:30:45.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:44.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:45.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:44.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:45.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:45.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:45.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:45.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:46.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:46.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:46.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:46.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:47.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:47.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:47.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:47.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:48.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:30:48.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:48.094122+0000) 2019-10-23T13:30:48.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:48.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:48.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:48.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:49.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:30:49.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:49.116769+0000) 2019-10-23T13:30:49.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:49.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:49.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:49.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:50.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:30:50.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:50.098429+0000) 2019-10-23T13:30:50.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:50.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:50.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:50.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:51.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:51.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:51.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:51.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:52.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:52.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:52.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:52.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:53.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:53.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:53.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:53.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:54.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:30:54.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:54.575007+0000) 2019-10-23T13:30:54.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:30:54.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:54.612538+0000) 2019-10-23T13:30:54.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:30:54.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:54.613469+0000) 2019-10-23T13:30:54.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:54.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:54.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:54.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:55.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:55.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:55.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:55.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:56.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:56.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:56.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:56.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:57.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:57.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:58.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:30:58.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:58.094241+0000) 2019-10-23T13:30:58.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:58.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:58.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:58.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:30:59.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:30:59.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:30:59.116867+0000) 2019-10-23T13:30:59.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:59.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:30:59.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:30:59.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:00.105 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:31:00.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:00.098525+0000) 2019-10-23T13:31:00.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:00.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:00.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:00.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:02.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:01.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:02.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:01.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:03.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:03.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:03.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:03.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:04.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:04.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:04.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:04.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:04.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:31:04.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:04.575098+0000) 2019-10-23T13:31:04.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:31:04.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:04.612630+0000) 2019-10-23T13:31:04.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:31:04.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:04.613560+0000) 2019-10-23T13:31:05.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:05.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:05.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:05.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:06.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:06.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:06.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:06.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:07.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:07.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:07.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:07.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:08.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:08.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:08.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:08.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:08.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:31:08.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:08.094359+0000) 2019-10-23T13:31:09.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:09.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:09.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:09.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:09.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:31:09.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:09.116964+0000) 2019-10-23T13:31:10.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:10.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:10.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:10.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:10.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:31:10.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:10.098621+0000) 2019-10-23T13:31:11.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:11.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:11.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:11.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:12.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:12.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:12.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:12.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:13.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:13.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:13.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:13.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:14.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:14.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:14.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:14.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:14.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:31:14.573+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:14.575196+0000) 2019-10-23T13:31:14.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:31:14.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:14.612724+0000) 2019-10-23T13:31:14.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:31:14.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:14.613652+0000) 2019-10-23T13:31:15.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:15.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:15.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:15.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:16.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:16.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:16.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:16.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:17.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:17.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:17.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:17.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:18.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:31:18.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:18.094478+0000) 2019-10-23T13:31:18.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:18.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:18.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:18.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:19.119 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:31:19.115+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:19.117060+0000) 2019-10-23T13:31:19.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:19.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:19.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:19.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:20.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:31:20.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:20.098716+0000) 2019-10-23T13:31:20.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:20.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:20.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:20.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:21.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:21.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:21.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:21.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:22.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:22.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:22.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:22.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:23.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:23.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:23.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:23.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:24.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:24.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:24.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:24.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:24.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:31:24.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:24.575292+0000) 2019-10-23T13:31:24.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:31:24.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:24.612818+0000) 2019-10-23T13:31:24.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:31:24.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:24.613768+0000) 2019-10-23T13:31:25.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:25.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:25.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:25.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:26.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:26.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:26.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:26.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:27.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:27.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:27.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:27.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:28.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:31:28.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:28.094594+0000) 2019-10-23T13:31:28.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:28.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:28.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:28.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:29.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:31:29.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:29.117156+0000) 2019-10-23T13:31:29.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:29.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:29.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:29.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:30.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:31:30.098+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:30.098813+0000) 2019-10-23T13:31:30.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:30.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:30.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:30.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:31.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:31.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:31.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:31.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:32.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:32.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:32.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:32.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:33.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:33.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:33.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:33.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:34.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:34.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:34.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:34.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:34.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:31:34.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:34.575391+0000) 2019-10-23T13:31:34.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:31:34.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:34.612912+0000) 2019-10-23T13:31:34.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:31:34.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:34.613878+0000) 2019-10-23T13:31:35.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:35.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:35.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:35.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:36.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:36.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:36.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:36.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:37.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:37.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:37.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:37.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:38.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:31:38.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:38.094720+0000) 2019-10-23T13:31:38.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:38.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:38.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:38.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:39.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:31:39.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:39.117248+0000) 2019-10-23T13:31:39.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:39.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:39.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:39.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:40.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:31:40.098+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:40.098911+0000) 2019-10-23T13:31:40.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:40.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:40.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:40.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:41.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:41.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:41.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:41.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:42.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:42.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:42.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:42.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:43.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:43.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:43.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:43.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:44.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:44.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:44.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:44.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:44.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:31:44.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:44.575495+0000) 2019-10-23T13:31:44.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:31:44.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:44.613010+0000) 2019-10-23T13:31:44.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:31:44.612+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:44.613987+0000) 2019-10-23T13:31:45.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:45.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:45.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:45.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:46.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:46.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:46.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:46.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:47.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:47.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:47.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:47.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:48.099 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:31:48.093+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:48.094836+0000) 2019-10-23T13:31:48.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:48.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:48.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:48.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:49.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:31:49.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:49.117345+0000) 2019-10-23T13:31:49.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:49.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:49.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:49.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:50.101 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:31:50.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:50.099004+0000) 2019-10-23T13:31:50.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:50.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:50.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:50.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:51.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:51.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:51.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:51.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:52.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:52.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:52.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:52.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:53.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:53.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:53.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:53.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:54.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:31:54.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:54.575597+0000) 2019-10-23T13:31:54.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:54.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:54.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:54.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:54.615 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:31:54.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:54.613108+0000) 2019-10-23T13:31:54.618 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:31:54.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:54.614089+0000) 2019-10-23T13:31:55.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:55.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:55.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:55.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:56.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:56.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:56.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:56.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:57.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:57.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:57.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:57.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:58.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:31:58.097+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:58.098940+0000) 2019-10-23T13:31:58.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:58.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:58.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:58.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:31:59.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:31:59.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:31:59.117438+0000) 2019-10-23T13:31:59.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:59.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:31:59.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:31:59.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:00.102 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:00.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:00.099104+0000) 2019-10-23T13:32:00.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:00.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:00.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:00.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:01.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:01.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:01.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:01.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:02.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:02.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:02.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:02.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:03.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:03.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:03.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:03.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:04.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:32:04.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:04.575695+0000) 2019-10-23T13:32:04.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:32:04.611+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:04.613199+0000) 2019-10-23T13:32:04.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:32:04.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:04.614192+0000) 2019-10-23T13:32:04.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:04.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:04.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:04.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:05.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:05.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:05.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:05.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:06.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:06.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:06.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:06.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:07.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:07.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:07.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:07.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:08.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:32:08.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:08.099058+0000) 2019-10-23T13:32:08.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:08.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:08.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:08.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:09.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:32:09.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:09.117535+0000) 2019-10-23T13:32:09.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:09.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:09.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:09.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:10.102 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:10.097+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:10.099200+0000) 2019-10-23T13:32:10.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:10.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:10.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:10.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:11.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:11.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:11.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:11.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:12.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:12.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:12.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:12.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:13.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:13.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:13.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:13.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:14.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:32:14.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:14.575788+0000) 2019-10-23T13:32:14.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:32:14.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:14.613297+0000) 2019-10-23T13:32:14.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:32:14.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:14.614298+0000) 2019-10-23T13:32:14.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:14.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:14.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:14.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:15.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:15.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:15.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:15.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:16.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:16.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:16.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:16.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:17.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:17.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:17.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:17.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:18.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:32:18.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:18.099165+0000) 2019-10-23T13:32:18.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:18.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:18.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:18.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:19.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:32:19.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:19.117631+0000) 2019-10-23T13:32:19.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:19.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:19.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:19.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:20.102 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:20.098+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:20.099290+0000) 2019-10-23T13:32:20.102 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:20.098+0000 7fa1716d9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:20.100002+0000) 2019-10-23T13:32:20.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:20.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:20.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:20.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:21.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:21.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:21.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:21.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:22.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:22.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:22.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:22.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:23.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:23.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:23.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:23.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:24.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:32:24.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:24.575882+0000) 2019-10-23T13:32:24.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:24.598+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:24.599481+0000) 2019-10-23T13:32:24.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:32:24.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:24.613392+0000) 2019-10-23T13:32:24.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:32:24.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:24.614405+0000) 2019-10-23T13:32:24.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:24.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:24.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:24.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:25.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:25.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:25.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:25.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:26.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:26.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:26.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:26.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:27.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:27.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:27.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:27.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:28.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:32:28.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:28.099273+0000) 2019-10-23T13:32:28.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:28.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:28.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:28.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:29.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:32:29.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:29.117726+0000) 2019-10-23T13:32:29.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:29.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:29.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:29.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:30.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:30.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:30.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:31.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:31.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:31.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:31.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:32.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:32.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:32.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:32.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:33.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:33.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:33.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:33.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:34.578 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:32:34.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:34.575976+0000) 2019-10-23T13:32:34.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:34.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:34.599578+0000) 2019-10-23T13:32:34.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:32:34.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:34.613482+0000) 2019-10-23T13:32:34.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:32:34.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:34.614510+0000) 2019-10-23T13:32:34.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:34.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:34.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:34.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:35.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:35.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:35.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:35.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:36.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:36.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:36.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:36.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:37.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:37.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:37.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:37.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:38.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:32:38.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:38.099386+0000) 2019-10-23T13:32:38.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:38.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:38.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:38.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:39.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:32:39.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:39.117824+0000) 2019-10-23T13:32:39.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:39.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:39.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:39.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:40.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:40.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:40.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:40.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:41.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:41.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:41.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:41.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:42.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:42.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:42.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:42.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:43.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:43.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:43.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:43.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:44.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:32:44.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:44.576076+0000) 2019-10-23T13:32:44.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:44.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:44.599672+0000) 2019-10-23T13:32:44.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:32:44.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:44.613578+0000) 2019-10-23T13:32:44.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:32:44.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:44.614620+0000) 2019-10-23T13:32:44.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:44.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:44.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:44.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:45.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:45.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:45.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:45.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:46.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:46.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:46.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:46.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:47.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:47.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:47.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:47.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:48.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:32:48.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:48.099497+0000) 2019-10-23T13:32:48.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:48.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:48.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:48.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:49.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:32:49.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:49.117920+0000) 2019-10-23T13:32:49.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:49.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:49.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:49.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:50.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:50.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:50.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:50.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:51.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:51.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:51.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:51.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:52.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:52.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:52.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:52.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:53.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:53.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:53.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:53.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:54.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:32:54.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:54.576173+0000) 2019-10-23T13:32:54.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:32:54.598+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:54.599766+0000) 2019-10-23T13:32:54.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:32:54.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:54.613671+0000) 2019-10-23T13:32:54.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:32:54.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:54.614730+0000) 2019-10-23T13:32:54.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:54.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:54.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:54.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:55.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:55.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:55.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:55.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:56.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:56.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:56.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:56.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:57.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:57.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:57.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:57.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:58.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:32:58.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:58.099615+0000) 2019-10-23T13:32:58.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:58.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:58.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:58.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:32:59.120 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:32:59.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:32:59.118016+0000) 2019-10-23T13:32:59.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:59.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:32:59.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:32:59.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:00.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:00.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:00.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:00.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:01.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:01.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:01.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:01.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:02.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:02.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:02.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:02.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:03.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:03.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:03.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:03.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:04.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:33:04.574+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:04.576266+0000) 2019-10-23T13:33:04.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:33:04.598+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:04.599859+0000) 2019-10-23T13:33:04.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:33:04.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:04.613768+0000) 2019-10-23T13:33:04.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:33:04.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:04.614839+0000) 2019-10-23T13:33:04.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:04.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:04.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:04.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:05.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:05.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:05.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:05.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:06.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:06.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:06.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:06.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:07.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:07.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:07.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:07.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:08.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:33:08.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:08.099728+0000) 2019-10-23T13:33:08.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:08.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:08.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:08.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:09.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:33:09.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:09.118116+0000) 2019-10-23T13:33:09.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:09.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:09.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:09.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:10.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:10.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:10.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:10.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:11.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:11.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:11.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:11.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:12.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:12.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:12.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:12.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:13.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:13.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:13.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:13.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:14.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:33:14.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:14.576367+0000) 2019-10-23T13:33:14.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:33:14.598+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:14.599954+0000) 2019-10-23T13:33:14.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:33:14.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:14.613862+0000) 2019-10-23T13:33:14.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:33:14.613+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:14.614950+0000) 2019-10-23T13:33:14.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:14.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:14.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:14.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:15.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:15.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:15.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:15.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:16.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:16.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:16.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:16.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:17.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:17.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:17.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:17.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:18.104 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:33:18.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:18.099838+0000) 2019-10-23T13:33:18.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:18.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:18.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:18.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:19.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:33:19.116+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:19.118215+0000) 2019-10-23T13:33:19.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:19.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:19.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:19.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:20.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:20.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:20.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:20.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:21.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:21.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:21.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:21.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:22.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:22.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:22.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:22.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:23.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:23.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:24.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:33:24.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:24.576461+0000) 2019-10-23T13:33:24.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:33:24.598+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:24.600048+0000) 2019-10-23T13:33:24.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:33:24.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:24.613955+0000) 2019-10-23T13:33:24.619 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:33:24.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:24.615062+0000) 2019-10-23T13:33:24.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:24.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:24.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:24.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:25.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:25.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:25.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:25.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:26.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:26.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:26.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:26.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:27.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:27.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:27.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:27.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:28.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:33:28.098+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:28.099948+0000) 2019-10-23T13:33:28.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:28.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:28.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:28.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:29.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:33:29.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:29.118297+0000) 2019-10-23T13:33:29.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:29.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:29.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:29.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:30.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:30.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:30.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:30.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:31.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:31.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:31.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:31.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:32.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:32.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:32.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:32.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:33.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:33.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:33.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:33.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:34.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:33:34.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:34.576551+0000) 2019-10-23T13:33:34.602 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:33:34.598+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:34.600141+0000) 2019-10-23T13:33:34.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:33:34.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:34.614045+0000) 2019-10-23T13:33:34.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:33:34.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:34.615172+0000) 2019-10-23T13:33:34.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:34.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:34.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:34.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:35.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:35.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:35.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:35.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:36.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:36.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:36.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:36.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:37.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:37.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:37.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:37.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:38.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:33:38.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:38.100061+0000) 2019-10-23T13:33:38.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:38.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:38.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:38.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:39.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:33:39.118+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:39.118397+0000) 2019-10-23T13:33:39.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:39.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:39.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:39.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:40.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:40.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:40.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:40.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:41.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:41.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:41.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:41.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:42.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:42.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:42.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:42.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:43.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:43.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:43.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:43.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:44.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:33:44.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:44.576648+0000) 2019-10-23T13:33:44.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:33:44.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:44.600237+0000) 2019-10-23T13:33:44.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:44.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:44.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:44.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:44.616 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:33:44.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:44.614140+0000) 2019-10-23T13:33:44.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:33:44.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:44.615281+0000) 2019-10-23T13:33:45.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:45.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:45.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:45.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:46.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:46.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:46.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:46.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:47.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:47.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:47.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:47.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:48.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:33:48.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:48.100173+0000) 2019-10-23T13:33:48.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:48.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:48.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:48.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:49.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:33:49.118+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:49.118490+0000) 2019-10-23T13:33:49.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:49.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:49.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:49.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:50.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:50.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:50.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:50.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:51.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:51.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:52.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:52.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:52.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:52.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:53.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:53.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:53.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:53.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:54.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:33:54.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:54.576745+0000) 2019-10-23T13:33:54.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:33:54.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:54.600298+0000) 2019-10-23T13:33:54.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:33:54.612+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:54.614233+0000) 2019-10-23T13:33:54.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:33:54.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:54.615391+0000) 2019-10-23T13:33:54.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:54.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:54.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:54.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:55.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:55.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:55.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:55.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:56.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:56.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:56.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:56.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:57.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:57.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:57.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:57.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:58.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:33:58.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:58.100287+0000) 2019-10-23T13:33:58.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:58.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:58.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:58.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:33:59.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:33:59.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:33:59.118583+0000) 2019-10-23T13:33:59.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:59.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:33:59.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:33:59.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:00.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:00.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:00.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:00.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:01.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:01.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:01.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:01.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:02.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:02.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:02.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:02.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:03.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:03.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:03.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:03.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:04.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:34:04.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:04.576843+0000) 2019-10-23T13:34:04.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:34:04.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:04.600392+0000) 2019-10-23T13:34:04.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:34:04.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:04.614328+0000) 2019-10-23T13:34:04.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:34:04.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:04.615498+0000) 2019-10-23T13:34:04.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:04.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:04.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:04.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:05.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:05.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:05.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:05.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:06.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:06.552+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:06.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:06.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:07.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:07.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:07.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:07.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:08.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:34:08.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:08.100402+0000) 2019-10-23T13:34:08.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:08.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:08.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:08.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:09.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:34:09.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:09.118676+0000) 2019-10-23T13:34:09.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:09.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:09.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:09.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:10.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:10.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:10.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:10.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:11.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:11.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:11.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:11.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:12.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:12.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:12.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:12.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:13.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:13.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:13.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:13.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:14.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:34:14.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:14.576943+0000) 2019-10-23T13:34:14.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:14.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:14.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:14.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:14.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:34:14.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:14.600490+0000) 2019-10-23T13:34:14.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:34:14.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:14.614424+0000) 2019-10-23T13:34:14.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:34:14.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:14.615605+0000) 2019-10-23T13:34:15.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:15.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:15.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:15.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:16.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:16.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:16.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:16.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:17.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:17.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:17.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:17.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:18.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:34:18.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:18.100515+0000) 2019-10-23T13:34:18.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:18.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:18.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:18.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:19.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:34:19.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:19.118773+0000) 2019-10-23T13:34:19.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:19.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:19.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:19.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:20.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:20.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:20.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:20.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:21.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:21.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:21.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:21.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:22.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:22.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:22.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:22.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:23.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:23.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:23.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:23.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:24.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:24.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:24.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:24.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:24.579 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:34:24.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:24.577037+0000) 2019-10-23T13:34:24.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:34:24.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:24.600582+0000) 2019-10-23T13:34:24.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:34:24.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:24.614517+0000) 2019-10-23T13:34:24.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:34:24.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:24.615710+0000) 2019-10-23T13:34:25.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:25.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:25.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:25.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:26.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:26.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:26.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:26.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:27.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:27.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:27.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:27.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:28.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:34:28.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:28.100626+0000) 2019-10-23T13:34:28.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:28.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:28.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:28.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:29.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:34:29.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:29.118869+0000) 2019-10-23T13:34:29.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:29.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:29.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:29.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:30.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:30.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:30.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:30.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:31.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:31.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:31.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:31.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:32.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:32.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:32.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:32.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:33.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:33.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:33.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:33.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:34.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:34:34.575+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:34.577132+0000) 2019-10-23T13:34:34.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:34:34.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:34.600675+0000) 2019-10-23T13:34:34.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:34:34.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:34.614614+0000) 2019-10-23T13:34:34.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:34:34.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:34.615814+0000) 2019-10-23T13:34:34.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:34.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:34.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:34.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:35.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:35.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:35.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:35.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:36.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:36.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:36.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:36.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:37.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:37.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:37.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:37.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:38.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:34:38.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:38.100742+0000) 2019-10-23T13:34:38.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:38.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:38.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:38.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:39.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:34:39.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:39.118963+0000) 2019-10-23T13:34:39.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:39.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:39.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:39.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:40.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:40.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:40.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:40.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:41.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:41.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:41.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:41.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:42.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:42.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:42.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:42.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:43.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:43.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:43.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:43.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:44.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:34:44.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:44.577228+0000) 2019-10-23T13:34:44.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:34:44.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:44.600771+0000) 2019-10-23T13:34:44.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:34:44.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:44.614711+0000) 2019-10-23T13:34:44.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:34:44.614+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:44.615921+0000) 2019-10-23T13:34:44.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:44.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:44.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:44.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:45.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:45.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:45.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:45.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:46.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:46.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:46.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:46.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:47.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:47.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:47.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:47.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:48.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:34:48.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:48.100854+0000) 2019-10-23T13:34:48.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:48.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:48.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:48.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:49.121 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:34:49.118+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:49.119056+0000) 2019-10-23T13:34:49.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:49.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:49.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:49.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:50.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:50.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:50.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:50.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:51.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:51.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:51.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:51.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:52.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:52.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:52.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:52.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:53.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:53.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:53.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:53.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:54.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:34:54.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:54.577326+0000) 2019-10-23T13:34:54.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:34:54.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:54.600868+0000) 2019-10-23T13:34:54.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:34:54.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:54.614806+0000) 2019-10-23T13:34:54.620 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:34:54.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:54.616030+0000) 2019-10-23T13:34:54.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:54.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:54.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:54.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:55.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:55.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:55.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:55.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:56.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:56.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:56.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:56.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:57.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:57.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:57.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:57.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:58.105 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:34:58.099+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:58.100962+0000) 2019-10-23T13:34:58.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:58.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:58.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:58.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:34:59.122 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:34:59.118+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:34:59.119143+0000) 2019-10-23T13:34:59.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:59.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:34:59.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:34:59.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:00.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:00.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:00.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:00.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:01.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:01.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:01.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:01.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:02.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:02.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:02.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:02.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:03.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:03.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:03.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:03.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:04.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:04.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:04.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:04.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:04.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:35:04.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:04.577423+0000) 2019-10-23T13:35:04.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:35:04.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:04.600964+0000) 2019-10-23T13:35:04.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:35:04.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:04.614899+0000) 2019-10-23T13:35:04.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:35:04.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:04.616140+0000) 2019-10-23T13:35:05.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:05.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:05.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:05.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:06.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:06.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:06.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:06.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:07.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:07.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:07.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:07.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:08.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:35:08.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:08.101076+0000) 2019-10-23T13:35:08.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:08.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:08.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:08.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:09.122 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:09.117+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:09.119231+0000) 2019-10-23T13:35:09.122 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:09.118+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:09.119828+0000) 2019-10-23T13:35:09.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:09.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:09.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:09.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:10.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:10.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:10.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:10.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:11.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:11.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:11.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:11.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:12.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:12.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:12.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:12.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:13.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:13.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:13.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:13.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:13.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:13.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:13.619417+0000) 2019-10-23T13:35:14.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:14.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:14.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:14.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:14.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:35:14.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:14.577519+0000) 2019-10-23T13:35:14.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:35:14.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:14.601061+0000) 2019-10-23T13:35:14.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:35:14.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:14.614995+0000) 2019-10-23T13:35:14.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:35:14.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:14.616249+0000) 2019-10-23T13:35:15.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:15.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:15.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:15.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:16.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:16.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:16.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:16.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:17.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:17.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:17.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:17.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:18.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:35:18.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:18.101186+0000) 2019-10-23T13:35:18.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:18.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:18.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:18.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:19.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:19.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:19.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:19.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:20.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:20.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:20.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:20.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:21.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:21.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:21.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:21.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:22.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:22.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:22.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:22.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:23.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:23.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:23.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:23.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:23.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:23.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:23.619516+0000) 2019-10-23T13:35:24.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:35:24.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:24.577615+0000) 2019-10-23T13:35:24.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:24.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:24.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:24.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:24.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:35:24.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:24.601155+0000) 2019-10-23T13:35:24.617 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:35:24.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:24.615091+0000) 2019-10-23T13:35:24.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:35:24.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:24.616357+0000) 2019-10-23T13:35:25.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:25.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:25.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:25.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:26.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:26.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:26.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:26.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:27.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:27.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:27.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:27.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:28.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:35:28.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:28.101299+0000) 2019-10-23T13:35:28.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:28.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:28.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:28.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:29.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:29.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:29.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:29.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:30.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:30.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:30.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:30.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:31.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:31.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:31.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:31.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:32.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:32.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:32.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:32.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:33.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:33.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:33.619614+0000) 2019-10-23T13:35:33.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:33.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:33.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:33.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:34.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:35:34.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:34.577709+0000) 2019-10-23T13:35:34.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:35:34.599+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:34.601254+0000) 2019-10-23T13:35:34.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:35:34.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:34.615180+0000) 2019-10-23T13:35:34.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:35:34.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:34.616468+0000) 2019-10-23T13:35:34.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:34.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:34.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:34.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:35.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:35.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:35.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:35.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:36.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:36.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:36.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:36.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:37.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:37.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:37.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:37.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:38.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:35:38.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:38.101405+0000) 2019-10-23T13:35:38.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:38.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:38.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:38.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:39.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:39.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:39.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:39.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:40.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:40.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:40.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:40.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:41.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:41.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:25:08.980288+0000 (oldest deadline 2019-10-23T13:25:28.980288+0000) 2019-10-23T13:35:41.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:41.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:42.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:42.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:43.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:43.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:43.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:43.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:43.619709+0000) 2019-10-23T13:35:44.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:35:44.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:44.577804+0000) 2019-10-23T13:35:44.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:35:44.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:44.601351+0000) 2019-10-23T13:35:44.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:44.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:44.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:35:44.613+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:44.615273+0000) 2019-10-23T13:35:44.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:35:44.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:44.616577+0000) 2019-10-23T13:35:45.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:45.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:46.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:46.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:47.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:47.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:48.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:35:48.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:48.101512+0000) 2019-10-23T13:35:48.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:48.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:49.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:49.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:50.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:50.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:51.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:51.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:52.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:52.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:53.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:53.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:53.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:35:53.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:53.619809+0000) 2019-10-23T13:35:54.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:35:54.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:54.577895+0000) 2019-10-23T13:35:54.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:54.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:54.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:35:54.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:54.601446+0000) 2019-10-23T13:35:54.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:35:54.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:54.615366+0000) 2019-10-23T13:35:54.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:35:54.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:54.616679+0000) 2019-10-23T13:35:55.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:55.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:56.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:56.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:57.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:57.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:58.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:35:58.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:35:58.101623+0000) 2019-10-23T13:35:58.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:58.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:35:59.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:35:59.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:00.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:00.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:01.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:01.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:02.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:02.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:03.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:03.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:03.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:03.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:03.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:36:03.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:03.619907+0000) 2019-10-23T13:36:04.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:04.525+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:04.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:04.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:04.580 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:36:04.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:04.577994+0000) 2019-10-23T13:36:04.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:36:04.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:04.601541+0000) 2019-10-23T13:36:04.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:36:04.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:04.615461+0000) 2019-10-23T13:36:04.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:36:04.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:04.616787+0000) 2019-10-23T13:36:05.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:05.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:05.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:05.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:06.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:06.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:06.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:06.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:07.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:07.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:07.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:07.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:08.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:36:08.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:08.101740+0000) 2019-10-23T13:36:08.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:08.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:08.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:08.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:09.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:09.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:09.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:09.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:10.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:10.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:10.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:10.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:11.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:11.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:11.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:11.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:12.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:12.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:12.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:12.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:13.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:13.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:13.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:13.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:13.622 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:36:13.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:13.620004+0000) 2019-10-23T13:36:14.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:14.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:14.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:14.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:14.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:36:14.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:14.578092+0000) 2019-10-23T13:36:14.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:36:14.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:14.601640+0000) 2019-10-23T13:36:14.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:36:14.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:14.615556+0000) 2019-10-23T13:36:14.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:36:14.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:14.616897+0000) 2019-10-23T13:36:15.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:15.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:15.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:15.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:16.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:16.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:16.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:16.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:17.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:17.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:17.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:17.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:18.106 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:36:18.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:18.101848+0000) 2019-10-23T13:36:18.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:18.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:18.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:18.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:19.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:19.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:19.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:19.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:20.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:20.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:20.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:20.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:21.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:21.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:21.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:21.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:22.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:22.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:22.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:22.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:23.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:23.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:23.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:23.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:23.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:36:23.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:23.620102+0000) 2019-10-23T13:36:24.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:24.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:24.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:24.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:24.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:36:24.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:24.578183+0000) 2019-10-23T13:36:24.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:36:24.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:24.601737+0000) 2019-10-23T13:36:24.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:36:24.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:24.615647+0000) 2019-10-23T13:36:24.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:36:24.615+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:24.617006+0000) 2019-10-23T13:36:25.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:25.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:25.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:25.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:26.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:26.452+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:26.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:26.452+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:27.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:27.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:27.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:27.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:28.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:36:28.100+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:28.101955+0000) 2019-10-23T13:36:28.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:28.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:28.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:28.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:29.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:29.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:29.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:29.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:30.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:30.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:30.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:30.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:31.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:31.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:31.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:31.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:32.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:32.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:32.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:32.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:33.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:33.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:33.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:33.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:33.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:36:33.618+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:33.620198+0000) 2019-10-23T13:36:34.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:34.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:34.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:34.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:34.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:36:34.576+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:34.578278+0000) 2019-10-23T13:36:34.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:36:34.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:34.601831+0000) 2019-10-23T13:36:34.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:36:34.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:34.615739+0000) 2019-10-23T13:36:34.621 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:36:34.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:34.617115+0000) 2019-10-23T13:36:35.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:35.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:35.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:35.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:36.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:36.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:36.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:36.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:37.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:37.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:37.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:37.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:38.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:36:38.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:38.102061+0000) 2019-10-23T13:36:38.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:38.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:38.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:38.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:39.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:39.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:39.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:39.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:40.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:40.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:40.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:40.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:41.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:41.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:41.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:41.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:42.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:42.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:42.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:42.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:43.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:43.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:43.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:43.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:43.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:36:43.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:43.620296+0000) 2019-10-23T13:36:44.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:36:44.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:44.578376+0000) 2019-10-23T13:36:44.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:44.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:44.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:44.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:44.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:36:44.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:44.601929+0000) 2019-10-23T13:36:44.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:36:44.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:44.615832+0000) 2019-10-23T13:36:44.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:36:44.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:44.617226+0000) 2019-10-23T13:36:45.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:45.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:45.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:45.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:46.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:46.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:46.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:46.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:47.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:47.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:47.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:47.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:48.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:36:48.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:48.102168+0000) 2019-10-23T13:36:48.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:48.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:48.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:48.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:49.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:49.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:49.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:49.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:50.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:50.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:50.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:50.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:51.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:51.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:51.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:51.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:52.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:52.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:52.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:52.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:53.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:36:53.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:53.620398+0000) 2019-10-23T13:36:53.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:53.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:53.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:53.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:54.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:36:54.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:54.578471+0000) 2019-10-23T13:36:54.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:36:54.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:54.602026+0000) 2019-10-23T13:36:54.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:36:54.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:54.615923+0000) 2019-10-23T13:36:54.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:36:54.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:54.617337+0000) 2019-10-23T13:36:54.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:54.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:54.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:54.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:55.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:55.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:55.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:55.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:56.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:56.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:56.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:56.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:57.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:57.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:57.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:57.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:58.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:36:58.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:36:58.102278+0000) 2019-10-23T13:36:58.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:58.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:58.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:58.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:36:59.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:59.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:36:59.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:36:59.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:00.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:00.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:00.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:00.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:01.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:01.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:01.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:01.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:02.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:02.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:02.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:02.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:03.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:37:03.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:03.620496+0000) 2019-10-23T13:37:03.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:03.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:03.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:03.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:04.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:37:04.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:04.578560+0000) 2019-10-23T13:37:04.604 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:37:04.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:04.602114+0000) 2019-10-23T13:37:04.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:37:04.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:04.616017+0000) 2019-10-23T13:37:04.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:37:04.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:04.617446+0000) 2019-10-23T13:37:04.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:04.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:04.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:04.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:05.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:05.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:05.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:05.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:06.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:06.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:06.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:06.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:07.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:07.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:07.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:07.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:08.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:37:08.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:08.102386+0000) 2019-10-23T13:37:08.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:08.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:08.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:08.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:09.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:09.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:09.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:09.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:10.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:10.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:10.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:10.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:11.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:11.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:11.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:11.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:12.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:12.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:12.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:12.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:13.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:37:13.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:13.620587+0000) 2019-10-23T13:37:13.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:13.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:13.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:13.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:14.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:37:14.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:14.578659+0000) 2019-10-23T13:37:14.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:37:14.600+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:14.602212+0000) 2019-10-23T13:37:14.618 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:37:14.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:14.616110+0000) 2019-10-23T13:37:14.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:37:14.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:14.617556+0000) 2019-10-23T13:37:14.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:14.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:14.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:14.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:15.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:15.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:15.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:15.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:16.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:16.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:16.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:16.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:17.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:17.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:18.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:37:18.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:18.102499+0000) 2019-10-23T13:37:18.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:18.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:18.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:18.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:19.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:19.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:19.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:19.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:20.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:20.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:20.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:20.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:21.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:21.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:21.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:21.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:22.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:22.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:22.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:22.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:23.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:37:23.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:23.620685+0000) 2019-10-23T13:37:23.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:23.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:23.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:23.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:24.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:37:24.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:24.578752+0000) 2019-10-23T13:37:24.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:37:24.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:24.602298+0000) 2019-10-23T13:37:24.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:37:24.614+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:24.616200+0000) 2019-10-23T13:37:24.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:37:24.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:24.617663+0000) 2019-10-23T13:37:24.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:24.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:24.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:24.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:25.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:25.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:25.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:25.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:26.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:26.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:26.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:26.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:27.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:27.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:27.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:27.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:28.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:37:28.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:28.102607+0000) 2019-10-23T13:37:28.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:28.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:28.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:28.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:29.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:29.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:29.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:29.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:30.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:30.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:30.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:30.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:31.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:31.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:31.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:31.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:32.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:32.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:32.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:32.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:33.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:37:33.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:33.620784+0000) 2019-10-23T13:37:33.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:33.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:33.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:33.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:34.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:37:34.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:34.578842+0000) 2019-10-23T13:37:34.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:37:34.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:34.602393+0000) 2019-10-23T13:37:34.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:37:34.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:34.616297+0000) 2019-10-23T13:37:34.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:37:34.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:34.617768+0000) 2019-10-23T13:37:34.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:34.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:34.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:34.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:35.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:35.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:35.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:35.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:36.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:36.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:36.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:36.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:37.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:37.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:37.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:37.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:38.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:37:38.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:38.102714+0000) 2019-10-23T13:37:38.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:38.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:38.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:38.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:39.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:39.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:39.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:39.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:40.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:40.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:40.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:40.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:41.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:41.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:41.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:41.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:42.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:42.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:42.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:42.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:43.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:37:43.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:43.620882+0000) 2019-10-23T13:37:43.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:43.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:43.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:43.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:44.581 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:37:44.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:44.578935+0000) 2019-10-23T13:37:44.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:37:44.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:44.602485+0000) 2019-10-23T13:37:44.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:37:44.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:44.616391+0000) 2019-10-23T13:37:44.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:37:44.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:44.617877+0000) 2019-10-23T13:37:44.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:44.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:44.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:44.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:45.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:45.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:45.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:45.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:46.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:46.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:46.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:46.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:47.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:47.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:47.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:47.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:48.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:37:48.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:48.102821+0000) 2019-10-23T13:37:48.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:48.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:48.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:48.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:49.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:49.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:49.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:49.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:50.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:50.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:50.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:50.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:51.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:51.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:51.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:51.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:52.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:52.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:52.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:52.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:53.623 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:37:53.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:53.620980+0000) 2019-10-23T13:37:53.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:53.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:53.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:53.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:54.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:37:54.577+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:54.579026+0000) 2019-10-23T13:37:54.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:37:54.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:54.602582+0000) 2019-10-23T13:37:54.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:37:54.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:54.616490+0000) 2019-10-23T13:37:54.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:37:54.616+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:54.617986+0000) 2019-10-23T13:37:54.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:54.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:54.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:54.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:55.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:55.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:55.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:55.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:56.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:56.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:56.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:56.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:57.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:57.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:57.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:57.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:58.107 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:37:58.101+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:37:58.102927+0000) 2019-10-23T13:37:58.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:58.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:58.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:58.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:37:59.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:59.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:37:59.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:37:59.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:00.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:00.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:00.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:00.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:01.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:01.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:01.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:01.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:02.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:02.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:02.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:02.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:03.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:38:03.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:03.621075+0000) 2019-10-23T13:38:03.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:03.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:03.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:03.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:04.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:38:04.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:04.579120+0000) 2019-10-23T13:38:04.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:38:04.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:04.602673+0000) 2019-10-23T13:38:04.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:38:04.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:04.616585+0000) 2019-10-23T13:38:04.622 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:38:04.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:04.618089+0000) 2019-10-23T13:38:04.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:04.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:04.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:04.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:05.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:05.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:05.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:05.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:06.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:06.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:06.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:06.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:07.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:07.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:07.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:07.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:08.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:38:08.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:08.103043+0000) 2019-10-23T13:38:08.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:08.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:08.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:08.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:09.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:09.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:09.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:09.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:11.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:10.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:11.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:11.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:12.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:12.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:12.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:12.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:13.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:13.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:13.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:13.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:13.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:38:13.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:13.621174+0000) 2019-10-23T13:38:14.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:14.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:14.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:14.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:14.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:38:14.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:14.579208+0000) 2019-10-23T13:38:14.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:38:14.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:14.602775+0000) 2019-10-23T13:38:14.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:38:14.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:14.616676+0000) 2019-10-23T13:38:14.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:38:14.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:14.618197+0000) 2019-10-23T13:38:14.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:14.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:14.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:14.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:16.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:15.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:16.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:15.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:17.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:17.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:17.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:17.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:18.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:18.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:18.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:18.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:18.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:38:18.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:18.103155+0000) 2019-10-23T13:38:18.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:18.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:18.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:18.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:20.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:20.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:20.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:20.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:21.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:21.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:21.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:21.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:22.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:22.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:22.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:22.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:23.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:23.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:23.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:23.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:23.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:38:23.619+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:23.621271+0000) 2019-10-23T13:38:24.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:24.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:24.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:24.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:24.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:38:24.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:24.579299+0000) 2019-10-23T13:38:24.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:38:24.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:24.602870+0000) 2019-10-23T13:38:24.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:38:24.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:24.616772+0000) 2019-10-23T13:38:24.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:38:24.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:24.618306+0000) 2019-10-23T13:38:25.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:25.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:25.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:25.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:26.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:26.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:26.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:26.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:27.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:27.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:27.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:27.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:28.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:27.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:28.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:27.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:28.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:38:28.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:28.103267+0000) 2019-10-23T13:38:28.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:28.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:28.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:28.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:29.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:29.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:29.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:29.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:31.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:31.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:31.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:31.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:32.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:32.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:32.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:32.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:33.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:33.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:33.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:33.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:33.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:38:33.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:33.621387+0000) 2019-10-23T13:38:34.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:34.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:34.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:34.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:34.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:38:34.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:34.579390+0000) 2019-10-23T13:38:34.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:38:34.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:34.602964+0000) 2019-10-23T13:38:34.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:38:34.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:34.616870+0000) 2019-10-23T13:38:34.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:38:34.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:34.618410+0000) 2019-10-23T13:38:35.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:35.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:35.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:35.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:36.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:36.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:36.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:36.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:37.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:37.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:37.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:37.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:38.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:38.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:38.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:38.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:38.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:38:38.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:38.103385+0000) 2019-10-23T13:38:39.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:39.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:39.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:39.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:40.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:40.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:40.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:40.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:41.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:41.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:41.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:41.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:42.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:42.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:42.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:42.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:43.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:43.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:43.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:43.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:43.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:38:43.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:43.621517+0000) 2019-10-23T13:38:44.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:44.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:44.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:44.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:44.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:38:44.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:44.579487+0000) 2019-10-23T13:38:44.605 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:38:44.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:44.603055+0000) 2019-10-23T13:38:44.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:38:44.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:44.616965+0000) 2019-10-23T13:38:44.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:38:44.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:44.618519+0000) 2019-10-23T13:38:45.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:45.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:45.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:45.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:46.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:46.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:46.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:46.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:47.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:47.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:47.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:47.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:48.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:38:48.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:48.103500+0000) 2019-10-23T13:38:48.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:48.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:48.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:48.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:49.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:49.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:49.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:49.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:50.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:50.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:50.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:50.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:51.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:51.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:51.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:51.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:52.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:52.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:52.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:52.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:53.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:53.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:53.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:53.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:53.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:38:53.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:53.621612+0000) 2019-10-23T13:38:54.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:54.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:54.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:54.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:54.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:38:54.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:54.579580+0000) 2019-10-23T13:38:54.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:38:54.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:54.603150+0000) 2019-10-23T13:38:54.619 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:38:54.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:54.617061+0000) 2019-10-23T13:38:54.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:38:54.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:54.618627+0000) 2019-10-23T13:38:55.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:55.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:55.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:55.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:56.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:56.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:56.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:56.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:57.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:57.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:57.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:57.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:58.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:38:58.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:38:58.103610+0000) 2019-10-23T13:38:58.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:58.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:58.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:58.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:38:59.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:59.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:38:59.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:38:59.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:00.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:00.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:00.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:00.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:01.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:01.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:01.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:01.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:02.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:02.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:02.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:02.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:03.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:03.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:03.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:03.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:03.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:39:03.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:03.621708+0000) 2019-10-23T13:39:04.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:04.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:04.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:04.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:04.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:39:04.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:04.579673+0000) 2019-10-23T13:39:04.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:39:04.601+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:04.603249+0000) 2019-10-23T13:39:04.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:39:04.615+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:04.617157+0000) 2019-10-23T13:39:04.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:39:04.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:04.618735+0000) 2019-10-23T13:39:05.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:05.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:05.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:05.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:06.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:06.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:06.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:06.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:07.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:07.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:07.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:07.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:08.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:39:08.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:08.103720+0000) 2019-10-23T13:39:08.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:08.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:08.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:08.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:09.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:09.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:09.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:09.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:10.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:10.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:10.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:10.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:11.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:11.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:11.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:11.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:12.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:12.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:12.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:12.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:13.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:13.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:13.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:13.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:13.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:39:13.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:13.621806+0000) 2019-10-23T13:39:14.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:14.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:14.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:14.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:14.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:39:14.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:14.579766+0000) 2019-10-23T13:39:14.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:39:14.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:14.603352+0000) 2019-10-23T13:39:14.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:39:14.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:14.617253+0000) 2019-10-23T13:39:14.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:39:14.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:14.618846+0000) 2019-10-23T13:39:15.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:15.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:15.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:15.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:16.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:16.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:16.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:16.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:17.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:17.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:17.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:17.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:18.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:39:18.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:18.103834+0000) 2019-10-23T13:39:18.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:18.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:18.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:18.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:19.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:19.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:19.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:19.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:20.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:20.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:20.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:20.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:21.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:21.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:21.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:21.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:22.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:22.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:22.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:22.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:23.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:23.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:23.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:23.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:23.624 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:39:23.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:23.621897+0000) 2019-10-23T13:39:24.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:24.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:24.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:24.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:24.582 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:39:24.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:24.579862+0000) 2019-10-23T13:39:24.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:39:24.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:24.603450+0000) 2019-10-23T13:39:24.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:39:24.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:24.617358+0000) 2019-10-23T13:39:24.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:39:24.617+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:24.618955+0000) 2019-10-23T13:39:25.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:25.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:25.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:25.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:26.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:26.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:26.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:26.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:27.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:27.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:27.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:27.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:28.108 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:39:28.102+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:28.103946+0000) 2019-10-23T13:39:28.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:28.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:28.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:28.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:29.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:29.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:29.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:29.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:30.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:30.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:30.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:30.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:31.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:31.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:31.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:31.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:32.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:32.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:32.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:32.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:33.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:33.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:33.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:33.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:33.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:39:33.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:33.621994+0000) 2019-10-23T13:39:34.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:34.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:34.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:34.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:34.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:39:34.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:34.579959+0000) 2019-10-23T13:39:34.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:39:34.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:34.603546+0000) 2019-10-23T13:39:34.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:39:34.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:34.617457+0000) 2019-10-23T13:39:34.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:39:34.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:34.619062+0000) 2019-10-23T13:39:35.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:35.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:35.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:35.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:36.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:36.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:36.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:36.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:37.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:37.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:37.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:37.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:38.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:39:38.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:38.104062+0000) 2019-10-23T13:39:38.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:38.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:38.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:38.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:39.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:39.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:39.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:39.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:40.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:40.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:40.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:40.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:41.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:41.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:41.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:41.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:42.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:42.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:42.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:42.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:43.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:43.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:43.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:43.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:39:43.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:43.622090+0000) 2019-10-23T13:39:44.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:44.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:44.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:44.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:44.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:39:44.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:44.580055+0000) 2019-10-23T13:39:44.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:39:44.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:44.603642+0000) 2019-10-23T13:39:44.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:39:44.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:44.617549+0000) 2019-10-23T13:39:44.623 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:39:44.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:44.619172+0000) 2019-10-23T13:39:44.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:44.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:44.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:44.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:45.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:45.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:45.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:45.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:46.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:46.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:46.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:46.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:47.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:47.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:47.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:47.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:48.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:39:48.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:48.104175+0000) 2019-10-23T13:39:48.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:48.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:48.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:48.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:49.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:49.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:49.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:49.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:50.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:50.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:50.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:50.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:51.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:51.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:51.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:51.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:52.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:52.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:52.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:52.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:53.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:39:53.620+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:53.622185+0000) 2019-10-23T13:39:53.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:53.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:53.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:53.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:54.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:39:54.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:54.580147+0000) 2019-10-23T13:39:54.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:39:54.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:54.603735+0000) 2019-10-23T13:39:54.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:39:54.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:54.617644+0000) 2019-10-23T13:39:54.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:39:54.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:54.619282+0000) 2019-10-23T13:39:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:54.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:54.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:55.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:55.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:55.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:55.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:56.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:56.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:56.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:56.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:57.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:57.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:57.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:57.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:58.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:39:58.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:39:58.104289+0000) 2019-10-23T13:39:58.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:58.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:58.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:58.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:39:59.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:59.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:39:59.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:39:59.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:00.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:00.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:00.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:00.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:01.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:01.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:01.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:01.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:02.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:02.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:02.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:02.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:03.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:40:03.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:03.622283+0000) 2019-10-23T13:40:03.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:03.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:03.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:03.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:04.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:40:04.578+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:04.580243+0000) 2019-10-23T13:40:04.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:40:04.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:04.603831+0000) 2019-10-23T13:40:04.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:40:04.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:04.617736+0000) 2019-10-23T13:40:04.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:40:04.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:04.619391+0000) 2019-10-23T13:40:04.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:04.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:04.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:04.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:05.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:05.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:05.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:05.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:06.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:06.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:06.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:06.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:07.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:07.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:07.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:07.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:08.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:40:08.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:08.104405+0000) 2019-10-23T13:40:08.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:08.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:08.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:08.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:09.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:09.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:09.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:09.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:10.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:10.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:10.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:10.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:11.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:11.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:11.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:11.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:12.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:12.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:12.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:12.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:13.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:40:13.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:13.622386+0000) 2019-10-23T13:40:13.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:13.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:13.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:13.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:14.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:40:14.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:14.580301+0000) 2019-10-23T13:40:14.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:40:14.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:14.603928+0000) 2019-10-23T13:40:14.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:40:14.617+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:14.617831+0000) 2019-10-23T13:40:14.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:40:14.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:14.619500+0000) 2019-10-23T13:40:14.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:14.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:14.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:14.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:15.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:15.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:15.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:15.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:16.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:16.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:16.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:16.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:17.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:17.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:17.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:17.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:18.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:40:18.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:18.104586+0000) 2019-10-23T13:40:18.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:18.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:18.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:18.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:19.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:19.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:19.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:19.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:20.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:20.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:20.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:20.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:21.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:21.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:21.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:21.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:22.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:22.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:22.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:22.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:23.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:40:23.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:23.622485+0000) 2019-10-23T13:40:23.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:23.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:23.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:23.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:24.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:40:24.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:24.580393+0000) 2019-10-23T13:40:24.606 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:40:24.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:24.604026+0000) 2019-10-23T13:40:24.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:40:24.617+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:24.617929+0000) 2019-10-23T13:40:24.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:40:24.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:24.619608+0000) 2019-10-23T13:40:24.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:24.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:24.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:24.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:25.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:25.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:25.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:25.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:26.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:26.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:26.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:26.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:27.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:27.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:27.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:27.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:28.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:40:28.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:28.104735+0000) 2019-10-23T13:40:28.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:28.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:28.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:28.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:29.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:29.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:29.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:29.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:30.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:30.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:30.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:30.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:31.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:31.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:31.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:31.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:32.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:32.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:32.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:32.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:33.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:40:33.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:33.622582+0000) 2019-10-23T13:40:33.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:33.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:33.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:33.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:34.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:40:34.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:34.580485+0000) 2019-10-23T13:40:34.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:40:34.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:34.604119+0000) 2019-10-23T13:40:34.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:40:34.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:34.618023+0000) 2019-10-23T13:40:34.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:40:34.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:34.619710+0000) 2019-10-23T13:40:34.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:34.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:34.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:34.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:35.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:35.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:35.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:35.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:36.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:36.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:36.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:36.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:37.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:37.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:37.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:37.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:38.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:40:38.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:38.104858+0000) 2019-10-23T13:40:38.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:38.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:38.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:38.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:39.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:39.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:39.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:39.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:40.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:40.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:40.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:40.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:41.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:41.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:41.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:41.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:42.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:42.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:42.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:42.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:43.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:40:43.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:43.622677+0000) 2019-10-23T13:40:43.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:43.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:43.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:43.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:44.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:40:44.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:44.580582+0000) 2019-10-23T13:40:44.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:40:44.602+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:44.604211+0000) 2019-10-23T13:40:44.620 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:40:44.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:44.618119+0000) 2019-10-23T13:40:44.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:40:44.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:44.619814+0000) 2019-10-23T13:40:44.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:44.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:44.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:44.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:45.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:45.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:45.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:45.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:46.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:46.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:46.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:46.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:47.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:47.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:47.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:47.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:48.109 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:40:48.103+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:48.104969+0000) 2019-10-23T13:40:48.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:48.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:48.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:48.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:49.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:49.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:49.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:49.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:50.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:50.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:50.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:50.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:51.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:51.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:51.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:51.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:52.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:52.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:52.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:52.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:53.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:53.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:53.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:53.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:53.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:40:53.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:53.622770+0000) 2019-10-23T13:40:54.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:40:54.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:54.580678+0000) 2019-10-23T13:40:54.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:54.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:54.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:54.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:54.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:40:54.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:54.604299+0000) 2019-10-23T13:40:54.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:40:54.616+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:54.618215+0000) 2019-10-23T13:40:54.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:40:54.618+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:54.619921+0000) 2019-10-23T13:40:55.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:55.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:55.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:55.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:56.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:56.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:56.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:56.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:57.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:57.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:57.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:57.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:58.110 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:40:58.104+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:40:58.105060+0000) 2019-10-23T13:40:58.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:58.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:58.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:58.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:40:59.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:59.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:40:59.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:40:59.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:00.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:00.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:00.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:00.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:01.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:01.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:01.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:01.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:02.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:02.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:02.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:02.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:03.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:03.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:03.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:03.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:03.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:41:03.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:03.622869+0000) 2019-10-23T13:41:04.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:04.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:04.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:04.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:04.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:41:04.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:04.580773+0000) 2019-10-23T13:41:04.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:41:04.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:04.604397+0000) 2019-10-23T13:41:04.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:04.617+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:04.618313+0000) 2019-10-23T13:41:04.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:41:04.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:04.620036+0000) 2019-10-23T13:41:05.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:05.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:05.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:05.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:06.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:06.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:06.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:06.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:07.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:07.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:07.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:07.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:08.110 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:08.104+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:08.105161+0000) 2019-10-23T13:41:08.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:08.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:08.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:08.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:09.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:09.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:09.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:09.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:10.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:10.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:10.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:10.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:11.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:11.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:11.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:11.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:12.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:12.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:12.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:12.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:13.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:13.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:13.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:13.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:13.625 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:41:13.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:13.622965+0000) 2019-10-23T13:41:14.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:14.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:14.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:14.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:14.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:41:14.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:14.580869+0000) 2019-10-23T13:41:14.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:41:14.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:14.604492+0000) 2019-10-23T13:41:14.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:14.617+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:14.618406+0000) 2019-10-23T13:41:14.624 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:41:14.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:14.620145+0000) 2019-10-23T13:41:15.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:15.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:15.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:15.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:16.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:16.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:16.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:16.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:17.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:17.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:17.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:17.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:18.110 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:18.104+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:18.105261+0000) 2019-10-23T13:41:18.110 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:18.104+0000 7f2d21959700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:18.105916+0000) 2019-10-23T13:41:18.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:18.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:18.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:18.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:19.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:19.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:19.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:19.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:20.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:20.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:20.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:20.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:21.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:21.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:21.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:21.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:22.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:22.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:22.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:22.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:22.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:22.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:22.605434+0000) 2019-10-23T13:41:23.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:23.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:23.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:23.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:23.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:41:23.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:23.623065+0000) 2019-10-23T13:41:24.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:24.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:24.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:24.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:24.583 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:41:24.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:24.580969+0000) 2019-10-23T13:41:24.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:41:24.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:24.604589+0000) 2019-10-23T13:41:24.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:24.618+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:24.618497+0000) 2019-10-23T13:41:24.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:41:24.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:24.620250+0000) 2019-10-23T13:41:25.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:25.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:25.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:25.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:26.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:26.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:26.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:26.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:27.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:27.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:27.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:27.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:28.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:28.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:28.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:28.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:29.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:29.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:29.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:29.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:30.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:30.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:30.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:30.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:31.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:31.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:31.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:31.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:32.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:32.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:32.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:32.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:32.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:32.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:32.605526+0000) 2019-10-23T13:41:33.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:33.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:33.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:33.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:33.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:41:33.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:33.623162+0000) 2019-10-23T13:41:34.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:34.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:34.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:34.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:34.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:41:34.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:34.581063+0000) 2019-10-23T13:41:34.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:41:34.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:34.604685+0000) 2019-10-23T13:41:34.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:34.618+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:34.618591+0000) 2019-10-23T13:41:34.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:41:34.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:34.620357+0000) 2019-10-23T13:41:35.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:35.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:35.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:35.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:36.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:36.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:36.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:36.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:37.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:37.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:37.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:37.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:38.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:38.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:38.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:38.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:39.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:39.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:39.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:39.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:40.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:40.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:40.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:40.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:41.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:41.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:41.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:41.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:42.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:42.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:42.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:42.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:42.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:42.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:42.605621+0000) 2019-10-23T13:41:43.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:43.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:43.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:43.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:43.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:41:43.621+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:43.623259+0000) 2019-10-23T13:41:44.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:44.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:44.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:44.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:44.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:41:44.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:44.581160+0000) 2019-10-23T13:41:44.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:41:44.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:44.604778+0000) 2019-10-23T13:41:44.621 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:44.617+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:44.618679+0000) 2019-10-23T13:41:44.622 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:44.618+0000 7f9e30a8f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:44.619372+0000) 2019-10-23T13:41:44.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:41:44.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:44.620467+0000) 2019-10-23T13:41:45.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:45.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:45.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:45.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:46.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:46.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:46.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:46.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:47.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:47.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:47.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:47.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:48.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:48.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:48.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:48.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:49.121 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:49.117+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:49.118887+0000) 2019-10-23T13:41:49.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:49.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:49.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:49.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:50.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:50.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:50.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:50.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:51.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:51.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:51.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:51.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:52.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:52.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:52.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:52.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:52.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:41:52.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:52.605721+0000) 2019-10-23T13:41:53.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:53.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:53.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:53.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:53.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:41:53.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:53.623359+0000) 2019-10-23T13:41:54.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:54.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:54.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:54.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:54.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:41:54.579+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:54.581251+0000) 2019-10-23T13:41:54.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:41:54.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:54.604873+0000) 2019-10-23T13:41:54.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:41:54.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:54.620573+0000) 2019-10-23T13:41:55.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:55.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:55.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:55.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:56.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:56.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:56.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:56.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:57.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:57.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:57.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:57.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:58.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:58.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:58.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:58.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:59.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:59.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:41:59.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:41:59.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:41:59.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:41:59.117+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:41:59.118980+0000) 2019-10-23T13:42:00.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:00.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:00.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:00.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:01.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:01.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:01.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:01.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:02.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:02.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:02.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:02.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:02.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:42:02.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:02.605819+0000) 2019-10-23T13:42:03.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:03.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:03.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:03.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:03.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:42:03.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:03.623451+0000) 2019-10-23T13:42:04.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:04.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:04.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:04.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:04.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:42:04.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:04.581345+0000) 2019-10-23T13:42:04.607 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:42:04.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:04.604968+0000) 2019-10-23T13:42:04.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:42:04.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:04.620677+0000) 2019-10-23T13:42:05.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:05.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:05.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:05.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:05.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:05.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:05.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:05.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:06.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:06.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:06.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:06.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:07.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:07.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:07.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:07.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:08.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:08.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:08.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:08.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:09.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:42:09.117+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:09.119073+0000) 2019-10-23T13:42:10.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:10.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:10.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:10.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:10.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:10.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:10.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:10.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:11.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:11.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:11.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:11.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:12.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:42:12.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:12.605916+0000) 2019-10-23T13:42:12.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:12.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:12.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:12.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:13.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:42:13.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:13.623549+0000) 2019-10-23T13:42:13.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:13.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:13.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:13.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:14.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:42:14.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:14.581438+0000) 2019-10-23T13:42:14.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:42:14.603+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:14.605066+0000) 2019-10-23T13:42:14.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:42:14.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:14.620781+0000) 2019-10-23T13:42:14.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:14.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:14.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:14.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:15.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:15.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:15.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:15.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:16.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:16.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:16.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:16.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:17.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:17.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:17.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:17.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:18.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:18.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:18.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:18.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:19.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:42:19.117+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:19.119163+0000) 2019-10-23T13:42:19.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:19.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:19.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:19.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:20.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:20.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:20.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:20.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:21.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:21.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:21.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:21.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:22.610 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:42:22.604+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:22.606009+0000) 2019-10-23T13:42:22.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:22.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:22.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:22.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:23.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:42:23.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:23.623646+0000) 2019-10-23T13:42:23.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:23.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:23.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:23.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:24.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:42:24.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:24.581526+0000) 2019-10-23T13:42:24.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:42:24.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:24.605166+0000) 2019-10-23T13:42:24.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:42:24.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:24.620886+0000) 2019-10-23T13:42:24.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:24.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:24.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:24.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:25.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:25.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:25.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:25.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:26.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:26.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:26.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:26.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:27.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:27.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:27.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:27.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:28.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:28.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:28.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:28.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:29.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:42:29.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:29.119260+0000) 2019-10-23T13:42:29.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:29.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:29.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:29.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:30.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:30.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:30.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:30.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:31.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:31.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:31.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:31.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:32.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:42:32.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:32.606109+0000) 2019-10-23T13:42:32.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:32.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:32.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:32.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:33.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:42:33.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:33.623737+0000) 2019-10-23T13:42:33.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:33.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:33.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:33.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:34.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:42:34.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:34.581620+0000) 2019-10-23T13:42:34.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:42:34.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:34.605262+0000) 2019-10-23T13:42:34.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:42:34.619+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:34.620992+0000) 2019-10-23T13:42:34.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:34.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:34.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:34.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:35.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:35.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:35.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:35.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:36.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:36.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:36.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:36.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:37.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:37.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:37.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:37.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:38.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:38.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:38.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:38.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:39.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:42:39.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:39.119365+0000) 2019-10-23T13:42:39.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:39.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:39.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:39.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:40.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:40.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:40.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:40.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:41.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:41.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:41.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:41.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:42.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:42:42.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:42.606206+0000) 2019-10-23T13:42:42.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:42.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:42.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:42.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:43.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:42:43.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:43.623829+0000) 2019-10-23T13:42:43.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:43.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:43.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:43.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:44.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:42:44.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:44.581713+0000) 2019-10-23T13:42:44.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:42:44.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:44.605360+0000) 2019-10-23T13:42:44.625 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:42:44.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:44.621099+0000) 2019-10-23T13:42:44.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:44.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:44.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:44.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:45.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:45.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:45.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:45.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:46.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:46.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:46.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:46.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:47.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:47.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:47.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:47.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:48.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:48.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:48.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:48.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:49.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:42:49.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:49.119461+0000) 2019-10-23T13:42:49.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:49.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:49.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:49.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:50.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:50.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:50.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:50.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:51.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:51.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:51.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:51.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:52.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:42:52.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:52.606302+0000) 2019-10-23T13:42:52.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:52.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:52.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:52.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:53.626 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:42:53.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:53.623928+0000) 2019-10-23T13:42:53.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:53.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:53.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:53.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:54.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:42:54.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:54.581805+0000) 2019-10-23T13:42:54.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:42:54.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:54.605457+0000) 2019-10-23T13:42:54.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:42:54.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:54.621205+0000) 2019-10-23T13:42:54.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:54.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:54.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:54.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:55.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:55.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:55.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:55.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:56.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:56.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:57.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:57.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:57.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:57.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:58.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:58.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:58.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:58.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:42:59.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:42:59.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:42:59.119555+0000) 2019-10-23T13:42:59.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:59.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:42:59.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:42:59.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:00.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:00.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:00.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:00.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:01.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:01.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:01.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:01.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:02.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:43:02.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:02.606398+0000) 2019-10-23T13:43:02.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:02.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:02.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:02.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:03.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:43:03.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:03.624023+0000) 2019-10-23T13:43:03.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:03.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:03.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:03.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:04.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:43:04.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:04.581897+0000) 2019-10-23T13:43:04.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:43:04.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:04.605549+0000) 2019-10-23T13:43:04.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:43:04.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:04.621313+0000) 2019-10-23T13:43:04.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:04.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:04.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:04.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:05.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:05.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:05.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:05.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:06.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:06.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:06.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:06.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:07.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:07.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:07.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:07.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:08.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:08.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:08.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:09.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:43:09.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:09.119652+0000) 2019-10-23T13:43:09.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:09.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:09.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:09.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:10.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:10.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:10.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:10.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:11.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:11.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:11.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:11.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:12.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:43:12.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:12.606498+0000) 2019-10-23T13:43:12.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:12.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:12.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:12.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:13.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:43:13.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:13.624120+0000) 2019-10-23T13:43:13.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:13.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:13.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:13.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:14.584 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:43:14.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:14.581993+0000) 2019-10-23T13:43:14.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:43:14.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:14.605647+0000) 2019-10-23T13:43:14.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:43:14.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:14.621422+0000) 2019-10-23T13:43:14.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:14.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:14.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:14.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:15.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:15.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:15.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:15.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:16.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:16.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:16.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:16.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:17.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:17.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:17.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:17.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:18.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:18.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:18.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:18.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:19.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:43:19.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:19.119745+0000) 2019-10-23T13:43:19.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:19.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:19.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:19.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:20.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:20.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:20.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:20.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:21.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:21.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:21.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:21.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:22.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:43:22.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:22.606590+0000) 2019-10-23T13:43:22.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:22.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:22.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:22.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:23.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:43:23.622+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:23.624214+0000) 2019-10-23T13:43:23.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:23.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:23.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:23.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:24.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:43:24.580+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:24.582090+0000) 2019-10-23T13:43:24.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:43:24.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:24.605741+0000) 2019-10-23T13:43:24.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:43:24.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:24.621528+0000) 2019-10-23T13:43:24.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:24.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:24.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:24.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:25.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:25.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:25.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:25.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:26.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:26.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:26.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:26.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:28.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:28.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:28.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:28.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:29.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:29.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:29.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:29.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:29.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:43:29.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:29.119839+0000) 2019-10-23T13:43:30.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:30.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:30.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:30.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:31.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:31.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:31.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:31.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:32.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:32.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:32.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:32.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:32.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:43:32.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:32.606685+0000) 2019-10-23T13:43:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:33.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:33.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:33.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:43:33.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:33.624298+0000) 2019-10-23T13:43:34.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:34.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:34.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:34.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:34.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:43:34.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:34.582185+0000) 2019-10-23T13:43:34.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:43:34.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:34.605838+0000) 2019-10-23T13:43:34.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:43:34.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:34.621632+0000) 2019-10-23T13:43:35.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:35.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:35.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:35.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:36.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:36.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:36.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:36.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:37.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:37.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:37.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:37.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:38.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:38.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:38.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:38.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:39.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:39.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:39.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:39.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:39.122 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:43:39.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:39.119937+0000) 2019-10-23T13:43:40.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:40.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:40.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:40.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:41.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:41.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:41.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:41.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:42.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:42.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:42.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:42.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:42.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:43:42.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:42.606781+0000) 2019-10-23T13:43:43.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:43.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:43.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:43.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:43.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:43:43.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:43.624397+0000) 2019-10-23T13:43:44.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:44.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:44.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:44.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:44.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:43:44.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:44.582281+0000) 2019-10-23T13:43:44.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:43:44.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:44.605941+0000) 2019-10-23T13:43:44.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:43:44.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:44.621740+0000) 2019-10-23T13:43:45.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:45.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:45.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:45.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:46.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:46.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:46.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:46.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:47.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:47.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:47.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:47.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:48.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:48.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:48.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:48.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:49.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:43:49.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:49.120036+0000) 2019-10-23T13:43:49.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:49.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:49.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:49.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:50.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:50.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:50.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:50.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:51.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:51.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:51.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:51.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:52.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:52.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:52.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:52.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:52.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:43:52.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:52.606870+0000) 2019-10-23T13:43:53.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:53.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:53.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:53.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:53.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:43:53.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:53.624498+0000) 2019-10-23T13:43:54.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:54.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:54.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:54.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:54.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:43:54.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:54.582382+0000) 2019-10-23T13:43:54.608 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:43:54.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:54.606038+0000) 2019-10-23T13:43:54.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:43:54.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:54.621846+0000) 2019-10-23T13:43:55.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:55.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:55.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:55.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:56.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:56.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:56.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:56.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:57.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:57.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:57.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:57.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:58.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:58.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:58.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:58.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:43:59.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:43:59.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:43:59.120129+0000) 2019-10-23T13:43:59.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:59.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:43:59.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:43:59.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:00.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:00.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:00.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:00.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:01.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:01.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:01.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:01.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:02.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:02.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:02.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:02.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:02.611 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:44:02.605+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:02.606965+0000) 2019-10-23T13:44:03.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:03.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:03.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:03.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:03.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:44:03.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:03.624590+0000) 2019-10-23T13:44:04.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:04.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:04.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:04.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:04.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:44:04.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:04.582478+0000) 2019-10-23T13:44:04.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:44:04.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:04.606134+0000) 2019-10-23T13:44:04.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:44:04.620+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:04.621952+0000) 2019-10-23T13:44:05.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:05.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:05.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:05.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:06.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:06.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:06.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:06.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:07.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:07.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:07.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:07.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:08.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:08.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:08.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:08.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:09.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:44:09.118+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:09.120224+0000) 2019-10-23T13:44:09.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:09.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:09.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:09.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:10.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:10.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:10.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:10.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:11.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:11.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:11.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:11.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:12.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:12.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:12.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:12.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:12.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:44:12.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:12.607079+0000) 2019-10-23T13:44:13.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:13.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:13.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:13.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:13.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:44:13.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:13.624684+0000) 2019-10-23T13:44:14.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:14.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:14.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:14.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:14.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:44:14.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:14.582573+0000) 2019-10-23T13:44:14.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:44:14.604+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:14.606226+0000) 2019-10-23T13:44:14.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:44:14.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:14.622061+0000) 2019-10-23T13:44:15.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:15.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:15.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:15.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:16.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:16.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:16.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:16.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:17.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:17.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:17.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:17.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:18.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:18.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:18.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:18.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:19.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:44:19.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:19.120297+0000) 2019-10-23T13:44:19.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:19.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:19.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:19.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:20.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:20.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:20.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:20.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:21.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:21.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:21.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:21.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:22.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:22.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:22.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:22.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:22.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:44:22.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:22.607233+0000) 2019-10-23T13:44:23.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:23.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:23.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:23.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:23.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:44:23.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:23.624783+0000) 2019-10-23T13:44:24.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:24.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:24.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:24.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:24.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:44:24.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:24.582666+0000) 2019-10-23T13:44:24.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:44:24.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:24.606297+0000) 2019-10-23T13:44:24.626 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:44:24.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:24.622169+0000) 2019-10-23T13:44:25.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:25.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:25.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:25.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:26.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:26.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:26.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:26.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:27.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:27.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:27.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:27.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:28.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:28.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:28.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:28.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:29.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:44:29.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:29.120392+0000) 2019-10-23T13:44:29.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:29.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:29.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:29.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:30.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:30.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:30.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:30.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:31.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:31.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:31.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:31.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:32.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:32.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:32.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:32.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:32.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:44:32.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:32.607331+0000) 2019-10-23T13:44:33.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:33.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:33.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:33.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:33.627 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:44:33.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:33.624875+0000) 2019-10-23T13:44:34.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:34.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:34.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:34.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:34.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:44:34.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:34.582757+0000) 2019-10-23T13:44:34.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:44:34.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:34.606390+0000) 2019-10-23T13:44:34.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:44:34.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:34.622277+0000) 2019-10-23T13:44:35.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:35.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:35.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:35.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:36.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:36.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:36.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:36.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:37.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:37.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:37.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:37.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:38.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:38.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:38.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:38.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:39.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:44:39.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:39.120491+0000) 2019-10-23T13:44:39.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:39.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:39.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:39.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:40.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:40.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:40.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:40.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:41.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:41.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:41.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:41.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:42.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:42.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:42.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:42.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:42.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:44:42.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:42.607427+0000) 2019-10-23T13:44:43.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:43.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:43.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:43.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:43.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:44:43.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:43.624976+0000) 2019-10-23T13:44:44.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:44.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:44.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:44.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:44.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:44:44.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:44.582852+0000) 2019-10-23T13:44:44.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:44:44.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:44.606484+0000) 2019-10-23T13:44:44.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:44:44.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:44.622384+0000) 2019-10-23T13:44:45.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:45.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:45.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:45.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:46.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:46.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:46.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:46.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:47.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:47.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:47.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:47.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:48.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:48.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:48.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:48.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:49.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:44:49.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:49.120602+0000) 2019-10-23T13:44:49.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:49.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:49.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:49.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:50.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:50.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:50.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:50.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:51.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:51.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:51.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:51.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:52.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:52.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:52.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:52.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:52.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:44:52.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:52.607523+0000) 2019-10-23T13:44:53.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:53.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:53.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:53.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:53.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:44:53.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:53.625077+0000) 2019-10-23T13:44:54.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:54.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:54.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:54.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:54.585 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:44:54.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:54.582945+0000) 2019-10-23T13:44:54.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:44:54.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:54.606579+0000) 2019-10-23T13:44:54.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:44:54.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:54.622492+0000) 2019-10-23T13:44:55.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:55.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:55.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:55.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:56.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:56.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:56.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:56.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:57.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:57.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:57.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:57.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:58.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:58.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:58.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:58.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:44:59.123 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:44:59.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:44:59.120696+0000) 2019-10-23T13:44:59.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:59.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:44:59.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:44:59.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:00.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:00.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:00.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:00.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:01.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:01.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:01.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:01.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:02.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:02.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:02.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:02.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:02.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:45:02.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:02.607616+0000) 2019-10-23T13:45:03.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:03.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:03.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:03.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:03.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:45:03.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:03.625174+0000) 2019-10-23T13:45:04.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:04.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:04.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:04.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:04.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:45:04.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:04.583036+0000) 2019-10-23T13:45:04.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:45:04.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:04.606675+0000) 2019-10-23T13:45:04.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:45:04.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:04.622600+0000) 2019-10-23T13:45:05.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:05.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:05.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:05.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:06.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:06.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:06.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:06.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:07.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:07.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:07.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:07.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:08.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:08.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:08.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:08.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:09.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:45:09.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:09.120796+0000) 2019-10-23T13:45:09.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:09.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:09.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:09.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:10.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:10.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:10.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:10.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:11.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:11.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:11.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:11.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:12.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:12.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:12.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:12.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:12.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:45:12.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:12.607713+0000) 2019-10-23T13:45:13.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:13.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:13.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:13.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:13.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:45:13.623+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:13.625271+0000) 2019-10-23T13:45:14.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:14.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:14.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:14.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:14.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:45:14.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:14.583126+0000) 2019-10-23T13:45:14.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:45:14.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:14.606771+0000) 2019-10-23T13:45:14.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:45:14.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:14.622709+0000) 2019-10-23T13:45:15.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:15.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:15.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:15.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:16.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:16.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:16.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:16.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:17.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:17.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:17.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:17.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:18.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:18.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:18.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:18.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:19.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:45:19.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:19.120891+0000) 2019-10-23T13:45:19.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:19.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:19.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:19.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:20.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:20.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:20.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:20.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:21.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:21.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:21.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:21.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:22.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:22.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:22.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:22.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:22.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:45:22.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:22.607809+0000) 2019-10-23T13:45:23.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:23.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:23.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:23.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:23.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:45:23.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:23.625371+0000) 2019-10-23T13:45:24.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:24.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:24.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:24.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:24.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:45:24.581+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:24.583223+0000) 2019-10-23T13:45:24.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:45:24.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:24.606866+0000) 2019-10-23T13:45:24.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:45:24.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:24.622816+0000) 2019-10-23T13:45:25.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:25.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:25.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:25.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:26.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:26.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:26.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:26.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:27.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:27.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:27.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:27.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:28.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:28.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:28.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:28.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:29.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:45:29.119+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:29.120986+0000) 2019-10-23T13:45:29.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:29.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:29.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:29.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:30.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:30.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:30.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:30.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:31.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:31.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:31.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:31.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:32.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:32.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:32.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:32.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:32.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:45:32.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:32.607904+0000) 2019-10-23T13:45:33.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:33.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:33.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:33.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:33.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:45:33.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:33.625467+0000) 2019-10-23T13:45:34.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:34.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:34.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:34.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:34.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:45:34.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:34.583314+0000) 2019-10-23T13:45:34.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:45:34.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:34.606960+0000) 2019-10-23T13:45:34.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:45:34.621+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:34.622924+0000) 2019-10-23T13:45:35.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:35.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:35.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:35.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:36.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:36.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:36.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:36.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:37.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:37.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:37.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:37.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:38.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:38.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:38.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:38.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:39.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:45:39.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:39.121087+0000) 2019-10-23T13:45:39.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:39.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:39.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:39.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:40.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:40.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:40.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:40.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:41.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:41.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:41.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:41.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:42.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:42.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:42.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:42.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:42.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:45:42.606+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:42.608000+0000) 2019-10-23T13:45:43.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:43.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:43.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:43.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:43.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:45:43.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:43.625566+0000) 2019-10-23T13:45:44.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:44.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:44.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:44.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:44.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:45:44.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:44.583406+0000) 2019-10-23T13:45:44.609 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:45:44.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:44.607055+0000) 2019-10-23T13:45:44.627 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:45:44.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:44.623041+0000) 2019-10-23T13:45:45.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:45.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:45.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:45.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:46.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:46.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:46.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:46.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:47.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:47.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:47.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:47.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:48.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:48.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:48.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:48.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:49.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:45:49.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:49.121188+0000) 2019-10-23T13:45:49.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:49.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:49.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:49.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:50.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:50.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:50.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:50.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:51.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:51.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:51.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:51.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:52.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:52.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:52.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:52.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:52.612 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:45:52.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:52.608099+0000) 2019-10-23T13:45:53.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:53.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:53.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:53.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:53.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:45:53.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:53.625661+0000) 2019-10-23T13:45:54.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:54.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:54.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:54.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:54.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:45:54.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:54.583505+0000) 2019-10-23T13:45:54.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:45:54.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:54.607150+0000) 2019-10-23T13:45:54.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:45:54.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:54.623146+0000) 2019-10-23T13:45:55.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:55.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:55.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:55.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:56.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:56.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:56.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:56.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:57.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:57.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:57.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:57.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:58.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:58.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:58.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:58.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:45:59.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:45:59.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:45:59.121283+0000) 2019-10-23T13:45:59.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:59.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:45:59.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:45:59.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:00.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:00.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:00.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:00.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:01.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:01.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:01.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:01.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:02.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:02.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:02.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:02.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:02.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:46:02.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:02.608196+0000) 2019-10-23T13:46:03.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:03.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:03.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:03.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:03.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:46:03.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:03.625769+0000) 2019-10-23T13:46:04.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:04.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:04.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:04.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:04.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:46:04.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:04.583600+0000) 2019-10-23T13:46:04.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:46:04.605+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:04.607245+0000) 2019-10-23T13:46:04.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:46:04.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:04.623250+0000) 2019-10-23T13:46:05.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:05.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:05.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:05.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:06.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:06.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:06.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:06.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:07.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:07.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:07.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:07.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:08.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:08.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:08.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:08.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:09.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:46:09.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:09.121383+0000) 2019-10-23T13:46:09.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:09.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:09.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:09.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:10.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:10.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:10.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:10.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:11.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:11.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:11.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:11.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:12.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:12.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:12.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:12.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:12.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:46:12.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:12.608288+0000) 2019-10-23T13:46:13.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:13.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:13.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:13.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:13.628 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:46:13.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:13.625860+0000) 2019-10-23T13:46:14.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:14.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:14.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:14.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:14.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:46:14.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:14.583693+0000) 2019-10-23T13:46:14.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:46:14.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:14.607298+0000) 2019-10-23T13:46:14.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:46:14.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:14.623360+0000) 2019-10-23T13:46:15.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:15.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:35:42.907060+0000 (oldest deadline 2019-10-23T13:36:02.907060+0000) 2019-10-23T13:46:15.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:15.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:16.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:16.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:17.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:17.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:18.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:18.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:19.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:46:19.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:19.121524+0000) 2019-10-23T13:46:19.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:19.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:20.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:20.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:21.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:21.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:22.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:22.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:22.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:46:22.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:22.608384+0000) 2019-10-23T13:46:23.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:23.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:23.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:46:23.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:23.625961+0000) 2019-10-23T13:46:24.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:24.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:24.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:46:24.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:24.583782+0000) 2019-10-23T13:46:24.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:46:24.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:24.607393+0000) 2019-10-23T13:46:24.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:46:24.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:24.623468+0000) 2019-10-23T13:46:25.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:25.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:26.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:26.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:27.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:27.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:28.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:28.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:29.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:46:29.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:29.121653+0000) 2019-10-23T13:46:29.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:29.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:30.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:30.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:31.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:31.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:32.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:32.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:32.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:46:32.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:32.608481+0000) 2019-10-23T13:46:33.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:33.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:33.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:46:33.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:33.626059+0000) 2019-10-23T13:46:34.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:34.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:34.586 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:46:34.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:34.583877+0000) 2019-10-23T13:46:34.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:46:34.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:34.607485+0000) 2019-10-23T13:46:34.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:46:34.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:34.623579+0000) 2019-10-23T13:46:35.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:35.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:36.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:36.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:37.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:37.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:37.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:37.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:38.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:38.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:38.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:38.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:39.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:46:39.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:39.121728+0000) 2019-10-23T13:46:39.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:39.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:39.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:39.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:40.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:40.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:40.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:40.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:41.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:41.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:41.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:41.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:42.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:42.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:42.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:42.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:42.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:46:42.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:42.608577+0000) 2019-10-23T13:46:43.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:43.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:43.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:43.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:43.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:46:43.624+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:43.626159+0000) 2019-10-23T13:46:44.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:44.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:44.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:44.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:44.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:46:44.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:44.583973+0000) 2019-10-23T13:46:44.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:46:44.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:44.607582+0000) 2019-10-23T13:46:44.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:46:44.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:44.623685+0000) 2019-10-23T13:46:45.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:45.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:45.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:45.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:46.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:46.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:46.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:46.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:47.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:47.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:47.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:47.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:48.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:48.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:48.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:48.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:49.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:46:49.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:49.121820+0000) 2019-10-23T13:46:49.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:49.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:49.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:49.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:50.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:50.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:50.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:50.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:51.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:51.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:51.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:51.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:52.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:52.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:52.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:52.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:52.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:46:52.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:52.608674+0000) 2019-10-23T13:46:53.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:53.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:53.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:53.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:53.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:46:53.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:53.626259+0000) 2019-10-23T13:46:54.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:54.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:54.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:54.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:54.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:46:54.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:54.584065+0000) 2019-10-23T13:46:54.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:46:54.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:54.607675+0000) 2019-10-23T13:46:54.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:46:54.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:54.623789+0000) 2019-10-23T13:46:55.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:55.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:55.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:55.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:56.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:56.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:56.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:56.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:57.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:57.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:57.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:57.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:58.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:58.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:58.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:58.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:46:59.124 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:46:59.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:46:59.121914+0000) 2019-10-23T13:46:59.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:59.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:46:59.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:46:59.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:00.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:00.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:00.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:00.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:01.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:01.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:01.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:01.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:02.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:02.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:02.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:02.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:02.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:47:02.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:02.608770+0000) 2019-10-23T13:47:03.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:03.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:03.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:03.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:03.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:47:03.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:03.626367+0000) 2019-10-23T13:47:04.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:04.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:04.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:04.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:04.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:47:04.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:04.584162+0000) 2019-10-23T13:47:04.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:47:04.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:04.607770+0000) 2019-10-23T13:47:04.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:47:04.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:04.623897+0000) 2019-10-23T13:47:05.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:05.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:05.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:05.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:06.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:06.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:06.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:06.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:07.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:07.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:07.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:07.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:08.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:08.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:08.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:08.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:09.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:47:09.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:09.122014+0000) 2019-10-23T13:47:09.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:09.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:09.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:09.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:10.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:10.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:10.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:10.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:11.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:11.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:11.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:11.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:12.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:12.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:12.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:12.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:12.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:47:12.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:12.608865+0000) 2019-10-23T13:47:13.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:13.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:13.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:13.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:13.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:47:13.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:13.626459+0000) 2019-10-23T13:47:14.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:14.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:14.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:14.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:14.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:47:14.582+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:14.584255+0000) 2019-10-23T13:47:14.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:47:14.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:14.607860+0000) 2019-10-23T13:47:14.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:47:14.622+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:14.624001+0000) 2019-10-23T13:47:15.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:15.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:15.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:15.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:16.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:16.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:16.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:16.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:17.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:17.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:17.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:17.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:18.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:18.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:18.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:18.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:19.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:47:19.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:19.122103+0000) 2019-10-23T13:47:19.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:19.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:19.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:19.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:20.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:20.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:20.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:20.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:21.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:21.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:21.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:21.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:22.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:22.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:22.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:22.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:22.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:47:22.607+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:22.608963+0000) 2019-10-23T13:47:23.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:23.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:23.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:23.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:23.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:47:23.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:23.626558+0000) 2019-10-23T13:47:24.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:24.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:24.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:24.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:24.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:47:24.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:24.584353+0000) 2019-10-23T13:47:24.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:47:24.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:24.607955+0000) 2019-10-23T13:47:24.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:47:24.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:24.624106+0000) 2019-10-23T13:47:25.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:25.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:25.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:25.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:26.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:26.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:26.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:26.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:27.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:27.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:27.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:27.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:28.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:28.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:28.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:28.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:29.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:47:29.120+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:29.122195+0000) 2019-10-23T13:47:29.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:29.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:29.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:29.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:30.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:30.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:30.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:30.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:31.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:31.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:31.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:31.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:32.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:32.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:32.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:32.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:32.613 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:47:32.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:32.609061+0000) 2019-10-23T13:47:33.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:33.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:33.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:33.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:33.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:47:33.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:33.626662+0000) 2019-10-23T13:47:34.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:34.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:34.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:34.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:34.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:47:34.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:34.584448+0000) 2019-10-23T13:47:34.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:47:34.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:34.608053+0000) 2019-10-23T13:47:34.628 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:47:34.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:34.624207+0000) 2019-10-23T13:47:35.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:35.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:35.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:35.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:36.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:36.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:36.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:36.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:37.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:37.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:37.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:37.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:38.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:38.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:38.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:38.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:39.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:47:39.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:39.122295+0000) 2019-10-23T13:47:39.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:39.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:39.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:39.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:40.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:40.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:40.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:40.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:41.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:41.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:41.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:41.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:42.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:42.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:42.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:42.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:42.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:47:42.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:42.609155+0000) 2019-10-23T13:47:43.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:43.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:43.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:43.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:43.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:47:43.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:43.626760+0000) 2019-10-23T13:47:44.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:44.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:44.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:44.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:44.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:47:44.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:44.584542+0000) 2019-10-23T13:47:44.610 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:47:44.606+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:44.608150+0000) 2019-10-23T13:47:44.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:47:44.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:44.624311+0000) 2019-10-23T13:47:45.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:45.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:45.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:45.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:46.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:46.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:46.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:46.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:47.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:47.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:47.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:47.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:48.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:48.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:48.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:48.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:49.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:47:49.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:49.122390+0000) 2019-10-23T13:47:49.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:49.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:49.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:49.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:50.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:50.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:50.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:50.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:51.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:51.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:51.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:51.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:52.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:52.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:52.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:52.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:52.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:47:52.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:52.609251+0000) 2019-10-23T13:47:53.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:53.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:53.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:53.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:53.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:47:53.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:53.626865+0000) 2019-10-23T13:47:54.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:54.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:54.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:54.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:54.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:47:54.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:54.584634+0000) 2019-10-23T13:47:54.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:47:54.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:54.608246+0000) 2019-10-23T13:47:54.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:47:54.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:54.624414+0000) 2019-10-23T13:47:55.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:55.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:55.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:55.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:56.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:56.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:56.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:56.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:57.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:57.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:57.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:57.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:58.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:58.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:58.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:58.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:47:59.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:47:59.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:47:59.122485+0000) 2019-10-23T13:47:59.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:59.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:47:59.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:47:59.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:00.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:00.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:00.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:00.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:01.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:01.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:01.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:01.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:02.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:02.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:02.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:02.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:02.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:48:02.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:02.609345+0000) 2019-10-23T13:48:03.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:03.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:03.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:03.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:03.629 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:48:03.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:03.626966+0000) 2019-10-23T13:48:04.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:04.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:04.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:04.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:04.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:48:04.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:04.584732+0000) 2019-10-23T13:48:04.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:48:04.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:04.608299+0000) 2019-10-23T13:48:04.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:48:04.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:04.624522+0000) 2019-10-23T13:48:05.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:05.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:05.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:05.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:06.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:06.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:06.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:06.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:07.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:07.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:07.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:07.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:08.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:08.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:08.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:08.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:09.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:48:09.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:09.122580+0000) 2019-10-23T13:48:09.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:09.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:09.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:09.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:10.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:10.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:10.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:10.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:11.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:11.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:11.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:11.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:12.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:12.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:12.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:12.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:12.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:48:12.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:12.609442+0000) 2019-10-23T13:48:13.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:13.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:13.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:13.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:13.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:48:13.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:13.627066+0000) 2019-10-23T13:48:14.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:14.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:14.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:14.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:14.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:48:14.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:14.584826+0000) 2019-10-23T13:48:14.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:48:14.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:14.608394+0000) 2019-10-23T13:48:14.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:48:14.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:14.624630+0000) 2019-10-23T13:48:15.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:15.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:15.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:15.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:16.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:16.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:16.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:16.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:17.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:17.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:17.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:17.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:18.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:18.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:18.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:18.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:19.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:48:19.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:19.122677+0000) 2019-10-23T13:48:19.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:19.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:19.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:19.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:20.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:20.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:20.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:20.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:21.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:21.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:21.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:21.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:22.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:22.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:22.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:22.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:22.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:48:22.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:22.609540+0000) 2019-10-23T13:48:23.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:23.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:23.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:23.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:23.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:48:23.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:23.627167+0000) 2019-10-23T13:48:24.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:24.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:24.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:24.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:24.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:48:24.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:24.584917+0000) 2019-10-23T13:48:24.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:48:24.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:24.608489+0000) 2019-10-23T13:48:24.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:48:24.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:24.624736+0000) 2019-10-23T13:48:25.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:25.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:25.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:25.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:26.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:26.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:26.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:26.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:27.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:27.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:27.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:27.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:28.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:28.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:28.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:28.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:29.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:48:29.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:29.122771+0000) 2019-10-23T13:48:29.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:29.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:29.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:29.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:30.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:30.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:30.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:30.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:31.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:31.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:31.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:31.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:32.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:32.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:32.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:32.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:32.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:48:32.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:32.609637+0000) 2019-10-23T13:48:33.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:33.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:33.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:33.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:33.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:48:33.625+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:33.627269+0000) 2019-10-23T13:48:34.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:34.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:34.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:34.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:34.587 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:48:34.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:34.585012+0000) 2019-10-23T13:48:34.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:48:34.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:34.608580+0000) 2019-10-23T13:48:34.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:48:34.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:34.624842+0000) 2019-10-23T13:48:35.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:35.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:35.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:35.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:36.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:36.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:36.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:36.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:37.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:37.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:37.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:37.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:38.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:38.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:38.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:38.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:39.125 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:48:39.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:39.122864+0000) 2019-10-23T13:48:39.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:39.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:39.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:39.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:40.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:40.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:40.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:40.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:41.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:41.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:41.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:41.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:42.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:42.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:42.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:42.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:42.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:48:42.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:42.609733+0000) 2019-10-23T13:48:43.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:43.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:43.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:43.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:43.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:48:43.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:43.627368+0000) 2019-10-23T13:48:44.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:44.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:44.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:44.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:44.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:48:44.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:44.585108+0000) 2019-10-23T13:48:44.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:48:44.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:44.608670+0000) 2019-10-23T13:48:44.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:48:44.623+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:44.624950+0000) 2019-10-23T13:48:45.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:45.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:45.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:45.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:46.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:46.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:46.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:46.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:47.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:47.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:47.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:47.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:48.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:48.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:48.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:48.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:49.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:48:49.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:49.122959+0000) 2019-10-23T13:48:49.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:49.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:49.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:49.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:50.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:50.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:50.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:50.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:51.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:51.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:51.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:51.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:52.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:52.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:52.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:52.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:52.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:48:52.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:52.609829+0000) 2019-10-23T13:48:53.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:53.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:53.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:53.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:53.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:48:53.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:53.627466+0000) 2019-10-23T13:48:54.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:54.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:54.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:54.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:54.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:48:54.583+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:54.585201+0000) 2019-10-23T13:48:54.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:48:54.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:54.608763+0000) 2019-10-23T13:48:54.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:48:54.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:54.625053+0000) 2019-10-23T13:48:55.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:55.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:55.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:55.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:56.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:56.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:56.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:56.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:57.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:57.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:57.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:57.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:58.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:58.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:58.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:58.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:48:59.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:48:59.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:48:59.123055+0000) 2019-10-23T13:48:59.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:59.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:48:59.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:48:59.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:00.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:00.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:00.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:00.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:01.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:01.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:01.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:01.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:02.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:02.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:02.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:02.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:02.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:49:02.608+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:02.609929+0000) 2019-10-23T13:49:03.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:03.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:03.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:03.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:03.631 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:49:03.627+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:03.627565+0000) 2019-10-23T13:49:04.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:04.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:04.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:04.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:04.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:49:04.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:04.585298+0000) 2019-10-23T13:49:04.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:49:04.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:04.608855+0000) 2019-10-23T13:49:04.629 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:49:04.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:04.625159+0000) 2019-10-23T13:49:05.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:05.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:05.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:05.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:06.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:06.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:06.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:06.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:07.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:07.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:07.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:07.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:08.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:08.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:08.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:08.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:09.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:49:09.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:09.123157+0000) 2019-10-23T13:49:09.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:09.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:09.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:09.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:10.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:10.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:10.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:10.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:11.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:11.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:11.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:11.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:12.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:12.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:12.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:12.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:12.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:49:12.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:12.610027+0000) 2019-10-23T13:49:13.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:13.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:13.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:13.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:13.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:49:13.627+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:13.627667+0000) 2019-10-23T13:49:14.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:14.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:14.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:14.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:14.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:49:14.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:14.585393+0000) 2019-10-23T13:49:14.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:49:14.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:14.608950+0000) 2019-10-23T13:49:14.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:49:14.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:14.625265+0000) 2019-10-23T13:49:15.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:15.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:15.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:15.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:16.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:16.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:16.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:16.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:17.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:17.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:17.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:17.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:18.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:18.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:18.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:18.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:19.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:49:19.121+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:19.123257+0000) 2019-10-23T13:49:19.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:19.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:19.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:19.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:20.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:20.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:20.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:20.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:21.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:21.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:21.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:21.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:22.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:22.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:22.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:22.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:22.614 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:49:22.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:22.610126+0000) 2019-10-23T13:49:23.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:23.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:23.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:23.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:23.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:49:23.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:23.627764+0000) 2019-10-23T13:49:24.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:24.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:24.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:24.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:24.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:49:24.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:24.585484+0000) 2019-10-23T13:49:24.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:49:24.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:24.609043+0000) 2019-10-23T13:49:24.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:49:24.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:24.625370+0000) 2019-10-23T13:49:25.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:25.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:25.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:25.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:26.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:26.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:26.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:26.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:27.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:27.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:27.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:27.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:28.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:28.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:28.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:28.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:29.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:49:29.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:29.123359+0000) 2019-10-23T13:49:29.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:29.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:29.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:29.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:30.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:30.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:30.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:30.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:31.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:31.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:31.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:31.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:32.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:32.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:32.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:32.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:32.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:49:32.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:32.610225+0000) 2019-10-23T13:49:33.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:33.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:33.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:33.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:33.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:49:33.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:33.627858+0000) 2019-10-23T13:49:34.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:34.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:34.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:34.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:34.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:49:34.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:34.585580+0000) 2019-10-23T13:49:34.611 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:49:34.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:34.609135+0000) 2019-10-23T13:49:34.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:49:34.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:34.625477+0000) 2019-10-23T13:49:35.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:35.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:35.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:35.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:36.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:36.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:36.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:36.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:37.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:37.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:37.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:37.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:38.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:38.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:38.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:38.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:39.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:49:39.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:39.123458+0000) 2019-10-23T13:49:39.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:39.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:39.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:39.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:40.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:40.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:40.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:40.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:41.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:41.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:41.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:41.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:42.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:42.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:42.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:42.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:42.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:49:42.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:42.610323+0000) 2019-10-23T13:49:43.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:43.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:43.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:43.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:43.630 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:49:43.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:43.627956+0000) 2019-10-23T13:49:44.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:44.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:44.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:44.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:44.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:49:44.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:44.585676+0000) 2019-10-23T13:49:44.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:49:44.607+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:44.609231+0000) 2019-10-23T13:49:44.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:49:44.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:44.625587+0000) 2019-10-23T13:49:45.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:45.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:45.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:45.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:46.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:46.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:46.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:46.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:47.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:47.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:47.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:47.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:48.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:48.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:48.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:48.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:49.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:49:49.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:49.123551+0000) 2019-10-23T13:49:49.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:49.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:49.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:49.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:50.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:50.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:50.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:50.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:51.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:51.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:51.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:51.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:52.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:52.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:52.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:52.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:52.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:49:52.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:52.610425+0000) 2019-10-23T13:49:53.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:53.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:53.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:53.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:53.631 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:49:53.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:53.628051+0000) 2019-10-23T13:49:54.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:54.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:54.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:54.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:54.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:49:54.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:54.585770+0000) 2019-10-23T13:49:54.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:49:54.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:54.609297+0000) 2019-10-23T13:49:54.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:49:54.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:54.625693+0000) 2019-10-23T13:49:55.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:55.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:55.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:55.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:56.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:56.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:56.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:56.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:57.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:57.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:57.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:57.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:58.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:58.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:58.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:58.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:49:59.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:49:59.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:49:59.123650+0000) 2019-10-23T13:49:59.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:59.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:49:59.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:49:59.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:00.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:00.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:00.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:00.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:01.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:01.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:01.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:01.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:02.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:02.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:02.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:02.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:02.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:02.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:02.610524+0000) 2019-10-23T13:50:03.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:03.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:03.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:03.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:03.631 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:03.626+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:03.628150+0000) 2019-10-23T13:50:04.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:04.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:04.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:04.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:04.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:50:04.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:04.585868+0000) 2019-10-23T13:50:04.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:50:04.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:04.609391+0000) 2019-10-23T13:50:04.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:50:04.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:04.625798+0000) 2019-10-23T13:50:05.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:05.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:05.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:05.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:06.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:06.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:06.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:06.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:07.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:07.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:07.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:07.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:08.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:08.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:08.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:08.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:09.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:50:09.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:09.123746+0000) 2019-10-23T13:50:09.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:09.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:09.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:09.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:10.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:10.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:10.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:10.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:11.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:11.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:11.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:11.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:12.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:12.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:12.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:12.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:12.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:12.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:12.610622+0000) 2019-10-23T13:50:13.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:13.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:13.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:13.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:13.631 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:13.627+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:13.628248+0000) 2019-10-23T13:50:14.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:14.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:14.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:14.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:14.588 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:50:14.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:14.585958+0000) 2019-10-23T13:50:14.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:50:14.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:14.609484+0000) 2019-10-23T13:50:14.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:50:14.624+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:14.625906+0000) 2019-10-23T13:50:15.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:15.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:15.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:15.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:16.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:16.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:16.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:16.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:17.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:17.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:17.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:17.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:18.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:18.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:18.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:18.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:19.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:19.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:19.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:19.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:19.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:50:19.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:19.123841+0000) 2019-10-23T13:50:20.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:20.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:20.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:20.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:21.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:21.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:21.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:21.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:22.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:22.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:22.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:22.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:22.615 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:22.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:22.610717+0000) 2019-10-23T13:50:23.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:23.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:23.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:23.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:23.631 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:23.628+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:23.628296+0000) 2019-10-23T13:50:23.631 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:23.628+0000 7fc3e1685700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:23.628948+0000) 2019-10-23T13:50:24.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:24.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:24.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:24.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:24.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:50:24.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:24.586052+0000) 2019-10-23T13:50:24.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:50:24.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:24.609579+0000) 2019-10-23T13:50:24.630 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:50:24.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:24.626018+0000) 2019-10-23T13:50:25.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:25.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:25.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:25.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:26.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:26.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:26.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:26.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:27.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:27.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:27.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:27.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:28.131 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:28.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:28.128480+0000) 2019-10-23T13:50:28.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:28.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:28.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:28.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:29.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:50:29.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:29.123933+0000) 2019-10-23T13:50:29.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:29.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:29.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:29.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:30.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:30.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:30.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:30.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:31.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:31.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:31.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:31.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:32.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:32.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:32.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:32.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:32.616 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:32.609+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:32.610813+0000) 2019-10-23T13:50:32.616 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:32.610+0000 7f2d2215a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:32.611449+0000) 2019-10-23T13:50:33.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:33.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:33.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:33.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:34.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:34.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:34.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:34.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:34.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:50:34.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:34.586148+0000) 2019-10-23T13:50:34.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:50:34.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:34.609671+0000) 2019-10-23T13:50:34.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:50:34.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:34.626137+0000) 2019-10-23T13:50:35.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:35.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:35.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:35.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:36.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:36.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:36.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:36.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:37.115 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:37.109+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:37.110994+0000) 2019-10-23T13:50:37.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:37.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:37.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:37.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:38.131 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:38.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:38.128582+0000) 2019-10-23T13:50:38.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:38.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:38.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:38.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:39.126 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:50:39.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:39.124031+0000) 2019-10-23T13:50:39.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:39.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:39.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:39.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:40.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:40.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:40.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:40.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:41.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:41.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:41.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:41.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:42.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:42.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:42.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:42.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:43.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:43.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:43.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:43.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:44.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:44.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:44.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:44.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:44.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:50:44.584+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:44.586249+0000) 2019-10-23T13:50:44.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:50:44.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:44.609769+0000) 2019-10-23T13:50:44.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:50:44.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:44.626247+0000) 2019-10-23T13:50:45.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:45.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:45.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:45.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:46.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:46.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:46.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:46.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:47.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:47.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:47.111093+0000) 2019-10-23T13:50:47.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:47.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:47.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:47.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:48.131 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:48.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:48.128676+0000) 2019-10-23T13:50:48.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:48.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:48.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:48.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:49.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:50:49.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:49.124127+0000) 2019-10-23T13:50:49.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:49.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:49.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:49.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:50.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:50.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:50.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:50.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:51.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:51.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:51.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:51.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:52.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:52.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:52.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:52.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:53.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:53.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:53.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:53.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:54.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:54.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:54.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:54.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:54.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:50:54.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:54.586344+0000) 2019-10-23T13:50:54.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:50:54.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:54.609867+0000) 2019-10-23T13:50:54.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:50:54.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:54.626354+0000) 2019-10-23T13:50:55.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:55.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:55.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:55.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:56.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:56.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:56.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:56.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:57.115 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:50:57.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:57.111185+0000) 2019-10-23T13:50:57.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:57.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:57.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:57.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:58.131 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:50:58.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:58.128777+0000) 2019-10-23T13:50:58.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:58.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:58.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:58.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:50:59.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:50:59.122+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:50:59.124225+0000) 2019-10-23T13:50:59.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:59.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:50:59.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:50:59.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:00.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:00.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:00.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:00.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:01.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:01.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:01.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:01.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:02.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:02.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:02.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:02.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:03.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:03.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:03.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:03.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:04.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:04.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:04.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:04.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:04.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:51:04.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:04.586443+0000) 2019-10-23T13:51:04.612 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:51:04.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:04.609964+0000) 2019-10-23T13:51:04.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:51:04.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:04.626465+0000) 2019-10-23T13:51:05.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:05.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:05.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:05.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:06.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:06.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:06.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:06.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:07.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:51:07.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:07.111281+0000) 2019-10-23T13:51:07.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:07.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:07.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:07.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:08.131 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:51:08.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:08.128873+0000) 2019-10-23T13:51:08.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:08.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:08.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:08.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:09.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:51:09.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:09.124297+0000) 2019-10-23T13:51:09.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:09.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:09.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:09.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:10.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:10.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:10.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:10.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:11.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:11.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:11.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:11.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:12.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:12.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:12.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:12.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:13.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:13.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:13.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:13.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:14.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:14.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:14.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:14.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:14.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:51:14.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:14.586542+0000) 2019-10-23T13:51:14.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:51:14.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:14.610064+0000) 2019-10-23T13:51:14.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:51:14.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:14.626573+0000) 2019-10-23T13:51:15.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:15.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:15.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:15.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:16.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:16.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:16.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:16.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:17.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:51:17.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:17.111377+0000) 2019-10-23T13:51:17.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:17.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:17.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:17.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:18.131 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:51:18.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:18.128970+0000) 2019-10-23T13:51:18.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:18.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:18.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:18.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:19.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:51:19.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:19.124392+0000) 2019-10-23T13:51:19.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:19.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:19.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:19.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:20.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:20.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:20.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:20.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:21.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:21.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:21.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:21.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:22.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:22.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:22.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:22.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:23.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:23.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:23.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:23.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:24.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:24.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:24.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:24.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:24.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:51:24.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:24.586638+0000) 2019-10-23T13:51:24.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:51:24.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:24.610160+0000) 2019-10-23T13:51:24.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:51:24.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:24.626680+0000) 2019-10-23T13:51:25.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:25.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:25.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:25.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:26.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:26.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:26.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:26.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:27.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:51:27.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:27.111473+0000) 2019-10-23T13:51:27.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:27.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:27.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:27.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:28.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:51:28.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:28.129069+0000) 2019-10-23T13:51:28.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:28.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:28.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:28.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:29.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:51:29.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:29.124489+0000) 2019-10-23T13:51:29.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:29.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:29.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:29.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:30.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:30.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:30.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:30.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:31.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:31.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:31.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:31.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:32.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:32.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:32.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:32.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:33.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:33.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:33.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:33.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:34.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:34.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:34.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:34.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:34.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:51:34.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:34.586738+0000) 2019-10-23T13:51:34.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:51:34.608+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:34.610254+0000) 2019-10-23T13:51:34.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:51:34.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:34.626786+0000) 2019-10-23T13:51:35.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:35.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:35.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:35.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:36.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:36.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:36.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:36.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:37.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:51:37.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:37.111569+0000) 2019-10-23T13:51:37.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:37.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:37.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:37.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:38.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:51:38.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:38.129160+0000) 2019-10-23T13:51:38.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:38.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:38.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:38.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:39.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:51:39.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:39.124582+0000) 2019-10-23T13:51:39.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:39.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:39.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:39.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:40.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:40.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:40.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:40.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:41.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:41.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:41.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:41.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:42.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:42.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:42.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:42.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:43.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:43.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:43.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:43.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:44.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:44.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:44.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:44.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:44.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:51:44.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:44.586839+0000) 2019-10-23T13:51:44.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:51:44.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:44.610355+0000) 2019-10-23T13:51:44.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:51:44.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:44.626894+0000) 2019-10-23T13:51:45.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:45.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:45.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:45.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:46.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:46.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:46.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:46.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:47.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:51:47.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:47.111663+0000) 2019-10-23T13:51:47.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:47.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:47.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:47.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:48.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:51:48.127+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:48.129257+0000) 2019-10-23T13:51:48.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:48.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:48.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:48.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:49.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:51:49.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:49.124679+0000) 2019-10-23T13:51:49.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:49.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:49.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:49.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:50.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:50.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:50.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:50.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:51.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:51.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:51.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:51.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:52.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:52.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:52.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:52.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:53.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:53.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:53.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:53.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:54.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:54.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:54.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:54.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:54.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:51:54.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:54.586937+0000) 2019-10-23T13:51:54.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:51:54.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:54.610453+0000) 2019-10-23T13:51:54.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:51:54.625+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:54.627002+0000) 2019-10-23T13:51:55.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:55.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:55.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:55.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:56.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:56.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:56.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:56.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:57.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:51:57.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:57.111758+0000) 2019-10-23T13:51:57.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:57.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:57.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:57.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:58.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:51:58.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:58.129357+0000) 2019-10-23T13:51:58.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:58.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:58.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:58.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:51:59.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:51:59.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:51:59.124778+0000) 2019-10-23T13:51:59.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:59.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:51:59.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:51:59.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:00.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:00.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:00.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:00.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:01.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:01.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:01.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:01.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:02.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:02.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:02.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:02.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:03.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:03.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:03.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:03.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:04.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:04.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:04.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:04.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:04.589 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:52:04.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:04.587032+0000) 2019-10-23T13:52:04.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:52:04.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:04.610548+0000) 2019-10-23T13:52:04.631 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:52:04.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:04.627111+0000) 2019-10-23T13:52:05.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:05.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:05.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:05.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:06.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:06.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:06.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:06.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:07.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:52:07.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:07.111851+0000) 2019-10-23T13:52:07.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:07.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:07.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:07.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:08.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:52:08.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:08.129450+0000) 2019-10-23T13:52:08.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:08.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:08.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:08.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:09.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:52:09.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:09.124876+0000) 2019-10-23T13:52:09.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:09.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:09.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:09.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:10.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:10.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:10.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:10.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:11.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:11.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:11.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:11.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:12.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:12.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:12.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:12.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:13.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:13.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:13.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:13.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:14.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:14.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:14.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:14.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:14.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:52:14.585+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:14.587127+0000) 2019-10-23T13:52:14.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:52:14.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:14.610646+0000) 2019-10-23T13:52:14.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:52:14.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:14.627222+0000) 2019-10-23T13:52:15.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:15.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:15.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:15.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:16.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:16.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:16.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:16.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:17.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:52:17.110+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:17.111948+0000) 2019-10-23T13:52:17.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:17.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:17.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:17.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 156 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:18.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:52:18.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:18.129549+0000) 2019-10-23T13:52:18.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:18.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:18.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:18.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:19.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:52:19.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:19.124972+0000) 2019-10-23T13:52:19.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:19.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:19.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:19.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:20.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:20.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:20.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:20.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:21.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:21.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:21.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:21.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:22.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:22.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:22.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:22.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:23.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:23.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:23.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:23.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:24.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:24.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:24.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:24.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:24.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:52:24.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:24.587225+0000) 2019-10-23T13:52:24.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:52:24.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:24.610745+0000) 2019-10-23T13:52:24.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:52:24.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:24.627328+0000) 2019-10-23T13:52:25.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:25.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:25.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:25.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:26.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:26.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:26.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:26.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:27.116 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:52:27.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:27.112046+0000) 2019-10-23T13:52:27.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:27.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:27.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:27.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:28.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:52:28.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:28.129647+0000) 2019-10-23T13:52:28.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:28.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:28.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:28.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:29.127 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:52:29.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:29.125067+0000) 2019-10-23T13:52:29.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:29.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:29.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:29.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:30.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:30.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:30.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:30.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:31.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:31.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:31.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:31.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:32.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:32.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:32.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:32.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:33.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:33.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:33.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:33.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:34.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:52:34.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:34.587318+0000) 2019-10-23T13:52:34.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:34.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:34.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:34.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:34.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:52:34.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:34.610841+0000) 2019-10-23T13:52:34.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:52:34.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:34.627439+0000) 2019-10-23T13:52:35.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:35.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:35.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:35.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:36.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:36.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:36.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:36.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:37.122 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:52:37.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:37.112142+0000) 2019-10-23T13:52:37.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:37.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:37.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:37.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:38.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:52:38.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:38.129747+0000) 2019-10-23T13:52:38.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:38.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:38.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:38.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:39.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:52:39.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:39.125165+0000) 2019-10-23T13:52:39.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:39.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:39.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:39.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:40.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:40.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:40.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:40.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:41.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:41.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:41.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:41.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:42.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:42.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:42.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:42.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:43.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:43.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:43.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:43.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:44.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:52:44.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:44.587416+0000) 2019-10-23T13:52:44.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:52:44.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:44.610940+0000) 2019-10-23T13:52:44.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:52:44.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:44.627548+0000) 2019-10-23T13:52:44.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:44.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:44.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:44.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:45.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:45.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:45.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:46.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:46.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:46.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:46.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:47.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:52:47.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:47.112241+0000) 2019-10-23T13:52:47.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:47.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:47.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:47.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:48.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:52:48.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:48.129849+0000) 2019-10-23T13:52:48.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:48.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:48.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:48.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:49.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:52:49.123+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:49.125262+0000) 2019-10-23T13:52:49.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:49.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:49.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:49.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:50.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:50.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:50.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:50.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:51.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:51.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:51.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:51.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:52.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:52.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:52.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:52.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:53.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:53.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:53.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:53.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:54.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:52:54.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:54.587512+0000) 2019-10-23T13:52:54.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:52:54.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:54.611040+0000) 2019-10-23T13:52:54.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:52:54.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:54.627653+0000) 2019-10-23T13:52:54.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:54.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:54.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:54.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:55.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:55.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:55.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:55.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:56.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:56.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:56.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:56.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:57.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:52:57.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:57.112338+0000) 2019-10-23T13:52:57.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:57.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:57.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:57.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:58.132 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:52:58.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:58.129946+0000) 2019-10-23T13:52:58.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:58.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:58.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:58.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:52:59.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:52:59.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:52:59.125359+0000) 2019-10-23T13:52:59.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:59.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:52:59.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:52:59.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:00.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:00.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:00.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:00.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:01.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:01.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:01.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:01.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:02.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:02.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:02.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:02.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:03.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:03.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:03.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:03.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:04.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:53:04.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:04.587610+0000) 2019-10-23T13:53:04.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:53:04.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:04.611137+0000) 2019-10-23T13:53:04.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:53:04.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:04.627758+0000) 2019-10-23T13:53:04.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:04.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:04.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:04.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:05.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:05.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:05.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:05.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:06.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:06.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:06.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:06.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:07.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:53:07.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:07.112434+0000) 2019-10-23T13:53:07.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:07.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:07.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:07.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:08.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:53:08.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:08.130070+0000) 2019-10-23T13:53:08.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:08.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:08.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:08.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:09.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:53:09.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:09.125457+0000) 2019-10-23T13:53:10.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:10.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:10.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:10.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:11.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:11.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:11.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:11.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:12.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:12.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:12.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:12.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:13.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:13.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:13.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:13.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:14.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:14.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:14.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:14.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:14.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:53:14.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:14.587711+0000) 2019-10-23T13:53:14.613 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:53:14.609+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:14.611237+0000) 2019-10-23T13:53:14.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:53:14.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:14.627865+0000) 2019-10-23T13:53:15.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:15.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:15.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:15.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:16.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:16.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:16.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:16.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:17.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:17.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:17.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:17.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:17.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:53:17.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:17.112532+0000) 2019-10-23T13:53:18.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:18.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:18.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:18.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:18.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:53:18.128+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:18.130215+0000) 2019-10-23T13:53:19.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:19.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:19.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:19.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:19.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:53:19.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:19.125553+0000) 2019-10-23T13:53:20.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:20.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:20.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:20.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:21.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:21.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:21.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:21.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:22.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:22.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:22.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:22.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:23.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:23.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:23.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:23.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:24.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:24.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:24.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:24.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:24.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:53:24.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:24.587805+0000) 2019-10-23T13:53:24.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:53:24.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:24.611298+0000) 2019-10-23T13:53:24.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:53:24.626+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:24.627971+0000) 2019-10-23T13:53:25.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:25.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:25.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:25.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:26.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:26.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:26.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:26.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:27.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:27.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:27.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:27.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:27.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:53:27.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:27.112627+0000) 2019-10-23T13:53:28.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:28.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:28.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:28.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:28.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:53:28.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:28.130312+0000) 2019-10-23T13:53:29.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:29.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:29.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:29.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:29.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:53:29.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:29.125653+0000) 2019-10-23T13:53:30.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:30.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:30.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:30.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:31.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:31.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:31.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:31.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:32.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:32.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:32.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:32.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:33.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:33.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:33.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:33.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:34.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:34.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:34.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:34.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:34.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:53:34.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:34.587905+0000) 2019-10-23T13:53:34.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:53:34.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:34.611394+0000) 2019-10-23T13:53:34.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:53:34.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:34.628076+0000) 2019-10-23T13:53:35.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:35.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:35.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:35.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:36.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:35.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:36.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:36.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:37.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:37.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:37.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:37.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:37.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:53:37.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:37.112719+0000) 2019-10-23T13:53:38.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:38.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:38.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:38.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:38.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:53:38.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:38.130409+0000) 2019-10-23T13:53:39.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:39.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:39.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:39.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:39.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:53:39.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:39.125750+0000) 2019-10-23T13:53:39.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:39.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:39.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:39.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:40.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:40.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:40.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:40.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:41.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:41.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:41.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:41.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:43.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:43.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:43.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:43.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:43.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:43.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:43.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:43.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:44.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:53:44.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:44.588004+0000) 2019-10-23T13:53:44.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:53:44.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:44.611493+0000) 2019-10-23T13:53:44.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:53:44.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:44.628183+0000) 2019-10-23T13:53:44.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:44.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:44.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:44.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:45.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:45.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:45.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:45.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:46.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:46.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:46.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:46.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:47.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:53:47.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:47.112814+0000) 2019-10-23T13:53:48.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:48.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:48.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:48.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:48.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:53:48.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:48.130507+0000) 2019-10-23T13:53:49.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:49.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:49.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:49.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:49.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:53:49.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:49.125845+0000) 2019-10-23T13:53:49.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:49.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:49.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:49.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:51.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:51.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:51.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:51.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:52.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:52.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:52.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:52.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:52.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:52.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:52.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:52.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:53.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:53.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:54.590 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:53:54.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:54.588097+0000) 2019-10-23T13:53:54.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:53:54.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:54.611591+0000) 2019-10-23T13:53:54.632 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:53:54.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:54.628286+0000) 2019-10-23T13:53:54.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:54.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:54.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:54.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:55.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:55.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:55.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:55.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:56.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:56.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:56.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:56.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:57.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:53:57.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:57.112909+0000) 2019-10-23T13:53:57.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:57.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:57.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:57.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:58.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:53:58.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:58.130606+0000) 2019-10-23T13:53:58.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:58.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:58.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:58.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:53:59.128 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:53:59.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:53:59.125940+0000) 2019-10-23T13:53:59.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:59.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:53:59.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:53:59.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:00.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:00.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:00.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:00.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:01.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:01.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:01.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:01.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:02.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:02.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:02.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:02.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:03.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:03.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:03.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:03.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:04.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:54:04.586+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:04.588196+0000) 2019-10-23T13:54:04.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:54:04.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:04.611685+0000) 2019-10-23T13:54:04.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:54:04.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:04.628392+0000) 2019-10-23T13:54:04.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:04.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:04.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:04.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:05.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:05.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:05.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:05.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:06.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:06.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:06.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:06.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:07.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:54:07.111+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:07.113008+0000) 2019-10-23T13:54:07.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:07.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:07.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:07.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:08.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:54:08.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:08.130704+0000) 2019-10-23T13:54:08.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:08.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:08.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:08.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:09.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:54:09.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:09.126038+0000) 2019-10-23T13:54:10.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:10.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:10.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:10.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:11.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:11.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:11.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:11.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:12.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:12.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:12.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:12.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:13.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:13.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:13.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:13.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:14.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:14.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:14.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:14.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:14.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:54:14.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:14.588296+0000) 2019-10-23T13:54:14.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:54:14.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:14.611780+0000) 2019-10-23T13:54:14.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:54:14.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:14.628502+0000) 2019-10-23T13:54:15.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:15.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:15.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:15.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:16.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:16.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:16.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:16.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:17.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:17.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:17.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:17.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:17.117 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:54:17.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:17.113110+0000) 2019-10-23T13:54:17.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:17.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:17.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:17.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:18.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:54:18.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:18.130801+0000) 2019-10-23T13:54:18.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:18.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:18.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:18.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:19.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:54:19.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:19.126132+0000) 2019-10-23T13:54:20.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:20.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:20.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:20.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:21.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:21.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:21.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:21.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:22.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:22.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:22.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:22.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:23.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:23.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:23.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:23.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:24.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:24.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:24.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:24.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:24.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:54:24.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:24.588390+0000) 2019-10-23T13:54:24.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:54:24.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:24.611879+0000) 2019-10-23T13:54:24.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:54:24.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:24.628609+0000) 2019-10-23T13:54:24.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:24.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:24.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:24.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:25.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:25.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:25.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:25.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:26.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:26.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:26.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:26.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:27.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:54:27.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:27.113207+0000) 2019-10-23T13:54:27.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:27.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:27.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:27.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:28.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:54:28.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:28.130896+0000) 2019-10-23T13:54:28.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:28.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:28.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:28.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:29.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:54:29.124+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:29.126224+0000) 2019-10-23T13:54:29.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:29.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:29.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:29.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:30.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:30.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:30.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:30.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:31.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:31.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:31.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:31.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:32.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:32.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:32.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:32.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:33.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:33.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:33.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:33.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:34.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:54:34.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:34.588482+0000) 2019-10-23T13:54:34.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:54:34.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:34.611973+0000) 2019-10-23T13:54:34.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:54:34.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:34.628719+0000) 2019-10-23T13:54:34.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:34.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:34.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:34.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:36.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:36.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:36.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:36.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:37.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:37.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:37.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:37.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:37.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:54:37.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:37.113299+0000) 2019-10-23T13:54:37.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:37.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:37.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:37.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:38.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:54:38.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:38.130994+0000) 2019-10-23T13:54:39.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:39.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:39.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:39.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:39.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:54:39.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:39.126296+0000) 2019-10-23T13:54:40.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:40.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:40.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:40.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:41.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:41.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:41.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:41.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:42.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:42.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:42.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:42.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:43.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:43.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:43.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:43.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:44.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:44.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:44.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:44.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:44.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:54:44.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:44.588582+0000) 2019-10-23T13:54:44.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:54:44.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:44.612069+0000) 2019-10-23T13:54:44.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:54:44.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:44.628828+0000) 2019-10-23T13:54:44.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:44.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:44.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:44.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:45.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:45.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:45.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:45.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:46.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:46.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:46.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:46.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:47.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:54:47.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:47.113396+0000) 2019-10-23T13:54:47.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:47.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:47.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:47.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:48.133 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:54:48.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:48.131091+0000) 2019-10-23T13:54:48.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:48.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:48.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:48.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:49.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:54:49.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:49.126389+0000) 2019-10-23T13:54:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:49.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:49.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:49.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:50.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:50.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:50.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:50.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:51.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:51.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:51.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:51.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:52.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:52.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:52.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:52.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:53.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:53.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:53.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:53.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:54.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:54:54.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:54.588676+0000) 2019-10-23T13:54:54.614 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:54:54.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:54.612166+0000) 2019-10-23T13:54:54.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:54:54.627+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:54.628939+0000) 2019-10-23T13:54:54.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:54.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:54.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:54.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:55.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:55.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:55.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:55.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:56.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:56.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:56.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:56.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:57.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:54:57.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:57.113489+0000) 2019-10-23T13:54:57.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:57.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:57.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:57.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:58.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:54:58.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:58.131155+0000) 2019-10-23T13:54:58.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:58.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:58.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:58.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:54:59.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:54:59.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:54:59.126481+0000) 2019-10-23T13:54:59.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:59.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:54:59.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:54:59.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:00.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:00.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:00.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:00.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:01.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:01.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:01.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:01.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:02.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:02.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:02.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:02.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:03.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:03.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:03.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:03.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:04.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:55:04.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:04.588776+0000) 2019-10-23T13:55:04.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:55:04.610+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:04.612267+0000) 2019-10-23T13:55:04.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:55:04.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:04.629053+0000) 2019-10-23T13:55:04.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:04.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:04.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:04.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:05.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:05.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:05.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:05.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:06.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:06.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:06.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:06.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:07.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:55:07.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:07.113589+0000) 2019-10-23T13:55:07.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:07.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:07.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:07.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:08.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:55:08.129+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:08.131250+0000) 2019-10-23T13:55:08.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:08.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:08.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:08.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:09.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:55:09.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:09.126575+0000) 2019-10-23T13:55:09.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:09.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:09.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:09.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:10.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:10.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:10.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:10.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:11.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:11.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:11.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:11.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:12.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:12.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:12.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:12.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:13.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:13.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:13.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:13.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:14.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:55:14.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:14.588870+0000) 2019-10-23T13:55:14.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:55:14.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:14.612364+0000) 2019-10-23T13:55:14.633 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:55:14.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:14.629165+0000) 2019-10-23T13:55:14.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:14.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:14.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:14.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:15.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:15.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:15.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:15.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:16.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:16.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:16.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:16.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:17.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:55:17.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:17.113690+0000) 2019-10-23T13:55:17.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:17.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:17.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:17.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:18.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:55:18.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:18.131298+0000) 2019-10-23T13:55:18.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:18.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:18.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:18.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:19.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:55:19.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:19.126673+0000) 2019-10-23T13:55:19.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:19.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:19.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:19.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:20.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:20.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:20.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:20.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:21.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:21.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:21.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:21.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:22.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:22.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:22.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:22.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:23.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:23.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:23.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:23.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:24.591 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:55:24.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:24.588961+0000) 2019-10-23T13:55:24.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:55:24.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:24.612458+0000) 2019-10-23T13:55:24.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:55:24.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:24.629275+0000) 2019-10-23T13:55:24.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:24.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:24.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:24.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:25.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:25.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:25.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:25.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:26.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:26.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:26.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:26.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:27.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:55:27.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:27.113789+0000) 2019-10-23T13:55:27.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:27.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:27.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:27.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:28.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:55:28.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:28.131430+0000) 2019-10-23T13:55:28.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:28.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:28.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:28.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:29.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:55:29.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:29.126808+0000) 2019-10-23T13:55:29.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:29.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:29.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:29.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:30.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:30.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:30.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:30.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:31.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:31.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:31.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:31.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:32.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:32.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:32.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:32.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:33.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:33.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:33.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:33.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:34.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:55:34.587+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:34.589064+0000) 2019-10-23T13:55:34.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:55:34.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:34.612552+0000) 2019-10-23T13:55:34.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:55:34.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:34.629385+0000) 2019-10-23T13:55:34.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:34.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:34.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:34.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:35.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:35.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:35.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:35.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:36.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:36.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:36.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:36.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:37.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:55:37.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:37.113888+0000) 2019-10-23T13:55:37.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:37.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:37.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:37.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:38.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:55:38.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:38.131567+0000) 2019-10-23T13:55:38.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:38.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:38.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:38.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:39.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:55:39.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:39.126938+0000) 2019-10-23T13:55:39.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:39.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:39.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:39.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:40.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:40.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:40.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:40.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:41.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:41.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:41.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:41.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:42.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:42.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:42.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:42.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:43.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:43.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:43.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:43.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:44.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:55:44.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:44.589160+0000) 2019-10-23T13:55:44.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:55:44.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:44.612644+0000) 2019-10-23T13:55:44.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:55:44.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:44.629496+0000) 2019-10-23T13:55:44.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:44.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:44.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:44.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:45.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:45.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:45.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:45.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:46.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:46.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:46.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:46.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:47.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:55:47.112+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:47.113982+0000) 2019-10-23T13:55:47.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:47.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:47.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:47.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:48.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:55:48.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:48.131662+0000) 2019-10-23T13:55:48.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:48.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:48.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:48.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:49.129 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:55:49.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:49.127028+0000) 2019-10-23T13:55:49.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:49.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:49.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:49.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:50.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:50.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:50.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:50.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:51.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:51.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:51.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:51.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:52.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:52.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:52.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:52.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:53.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:53.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:53.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:53.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:54.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:55:54.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:54.589258+0000) 2019-10-23T13:55:54.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:55:54.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:54.612739+0000) 2019-10-23T13:55:54.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:55:54.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:54.629607+0000) 2019-10-23T13:55:54.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:54.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:54.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:54.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:55.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:55.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:55.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:55.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:56.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:56.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:56.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:56.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:57.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:55:57.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:57.114080+0000) 2019-10-23T13:55:57.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:57.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:57.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:57.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:58.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:55:58.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:58.131756+0000) 2019-10-23T13:55:58.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:58.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:58.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:58.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:55:59.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:55:59.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:55:59.127122+0000) 2019-10-23T13:55:59.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:59.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:55:59.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:55:59.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:00.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:00.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:00.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:00.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:01.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:01.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:01.931 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:01.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:02.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:02.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:02.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:02.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:03.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:03.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:03.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:03.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:04.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:56:04.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:04.589360+0000) 2019-10-23T13:56:04.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:56:04.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:04.612828+0000) 2019-10-23T13:56:04.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:56:04.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:04.629713+0000) 2019-10-23T13:56:04.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:04.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:04.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:04.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:05.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:05.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:05.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:05.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:06.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:06.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:06.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:06.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:07.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:56:07.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:07.114175+0000) 2019-10-23T13:56:08.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:08.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:08.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:08.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:08.134 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:56:08.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:08.131854+0000) 2019-10-23T13:56:09.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:09.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:09.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:09.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:09.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:56:09.125+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:09.127216+0000) 2019-10-23T13:56:10.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:10.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:10.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:10.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:11.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:11.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:11.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:11.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:12.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:12.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:13.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:13.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:13.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:13.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:14.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:14.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:14.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:14.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:14.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:56:14.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:14.589463+0000) 2019-10-23T13:56:14.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:56:14.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:14.612921+0000) 2019-10-23T13:56:14.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:56:14.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:14.629818+0000) 2019-10-23T13:56:15.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:15.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:15.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:15.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:16.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:16.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:16.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:16.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:17.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:17.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:17.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:17.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:17.118 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:56:17.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:17.114274+0000) 2019-10-23T13:56:18.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:56:18.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:18.131947+0000) 2019-10-23T13:56:18.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:18.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:18.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:18.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:19.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:56:19.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:19.127298+0000) 2019-10-23T13:56:19.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:19.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:19.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:19.195+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:20.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:20.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:20.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:20.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:21.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:21.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:21.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:21.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:22.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:22.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:22.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:22.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:23.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:23.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:23.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:23.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:24.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:24.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:24.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:24.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:24.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:56:24.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:24.589560+0000) 2019-10-23T13:56:24.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:56:24.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:24.613010+0000) 2019-10-23T13:56:24.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:56:24.628+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:24.629922+0000) 2019-10-23T13:56:25.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:25.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:25.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:25.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:26.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:26.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:26.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:26.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:27.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:56:27.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:27.114373+0000) 2019-10-23T13:56:27.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:27.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:27.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:27.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:28.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:56:28.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:28.132042+0000) 2019-10-23T13:56:28.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:28.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:28.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:28.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:29.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:56:29.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:29.127389+0000) 2019-10-23T13:56:29.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:29.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:29.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:29.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:30.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:30.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:30.212 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:30.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:31.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:31.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:31.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:31.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:32.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:32.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:32.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:32.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:33.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:33.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:33.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:33.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:34.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:34.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:34.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:34.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:34.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:56:34.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:34.589658+0000) 2019-10-23T13:56:34.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:56:34.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:34.613107+0000) 2019-10-23T13:56:34.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:56:34.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:34.630032+0000) 2019-10-23T13:56:35.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:35.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:35.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:35.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:36.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:36.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:36.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:36.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:37.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:56:37.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:37.114472+0000) 2019-10-23T13:56:37.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:37.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:37.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:37.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:38.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:56:38.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:38.132139+0000) 2019-10-23T13:56:38.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:38.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:38.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:38.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:39.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:56:39.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:39.127483+0000) 2019-10-23T13:56:39.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:39.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:39.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:39.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:40.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:40.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:40.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:40.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:41.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:41.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:41.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:41.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:42.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:42.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:42.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:42.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:43.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:43.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:43.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:43.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:44.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:44.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:44.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:44.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:44.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:56:44.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:44.589756+0000) 2019-10-23T13:56:44.615 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:56:44.611+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:44.613206+0000) 2019-10-23T13:56:44.634 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:56:44.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:44.630145+0000) 2019-10-23T13:56:45.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:45.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:45.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:45.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:46.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:46.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:46.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:46.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:47.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:56:47.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:47.114570+0000) 2019-10-23T13:56:47.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:47.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:47.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:47.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:48.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:56:48.130+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:48.132238+0000) 2019-10-23T13:56:48.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:48.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:48.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:48.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:49.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:56:49.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:49.127581+0000) 2019-10-23T13:56:49.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:49.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:46:16.633289+0000 (oldest deadline 2019-10-23T13:46:36.633289+0000) 2019-10-23T13:56:49.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:49.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:50.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:50.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:51.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:51.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:52.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:52.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:53.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:53.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:54.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:54.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:54.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:56:54.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:54.589857+0000) 2019-10-23T13:56:54.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:56:54.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:54.613301+0000) 2019-10-23T13:56:54.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:56:54.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:54.630328+0000) 2019-10-23T13:56:55.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:55.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:56.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:56.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:57.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:56:57.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:57.114665+0000) 2019-10-23T13:56:57.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:57.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:58.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:56:58.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:58.132334+0000) 2019-10-23T13:56:58.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:58.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:56:59.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:56:59.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:56:59.127675+0000) 2019-10-23T13:56:59.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:56:59.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:00.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:00.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:01.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:01.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:02.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:02.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:03.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:03.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:04.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:04.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:04.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:57:04.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:04.589969+0000) 2019-10-23T13:57:04.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:57:04.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:04.613403+0000) 2019-10-23T13:57:04.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:57:04.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:04.630463+0000) 2019-10-23T13:57:05.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:05.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:06.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:06.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:07.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:07.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:07.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:57:07.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:07.114760+0000) 2019-10-23T13:57:08.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:08.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:08.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:57:08.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:08.132428+0000) 2019-10-23T13:57:09.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:09.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:09.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:57:09.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:09.127769+0000) 2019-10-23T13:57:10.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:10.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:11.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:11.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:12.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:12.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:13.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:13.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:14.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:14.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:14.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:14.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:14.592 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:57:14.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:14.590068+0000) 2019-10-23T13:57:14.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:57:14.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:14.613503+0000) 2019-10-23T13:57:14.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:57:14.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:14.630575+0000) 2019-10-23T13:57:15.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:15.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:15.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:15.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:16.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:16.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:16.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:16.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:17.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:57:17.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:17.114854+0000) 2019-10-23T13:57:17.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:17.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:17.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:17.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:18.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:57:18.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:18.132525+0000) 2019-10-23T13:57:18.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:18.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:18.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:18.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:19.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:57:19.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:19.127860+0000) 2019-10-23T13:57:19.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:19.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:19.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:19.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:20.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:20.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:20.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:20.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:21.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:21.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:21.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:21.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:22.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:22.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:22.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:22.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:23.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:23.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:23.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:23.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:24.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:24.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:24.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:24.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:24.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:57:24.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:24.590164+0000) 2019-10-23T13:57:24.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:57:24.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:24.613600+0000) 2019-10-23T13:57:24.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:57:24.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:24.630683+0000) 2019-10-23T13:57:25.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:25.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:25.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:25.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:26.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:26.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:26.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:26.263+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:27.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:57:27.113+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:27.114950+0000) 2019-10-23T13:57:27.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:27.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:27.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:27.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:28.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:57:28.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:28.132624+0000) 2019-10-23T13:57:28.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:28.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:28.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:28.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:29.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:57:29.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:29.127953+0000) 2019-10-23T13:57:29.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:29.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:29.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:29.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:30.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:30.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:30.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:30.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:31.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:31.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:31.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:31.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:32.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:32.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:32.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:32.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:33.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:33.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:33.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:33.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:34.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:34.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:34.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:34.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:34.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:57:34.588+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:34.590262+0000) 2019-10-23T13:57:34.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:57:34.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:34.613700+0000) 2019-10-23T13:57:34.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:57:34.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:34.630788+0000) 2019-10-23T13:57:35.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:35.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:35.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:35.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:36.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:36.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:36.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:36.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:37.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:57:37.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:37.115044+0000) 2019-10-23T13:57:37.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:37.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:37.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:37.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:38.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:38.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:38.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:38.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:38.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:57:38.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:38.132719+0000) 2019-10-23T13:57:39.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:39.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:39.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:39.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:39.130 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:57:39.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:39.128047+0000) 2019-10-23T13:57:40.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:40.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:40.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:40.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:41.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:41.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:41.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:41.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:41.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:41.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:41.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:41.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:42.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:42.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:42.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:42.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:44.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:44.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:44.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:44.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:44.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:57:44.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:44.590359+0000) 2019-10-23T13:57:44.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:57:44.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:44.613794+0000) 2019-10-23T13:57:44.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:57:44.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:44.630899+0000) 2019-10-23T13:57:45.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:45.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:45.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:45.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:46.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:46.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:46.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:46.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:47.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:47.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:47.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:47.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:47.119 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:57:47.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:47.115141+0000) 2019-10-23T13:57:48.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:48.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:48.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:48.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:48.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:57:48.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:48.132814+0000) 2019-10-23T13:57:49.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:49.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:49.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:49.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:49.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:57:49.126+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:49.128146+0000) 2019-10-23T13:57:50.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:50.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:50.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:50.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:51.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:51.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:51.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:51.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:52.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:52.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:52.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:52.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:53.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:53.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:53.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:53.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:54.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:54.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:54.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:54.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:54.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:57:54.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:54.590455+0000) 2019-10-23T13:57:54.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:57:54.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:54.613890+0000) 2019-10-23T13:57:54.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:57:54.629+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:54.631007+0000) 2019-10-23T13:57:55.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:55.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:55.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:55.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:56.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:56.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:56.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:56.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:57.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:57.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:57.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:57.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:57.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:57:57.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:57.115239+0000) 2019-10-23T13:57:58.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:58.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:58.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:58.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:58.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:57:58.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:58.132907+0000) 2019-10-23T13:57:59.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:59.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:57:59.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:57:59.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:57:59.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:57:59.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:57:59.128239+0000) 2019-10-23T13:58:00.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:00.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:00.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:00.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:00.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:00.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:00.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:00.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:02.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:01.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:02.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:01.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:03.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:03.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:03.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:03.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:04.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:04.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:04.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:04.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:04.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:58:04.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:04.590555+0000) 2019-10-23T13:58:04.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:58:04.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:04.613983+0000) 2019-10-23T13:58:04.635 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:58:04.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:04.631123+0000) 2019-10-23T13:58:05.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:05.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:05.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:05.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:06.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:06.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:06.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:06.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:07.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:58:07.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:07.115333+0000) 2019-10-23T13:58:07.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:07.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:07.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:07.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:08.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:08.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:08.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:08.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:08.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:58:08.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:08.133004+0000) 2019-10-23T13:58:09.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:58:09.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:09.128334+0000) 2019-10-23T13:58:09.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:09.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:09.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:09.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:10.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:10.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:10.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:10.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:11.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:11.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:11.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:11.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:12.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:12.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:12.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:12.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:13.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:13.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:13.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:13.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:14.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:14.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:14.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:14.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:14.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:58:14.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:14.590655+0000) 2019-10-23T13:58:14.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:58:14.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:14.614083+0000) 2019-10-23T13:58:14.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:58:14.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:14.631230+0000) 2019-10-23T13:58:15.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:15.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:15.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:15.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:16.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:16.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:16.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:16.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:17.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:17.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:17.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:17.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:17.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:58:17.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:17.115429+0000) 2019-10-23T13:58:18.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:18.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:18.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:18.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:18.135 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:58:18.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:18.133102+0000) 2019-10-23T13:58:19.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:58:19.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:19.128431+0000) 2019-10-23T13:58:19.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:19.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:19.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:19.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:20.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:20.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:20.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:20.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:21.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:21.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:21.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:21.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:22.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:22.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:22.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:22.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:23.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:23.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:23.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:23.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:24.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:24.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:24.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:24.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:24.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:58:24.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:24.590752+0000) 2019-10-23T13:58:24.616 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:58:24.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:24.614173+0000) 2019-10-23T13:58:24.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:58:24.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:24.631334+0000) 2019-10-23T13:58:25.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:25.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:25.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:25.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:26.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:26.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:26.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:26.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:27.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:58:27.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:27.115528+0000) 2019-10-23T13:58:27.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:27.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:27.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:27.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:28.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:58:28.131+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:28.133196+0000) 2019-10-23T13:58:28.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:28.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:28.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:28.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:29.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:58:29.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:29.128528+0000) 2019-10-23T13:58:29.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:29.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:29.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:29.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:30.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:30.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:30.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:30.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:31.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:31.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:31.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:31.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:32.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:32.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:32.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:32.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:33.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:33.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:33.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:33.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:34.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:34.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:34.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:34.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:34.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:58:34.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:34.590845+0000) 2019-10-23T13:58:34.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:58:34.612+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:34.614269+0000) 2019-10-23T13:58:34.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:58:34.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:34.631443+0000) 2019-10-23T13:58:35.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:35.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:35.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:35.130+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:36.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:36.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:36.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:36.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:37.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:58:37.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:37.115621+0000) 2019-10-23T13:58:37.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:37.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:37.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:37.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:38.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:58:38.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:38.133290+0000) 2019-10-23T13:58:38.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:38.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:38.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:38.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:39.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:58:39.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:39.128624+0000) 2019-10-23T13:58:39.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:39.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:39.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:39.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:40.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:40.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:40.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:40.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:41.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:41.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:41.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:41.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:42.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:42.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:42.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:42.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:43.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:43.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:43.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:43.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:44.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:44.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:44.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:44.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:44.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:58:44.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:44.590943+0000) 2019-10-23T13:58:44.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:58:44.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:44.614363+0000) 2019-10-23T13:58:44.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:58:44.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:44.631549+0000) 2019-10-23T13:58:45.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:45.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:45.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:45.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:46.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:46.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:46.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:46.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:47.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:58:47.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:47.115714+0000) 2019-10-23T13:58:47.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:47.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:47.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:47.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:48.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:58:48.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:48.133381+0000) 2019-10-23T13:58:48.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:48.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:48.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:48.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:49.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:58:49.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:49.128723+0000) 2019-10-23T13:58:49.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:49.193+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:49.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:49.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:50.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:50.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:50.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:50.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:51.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:51.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:51.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:51.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:52.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:52.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:52.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:52.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:53.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:53.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:53.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:53.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:54.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:54.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:54.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:54.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:54.593 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:58:54.589+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:54.591044+0000) 2019-10-23T13:58:54.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:58:54.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:54.614456+0000) 2019-10-23T13:58:54.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:58:54.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:54.631652+0000) 2019-10-23T13:58:55.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:55.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:55.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:55.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:56.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:56.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:56.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:56.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:57.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:58:57.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:57.115810+0000) 2019-10-23T13:58:57.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:57.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:57.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:57.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:58.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:58:58.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:58.133482+0000) 2019-10-23T13:58:58.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:58.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:58.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:58.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:58:59.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:58:59.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:58:59.128818+0000) 2019-10-23T13:58:59.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:59.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:58:59.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:58:59.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:00.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:00.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:00.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:00.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:01.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:01.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:01.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:01.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:02.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:02.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:02.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:02.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:03.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:03.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:03.267 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:03.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:04.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:04.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:04.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:04.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:04.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:59:04.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:04.591144+0000) 2019-10-23T13:59:04.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:59:04.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:04.614551+0000) 2019-10-23T13:59:04.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:59:04.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:04.631761+0000) 2019-10-23T13:59:05.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:05.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:05.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:05.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:06.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:06.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:06.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:06.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:07.120 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:07.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:07.115905+0000) 2019-10-23T13:59:07.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:07.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:07.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:07.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:08.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:59:08.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:08.133576+0000) 2019-10-23T13:59:08.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:08.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:08.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:08.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:09.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:59:09.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:09.128913+0000) 2019-10-23T13:59:09.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:09.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:09.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:09.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:10.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:10.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:10.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:10.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:11.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:11.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:11.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:11.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:12.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:12.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:12.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:12.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:13.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:13.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:13.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:13.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:14.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:14.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:14.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:14.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:14.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:59:14.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:14.591242+0000) 2019-10-23T13:59:14.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:59:14.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:14.614643+0000) 2019-10-23T13:59:14.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:59:14.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:14.631874+0000) 2019-10-23T13:59:15.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:15.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:15.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:15.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:16.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:16.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:16.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:16.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:17.125 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:17.114+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:17.115999+0000) 2019-10-23T13:59:17.125 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:17.115+0000 7f2d2215a700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:17.116633+0000) 2019-10-23T13:59:17.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:17.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:17.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:17.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:18.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:59:18.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:18.133673+0000) 2019-10-23T13:59:18.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:18.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:18.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:18.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:19.131 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:59:19.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:19.129008+0000) 2019-10-23T13:59:19.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:19.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:19.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:19.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:20.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:20.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:20.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:20.407+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:21.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:21.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:21.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:21.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:21.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:21.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:21.616194+0000) 2019-10-23T13:59:22.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:22.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:22.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:22.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:23.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:23.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:23.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:23.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:24.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:24.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:24.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:24.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:24.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:59:24.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:24.591343+0000) 2019-10-23T13:59:24.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:59:24.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:24.614739+0000) 2019-10-23T13:59:24.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:59:24.630+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:24.631980+0000) 2019-10-23T13:59:25.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:25.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:25.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:25.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:26.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:26.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:26.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:26.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:27.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:27.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:27.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:27.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:28.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:59:28.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:28.133765+0000) 2019-10-23T13:59:28.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:28.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:28.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:28.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:29.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:59:29.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:29.129104+0000) 2019-10-23T13:59:29.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:29.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:29.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:29.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:30.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:30.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:30.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:30.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:31.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:31.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:31.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:31.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:31.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:31.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:31.616290+0000) 2019-10-23T13:59:32.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:32.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:32.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:32.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:33.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:33.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:33.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:33.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:34.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:34.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:34.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:34.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:34.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:59:34.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:34.591437+0000) 2019-10-23T13:59:34.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:59:34.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:34.614834+0000) 2019-10-23T13:59:34.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:59:34.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:34.632086+0000) 2019-10-23T13:59:35.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:35.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:35.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:35.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:36.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:36.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:36.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:36.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:37.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:37.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:37.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:37.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:38.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:59:38.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:38.133859+0000) 2019-10-23T13:59:38.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:38.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:38.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:38.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:39.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:59:39.127+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:39.129195+0000) 2019-10-23T13:59:39.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:39.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:39.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:39.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:40.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:40.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:40.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:40.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:41.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:41.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:41.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:41.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:41.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:41.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:41.616391+0000) 2019-10-23T13:59:42.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:42.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:42.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:42.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:43.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:43.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:43.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:43.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:44.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:44.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:44.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:44.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:44.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:59:44.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:44.591534+0000) 2019-10-23T13:59:44.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:59:44.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:44.614928+0000) 2019-10-23T13:59:44.636 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:59:44.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:44.632193+0000) 2019-10-23T13:59:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:45.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:45.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:45.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:46.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:46.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:46.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:46.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:47.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:47.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:47.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:47.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:48.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:59:48.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:48.133957+0000) 2019-10-23T13:59:48.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:48.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:48.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:48.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:49.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:59:49.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:49.129294+0000) 2019-10-23T13:59:49.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:49.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:49.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:49.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:50.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:50.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:50.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:50.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:51.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:51.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:51.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:51.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:51.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T13:59:51.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:51.616485+0000) 2019-10-23T13:59:52.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:52.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:52.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:52.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:53.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:53.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:53.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:53.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:54.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:54.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:54.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:54.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:54.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T13:59:54.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:54.591634+0000) 2019-10-23T13:59:54.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T13:59:54.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:54.615021+0000) 2019-10-23T13:59:54.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T13:59:54.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:54.632300+0000) 2019-10-23T13:59:55.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:55.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:55.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:55.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:56.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:56.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:56.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:56.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:57.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:57.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:57.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:57.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:58.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T13:59:58.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:58.134054+0000) 2019-10-23T13:59:58.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:58.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:58.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:58.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T13:59:59.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T13:59:59.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T12:59:59.129391+0000) 2019-10-23T13:59:59.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:59.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T13:59:59.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T13:59:59.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:00.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:00.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:00.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:00.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:01.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:01.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:01.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:01.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:01.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:00:01.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:01.616584+0000) 2019-10-23T14:00:02.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:02.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:02.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:02.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:03.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:03.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:03.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:03.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:04.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:04.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:04.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:04.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:04.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:00:04.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:04.591731+0000) 2019-10-23T14:00:04.617 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:00:04.613+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:04.615114+0000) 2019-10-23T14:00:04.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:00:04.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:04.632407+0000) 2019-10-23T14:00:05.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:05.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:05.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:05.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:06.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:06.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:06.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:06.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:07.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:07.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:07.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:07.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:08.136 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:00:08.132+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:08.134148+0000) 2019-10-23T14:00:08.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:08.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:08.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:08.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:09.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:00:09.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:09.129486+0000) 2019-10-23T14:00:09.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:09.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:09.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:09.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:10.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:10.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:10.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:10.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:11.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:11.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:11.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:11.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:11.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:00:11.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:11.616689+0000) 2019-10-23T14:00:12.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:12.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:12.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:12.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:13.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:13.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:13.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:13.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:14.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:14.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:14.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:14.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:14.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:00:14.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:14.591827+0000) 2019-10-23T14:00:14.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:00:14.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:14.615209+0000) 2019-10-23T14:00:14.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:00:14.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:14.632515+0000) 2019-10-23T14:00:15.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:15.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:15.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:15.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:16.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:16.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:16.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:16.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:17.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:17.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:17.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:17.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:18.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:00:18.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:18.134240+0000) 2019-10-23T14:00:18.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:18.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:18.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:18.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:19.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:00:19.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:19.129583+0000) 2019-10-23T14:00:19.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:19.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:19.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:19.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:20.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:20.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:20.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:20.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:21.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:21.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:21.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:21.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:21.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:00:21.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:21.616788+0000) 2019-10-23T14:00:22.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:22.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:22.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:22.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:23.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:23.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:23.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:23.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:24.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:00:24.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:24.591926+0000) 2019-10-23T14:00:24.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:00:24.615+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:24.615297+0000) 2019-10-23T14:00:24.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:00:24.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:24.632623+0000) 2019-10-23T14:00:24.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:24.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:24.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:24.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:25.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:25.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:25.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:25.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:26.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:26.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:26.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:26.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:27.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:27.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:27.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:27.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:28.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:00:28.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:28.134296+0000) 2019-10-23T14:00:28.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:28.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:28.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:28.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:29.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:00:29.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:29.129680+0000) 2019-10-23T14:00:29.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:29.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:29.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:29.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:30.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:30.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:30.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:30.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:31.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:00:31.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:31.616887+0000) 2019-10-23T14:00:31.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:31.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:31.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:31.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:32.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:32.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:32.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:32.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:33.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:33.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:33.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:33.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:34.594 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:00:34.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:34.592021+0000) 2019-10-23T14:00:34.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:00:34.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:34.615389+0000) 2019-10-23T14:00:34.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:00:34.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:34.632729+0000) 2019-10-23T14:00:34.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:34.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:34.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:34.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:35.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:35.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:35.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:35.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:36.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:36.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:36.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:36.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:37.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:37.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:37.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:37.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:38.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:00:38.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:38.134390+0000) 2019-10-23T14:00:38.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:38.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:38.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:38.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:39.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:00:39.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:39.129818+0000) 2019-10-23T14:00:39.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:39.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:39.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:39.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:40.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:40.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:40.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:40.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:41.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:00:41.615+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:41.616986+0000) 2019-10-23T14:00:41.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:41.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:41.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:41.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:42.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:42.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:42.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:42.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:43.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:43.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:43.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:43.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:44.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:00:44.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:44.592117+0000) 2019-10-23T14:00:44.620 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:00:44.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:44.615484+0000) 2019-10-23T14:00:44.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:00:44.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:44.632834+0000) 2019-10-23T14:00:44.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:44.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:44.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:44.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:45.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:45.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:45.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:45.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:46.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:46.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:46.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:46.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:47.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:47.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:47.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:47.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:48.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:00:48.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:48.134484+0000) 2019-10-23T14:00:48.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:48.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:48.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:48.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:49.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:00:49.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:49.129942+0000) 2019-10-23T14:00:49.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:49.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:49.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:49.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:50.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:50.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:50.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:50.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:51.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:00:51.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:51.617039+0000) 2019-10-23T14:00:51.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:51.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:51.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:51.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:52.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:52.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:52.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:52.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:53.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:53.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:53.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:53.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:54.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:00:54.590+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:54.592215+0000) 2019-10-23T14:00:54.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:00:54.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:54.615576+0000) 2019-10-23T14:00:54.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:00:54.631+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:54.632941+0000) 2019-10-23T14:00:54.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:54.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:54.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:54.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:55.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:55.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:55.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:55.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:56.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:56.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:56.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:56.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:57.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:57.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:57.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:57.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:58.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:00:58.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:58.134582+0000) 2019-10-23T14:00:58.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:58.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:58.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:58.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:00:59.132 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:00:59.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:00:59.130036+0000) 2019-10-23T14:00:59.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:59.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:00:59.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:00:59.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:00.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:00.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:00.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:00.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:01.621 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:01:01.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:01.617135+0000) 2019-10-23T14:01:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:01.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:01.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:02.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:02.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:02.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:02.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:03.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:03.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:03.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:03.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:04.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:01:04.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:04.592343+0000) 2019-10-23T14:01:04.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:04.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:04.615682+0000) 2019-10-23T14:01:04.637 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:01:04.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:04.633116+0000) 2019-10-23T14:01:04.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:04.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:04.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:04.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:05.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:05.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:05.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:05.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:06.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:06.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:06.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:06.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:07.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:07.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:07.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:07.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:08.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:01:08.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:08.134697+0000) 2019-10-23T14:01:08.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:08.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:08.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:08.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:09.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:01:09.128+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:09.130133+0000) 2019-10-23T14:01:09.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:09.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:09.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:09.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:10.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:10.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:10.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:10.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:11.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:01:11.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:11.617241+0000) 2019-10-23T14:01:11.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:11.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:11.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:11.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:12.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:12.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:12.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:12.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:13.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:13.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:13.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:13.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:14.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:01:14.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:14.592486+0000) 2019-10-23T14:01:14.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:14.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:14.615804+0000) 2019-10-23T14:01:14.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:01:14.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:14.633249+0000) 2019-10-23T14:01:14.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:14.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:14.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:14.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:15.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:15.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:15.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:15.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:16.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:16.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:16.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:16.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:17.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:17.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:17.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:17.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:18.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:01:18.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:18.134794+0000) 2019-10-23T14:01:18.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:18.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:18.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:18.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:19.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:01:19.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:19.130231+0000) 2019-10-23T14:01:19.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:19.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:19.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:19.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:20.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:20.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:20.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:20.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:21.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:21.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:21.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:21.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:21.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:01:21.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:21.617340+0000) 2019-10-23T14:01:22.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:22.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:22.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:22.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:23.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:23.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:23.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:23.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:24.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:24.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:24.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:24.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:24.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:01:24.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:24.592605+0000) 2019-10-23T14:01:24.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:24.615+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:24.615903+0000) 2019-10-23T14:01:24.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:01:24.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:24.633357+0000) 2019-10-23T14:01:25.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:25.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:25.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:25.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:26.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:26.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:26.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:26.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:27.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:27.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:27.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:27.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:28.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:01:28.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:28.134889+0000) 2019-10-23T14:01:28.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:28.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:28.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:28.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:29.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:01:29.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:29.130322+0000) 2019-10-23T14:01:29.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:29.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:29.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:29.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:30.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:30.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:30.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:30.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:31.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:31.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:31.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:31.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:31.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:01:31.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:31.617440+0000) 2019-10-23T14:01:32.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:32.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:32.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:32.543+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:33.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:33.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:33.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:33.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:34.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:34.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:34.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:34.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:34.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:01:34.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:34.592713+0000) 2019-10-23T14:01:34.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:34.615+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:34.615998+0000) 2019-10-23T14:01:34.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:01:34.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:34.633463+0000) 2019-10-23T14:01:35.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:35.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:35.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:35.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:36.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:36.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:36.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:36.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:37.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:37.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:37.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:37.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:38.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:01:38.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:38.134985+0000) 2019-10-23T14:01:38.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:38.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:38.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:38.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:39.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:01:39.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:39.130411+0000) 2019-10-23T14:01:39.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:39.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:39.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:39.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:40.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:40.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:40.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:40.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:41.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:41.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:41.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:41.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:41.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:01:41.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:41.617540+0000) 2019-10-23T14:01:42.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:42.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:42.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:42.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:43.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:43.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:43.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:43.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:44.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:01:44.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:44.592823+0000) 2019-10-23T14:01:44.618 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:44.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:44.616087+0000) 2019-10-23T14:01:44.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:01:44.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:44.633571+0000) 2019-10-23T14:01:44.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:44.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:44.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:44.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:45.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:45.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:45.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:45.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:46.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:46.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:46.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:46.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:47.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:47.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:47.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:47.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:48.137 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:01:48.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:48.135083+0000) 2019-10-23T14:01:48.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:48.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:48.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:48.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:49.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:01:49.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:49.130506+0000) 2019-10-23T14:01:49.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:49.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:49.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:49.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:50.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:50.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:50.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:50.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:51.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:01:51.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:51.617639+0000) 2019-10-23T14:01:51.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:51.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:51.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:51.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:52.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:52.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:52.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:52.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:53.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:53.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:53.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:53.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:54.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:01:54.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:54.592933+0000) 2019-10-23T14:01:54.619 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:54.614+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:54.616175+0000) 2019-10-23T14:01:54.620 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:54.615+0000 7fa1716d9700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:54.616812+0000) 2019-10-23T14:01:54.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:01:54.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:54.633681+0000) 2019-10-23T14:01:54.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:54.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:54.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:54.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:55.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:55.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:55.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:55.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:56.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:56.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:56.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:56.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:57.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:57.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:57.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:57.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:58.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:01:58.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:58.135179+0000) 2019-10-23T14:01:58.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:58.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:58.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:58.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:01:59.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:01:59.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:59.116355+0000) 2019-10-23T14:01:59.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:01:59.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:01:59.130603+0000) 2019-10-23T14:01:59.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:59.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:01:59.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:01:59.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:00.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:00.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:00.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:00.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:01.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:02:01.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:01.617741+0000) 2019-10-23T14:02:01.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:01.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:01.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:01.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:02.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:02.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:02.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:02.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:03.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:03.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:03.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:03.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:04.595 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:02:04.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:04.593040+0000) 2019-10-23T14:02:04.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:02:04.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:04.633787+0000) 2019-10-23T14:02:04.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:04.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:04.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:04.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:05.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:05.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:05.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:05.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:06.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:06.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:06.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:06.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:07.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:07.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:07.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:07.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:08.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:02:08.133+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:08.135273+0000) 2019-10-23T14:02:08.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:08.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:08.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:08.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:09.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:02:09.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:09.116450+0000) 2019-10-23T14:02:09.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:02:09.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:09.130695+0000) 2019-10-23T14:02:09.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:09.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:09.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:09.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:10.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:10.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:10.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:10.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:11.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:02:11.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:11.617841+0000) 2019-10-23T14:02:11.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:11.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:11.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:11.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:12.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:12.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:12.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:12.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:13.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:13.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:14.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:02:14.591+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:14.593150+0000) 2019-10-23T14:02:14.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:02:14.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:14.633899+0000) 2019-10-23T14:02:14.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:14.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:14.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:14.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:15.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:15.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:15.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:15.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:16.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:16.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:16.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:16.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:17.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:17.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:17.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:17.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:18.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:02:18.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:18.135374+0000) 2019-10-23T14:02:18.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:18.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:18.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:18.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:19.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:02:19.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:19.116543+0000) 2019-10-23T14:02:19.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:02:19.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:19.130790+0000) 2019-10-23T14:02:19.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:19.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:19.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:19.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:20.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:20.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:20.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:20.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:21.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:02:21.616+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:21.617939+0000) 2019-10-23T14:02:21.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:21.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:21.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:21.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:22.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:22.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:22.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:22.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:23.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:23.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:23.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:23.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:24.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:02:24.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:24.593259+0000) 2019-10-23T14:02:24.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:02:24.632+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:24.634004+0000) 2019-10-23T14:02:24.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:24.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:24.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:24.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:25.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:25.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:25.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:25.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:26.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:26.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:26.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:26.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:27.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:27.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:27.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:27.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:28.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:02:28.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:28.135471+0000) 2019-10-23T14:02:28.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:28.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:28.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:28.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:29.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:02:29.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:29.116634+0000) 2019-10-23T14:02:29.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:02:29.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:29.130879+0000) 2019-10-23T14:02:29.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:29.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:29.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:29.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:30.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:30.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:30.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:30.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:31.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:02:31.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:31.618039+0000) 2019-10-23T14:02:31.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:31.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:31.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:31.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:32.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:32.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:32.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:32.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:33.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:33.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:33.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:33.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:34.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:02:34.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:34.593320+0000) 2019-10-23T14:02:34.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:02:34.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:34.634118+0000) 2019-10-23T14:02:34.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:34.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:34.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:34.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:35.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:35.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:35.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:35.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:36.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:36.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:36.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:36.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:37.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:37.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:37.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:37.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:38.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:02:38.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:38.135565+0000) 2019-10-23T14:02:38.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:38.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:38.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:38.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:39.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:02:39.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:39.116728+0000) 2019-10-23T14:02:39.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:02:39.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:39.130976+0000) 2019-10-23T14:02:39.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:39.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:39.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:39.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:40.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:40.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:40.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:40.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:41.622 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:02:41.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:41.618137+0000) 2019-10-23T14:02:41.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:41.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:41.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:41.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:42.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:42.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:42.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:42.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:43.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:43.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:43.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:43.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:44.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:02:44.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:44.593429+0000) 2019-10-23T14:02:44.638 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:02:44.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:44.634228+0000) 2019-10-23T14:02:44.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:44.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:44.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:44.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:45.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:45.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:45.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:45.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:46.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:46.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:47.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:47.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:47.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:47.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:48.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:02:48.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:48.135661+0000) 2019-10-23T14:02:48.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:48.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:48.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:48.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:49.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:02:49.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:49.116823+0000) 2019-10-23T14:02:49.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:02:49.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:49.131073+0000) 2019-10-23T14:02:49.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:49.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:49.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:49.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:50.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:50.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:50.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:50.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:51.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:02:51.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:51.618237+0000) 2019-10-23T14:02:51.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:51.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:51.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:51.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:52.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:52.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:52.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:52.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:53.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:53.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:53.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:53.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:54.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:02:54.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:54.593540+0000) 2019-10-23T14:02:54.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:02:54.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:54.634336+0000) 2019-10-23T14:02:54.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:54.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:54.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:54.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:55.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:55.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:55.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:55.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:56.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:56.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:56.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:56.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:57.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:57.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:57.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:57.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:58.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:02:58.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:58.135760+0000) 2019-10-23T14:02:58.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:58.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:58.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:58.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:02:59.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:02:59.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:59.116911+0000) 2019-10-23T14:02:59.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:02:59.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:02:59.131165+0000) 2019-10-23T14:02:59.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:59.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:02:59.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:02:59.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:00.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:00.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:00.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:00.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:01.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:03:01.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:01.618334+0000) 2019-10-23T14:03:01.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:01.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:01.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:01.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:02.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:02.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:02.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:02.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:03.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:03.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:03.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:03.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:04.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:03:04.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:04.593651+0000) 2019-10-23T14:03:04.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:03:04.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:04.634443+0000) 2019-10-23T14:03:04.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:04.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:04.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:04.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:05.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:05.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:05.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:05.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:06.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:06.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:06.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:06.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:07.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:07.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:07.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:07.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:08.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:03:08.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:08.135860+0000) 2019-10-23T14:03:08.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:08.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:08.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:08.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:09.119 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:03:09.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:09.117007+0000) 2019-10-23T14:03:09.133 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:03:09.129+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:09.131259+0000) 2019-10-23T14:03:09.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:09.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:09.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:09.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:10.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:10.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:10.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:10.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:11.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:03:11.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:11.618432+0000) 2019-10-23T14:03:11.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:11.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:11.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:11.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:12.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:12.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:12.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:12.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:13.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:13.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:13.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:13.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:14.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:03:14.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:14.593757+0000) 2019-10-23T14:03:14.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:03:14.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:14.634549+0000) 2019-10-23T14:03:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:14.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:14.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:14.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:15.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:15.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:15.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:15.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:16.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:16.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:16.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:16.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:17.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:17.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:17.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:17.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:18.138 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:03:18.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:18.135960+0000) 2019-10-23T14:03:18.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:18.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:18.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:18.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:19.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:03:19.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:19.117103+0000) 2019-10-23T14:03:19.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:03:19.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:19.131360+0000) 2019-10-23T14:03:19.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:19.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:19.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:19.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:20.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:20.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:20.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:20.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:21.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:03:21.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:21.618531+0000) 2019-10-23T14:03:21.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:21.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:21.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:21.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:22.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:22.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:22.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:22.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:23.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:23.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:23.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:23.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:24.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:03:24.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:24.593869+0000) 2019-10-23T14:03:24.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:03:24.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:24.634661+0000) 2019-10-23T14:03:24.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:24.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:24.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:24.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:25.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:25.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:25.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:25.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:26.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:26.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:26.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:26.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:27.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:27.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:27.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:27.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:28.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:03:28.134+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:28.136059+0000) 2019-10-23T14:03:28.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:28.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:28.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:28.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:29.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:03:29.115+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:29.117209+0000) 2019-10-23T14:03:29.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:03:29.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:29.131454+0000) 2019-10-23T14:03:29.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:29.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:29.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:29.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:30.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:30.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:30.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:30.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:31.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:31.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:31.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:31.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:31.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:03:31.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:31.618632+0000) 2019-10-23T14:03:32.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:32.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:32.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:32.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:33.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:33.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:33.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:33.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:34.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:34.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:34.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:34.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:34.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:03:34.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:34.593989+0000) 2019-10-23T14:03:34.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:03:34.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:34.634770+0000) 2019-10-23T14:03:35.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:35.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:35.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:35.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:36.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:36.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:36.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:36.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:37.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:37.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:37.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:37.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:38.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:03:38.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:38.136154+0000) 2019-10-23T14:03:38.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:38.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:38.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:38.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:39.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:03:39.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:39.117298+0000) 2019-10-23T14:03:39.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:03:39.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:39.131549+0000) 2019-10-23T14:03:39.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:39.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:39.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:39.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:40.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:40.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:40.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:40.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:41.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:41.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:41.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:41.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:41.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:03:41.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:41.618734+0000) 2019-10-23T14:03:42.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:42.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:42.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:42.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:43.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:43.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:43.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:43.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:44.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:44.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:44.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:44.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:44.596 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:03:44.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:44.594108+0000) 2019-10-23T14:03:44.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:03:44.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:44.634880+0000) 2019-10-23T14:03:45.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:45.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:45.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:45.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:46.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:46.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:46.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:46.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:47.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:47.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:47.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:47.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:48.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:03:48.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:48.136248+0000) 2019-10-23T14:03:48.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:48.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:48.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:48.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:49.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:03:49.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:49.117396+0000) 2019-10-23T14:03:49.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:03:49.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:49.131637+0000) 2019-10-23T14:03:49.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:49.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:49.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:49.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:50.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:50.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:50.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:50.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:51.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:51.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:51.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:51.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:51.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:03:51.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:51.618830+0000) 2019-10-23T14:03:52.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:52.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:52.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:52.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:53.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:53.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:53.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:53.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:54.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:54.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:54.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:54.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:54.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:03:54.592+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:54.594221+0000) 2019-10-23T14:03:54.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:03:54.633+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:54.634987+0000) 2019-10-23T14:03:55.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:55.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:55.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:55.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:56.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:56.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:56.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:56.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:57.570 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:57.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:57.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:57.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:58.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:03:58.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:58.136350+0000) 2019-10-23T14:03:58.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:58.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:58.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:58.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:03:59.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:03:59.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:59.117494+0000) 2019-10-23T14:03:59.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:03:59.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:03:59.131730+0000) 2019-10-23T14:03:59.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:59.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:03:59.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:03:59.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:00.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:00.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:00.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:00.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:01.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:01.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:01.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:01.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:01.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:04:01.617+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:01.618930+0000) 2019-10-23T14:04:02.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:02.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:02.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:02.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:03.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:03.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:03.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:03.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:04.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:04:04.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:04.594342+0000) 2019-10-23T14:04:04.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:04.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:04.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:04.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:04.639 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:04:04.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:04.635095+0000) 2019-10-23T14:04:05.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:05.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:05.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:05.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:06.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:06.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:06.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:06.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:07.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:07.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:07.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:07.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:08.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:04:08.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:08.136439+0000) 2019-10-23T14:04:08.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:08.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:08.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:08.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:09.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:04:09.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:09.117593+0000) 2019-10-23T14:04:09.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:04:09.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:09.131829+0000) 2019-10-23T14:04:09.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:09.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:09.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:09.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:10.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:10.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:10.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:10.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:11.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:11.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:11.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:11.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:11.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:04:11.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:11.619032+0000) 2019-10-23T14:04:12.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:12.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:12.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:12.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:13.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:13.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:13.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:13.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:14.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:14.527+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:14.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:14.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:14.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:04:14.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:14.594527+0000) 2019-10-23T14:04:14.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:04:14.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:14.635200+0000) 2019-10-23T14:04:15.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:15.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:15.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:15.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:16.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:16.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:16.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:16.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:17.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:17.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:17.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:17.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:18.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:04:18.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:18.136535+0000) 2019-10-23T14:04:18.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:18.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:18.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:18.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:19.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:04:19.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:19.117734+0000) 2019-10-23T14:04:19.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:04:19.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:19.131955+0000) 2019-10-23T14:04:19.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:19.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:19.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:19.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:20.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:20.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:20.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:20.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:21.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:21.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:21.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:21.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:21.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:04:21.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:21.619131+0000) 2019-10-23T14:04:22.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:22.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:22.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:22.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:23.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:23.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:23.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:23.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:24.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:04:24.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:24.594665+0000) 2019-10-23T14:04:24.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:04:24.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:24.635304+0000) 2019-10-23T14:04:24.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:24.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:24.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:24.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:25.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:25.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:25.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:25.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:26.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:26.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:26.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:26.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:27.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:27.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:27.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:27.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:28.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:04:28.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:28.136632+0000) 2019-10-23T14:04:28.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:28.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:28.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:28.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:29.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:04:29.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:29.117887+0000) 2019-10-23T14:04:29.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:04:29.130+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:29.132087+0000) 2019-10-23T14:04:29.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:29.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:29.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:29.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:30.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:30.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:30.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:30.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:31.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:31.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:31.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:31.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:31.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:04:31.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:31.619228+0000) 2019-10-23T14:04:32.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:32.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:32.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:32.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:33.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:33.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:33.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:33.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:34.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:34.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:34.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:34.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:34.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:04:34.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:34.594780+0000) 2019-10-23T14:04:34.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:04:34.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:34.635412+0000) 2019-10-23T14:04:35.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:35.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:35.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:35.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:36.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:36.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:36.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:36.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:37.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:37.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:37.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:37.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:38.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:04:38.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:38.136726+0000) 2019-10-23T14:04:38.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:38.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:38.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:38.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:39.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:04:39.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:39.117985+0000) 2019-10-23T14:04:39.134 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:04:39.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:39.132179+0000) 2019-10-23T14:04:39.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:39.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:39.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:39.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:40.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:40.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:40.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:40.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:41.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:41.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:41.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:41.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:41.623 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:04:41.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:41.619329+0000) 2019-10-23T14:04:42.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:42.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:42.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:42.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:43.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:43.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:43.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:43.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:44.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:04:44.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:44.594891+0000) 2019-10-23T14:04:44.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:44.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:44.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:44.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:44.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:04:44.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:44.635518+0000) 2019-10-23T14:04:45.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:45.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:45.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:45.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:46.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:46.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:46.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:46.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:47.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:47.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:47.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:47.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:48.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:04:48.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:48.136820+0000) 2019-10-23T14:04:48.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:48.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:48.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:48.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:49.120 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:04:49.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:49.118078+0000) 2019-10-23T14:04:49.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:04:49.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:49.132270+0000) 2019-10-23T14:04:49.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:49.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:49.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:49.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:50.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:50.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:50.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:50.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:51.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:51.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:51.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:51.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:51.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:04:51.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:51.619428+0000) 2019-10-23T14:04:52.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:52.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:52.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:52.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:53.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:53.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:53.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:53.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:54.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:54.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:54.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:54.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:54.597 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:04:54.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:54.594999+0000) 2019-10-23T14:04:54.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:04:54.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:54.635628+0000) 2019-10-23T14:04:55.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:55.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:55.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:55.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:56.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:56.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:56.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:56.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:57.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:57.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:57.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:57.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:58.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:04:58.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:58.136914+0000) 2019-10-23T14:04:58.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:58.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:58.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:58.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:04:59.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:04:59.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:59.118168+0000) 2019-10-23T14:04:59.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:04:59.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:04:59.132365+0000) 2019-10-23T14:04:59.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:59.529+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:04:59.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:04:59.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:00.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:00.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:00.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:00.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:01.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:01.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:01.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:01.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:01.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:05:01.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:01.619526+0000) 2019-10-23T14:05:02.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:02.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:02.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:02.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:03.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:03.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:03.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:03.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:04.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:04.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:04.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:04.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:04.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:05:04.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:04.595106+0000) 2019-10-23T14:05:04.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:05:04.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:04.635737+0000) 2019-10-23T14:05:05.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:05.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:05.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:05.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:06.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:06.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:06.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:06.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:07.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:07.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:07.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:07.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:08.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:05:08.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:08.137005+0000) 2019-10-23T14:05:08.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:08.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:08.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:08.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:09.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:05:09.116+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:09.118267+0000) 2019-10-23T14:05:09.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:05:09.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:09.132457+0000) 2019-10-23T14:05:09.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:09.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:09.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:09.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:10.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:10.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:10.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:10.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:11.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:11.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:11.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:11.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:11.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:05:11.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:11.619624+0000) 2019-10-23T14:05:12.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:12.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:12.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:12.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:13.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:13.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:13.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:13.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:14.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:14.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:14.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:14.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:14.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:05:14.593+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:14.595222+0000) 2019-10-23T14:05:14.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:05:14.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:14.635847+0000) 2019-10-23T14:05:15.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:15.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:15.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:15.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:16.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:16.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:16.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:16.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:17.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:17.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:17.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:17.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:18.139 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:05:18.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:18.137103+0000) 2019-10-23T14:05:18.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:18.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:18.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:18.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:19.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:05:19.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:19.118365+0000) 2019-10-23T14:05:19.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:05:19.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:19.132553+0000) 2019-10-23T14:05:19.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:19.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:19.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:19.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:20.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:20.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:20.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:20.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:21.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:21.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:21.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:21.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:21.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:05:21.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:21.619718+0000) 2019-10-23T14:05:22.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:22.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:22.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:22.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:23.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:23.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:23.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:23.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:24.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:24.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:24.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:24.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:24.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:05:24.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:24.595337+0000) 2019-10-23T14:05:24.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:05:24.634+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:24.635957+0000) 2019-10-23T14:05:25.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:25.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:25.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:25.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:26.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:26.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:26.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:26.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:27.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:27.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:27.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:27.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:28.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:05:28.135+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:28.137204+0000) 2019-10-23T14:05:28.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:28.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:28.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:28.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:29.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:05:29.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:29.118461+0000) 2019-10-23T14:05:29.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:05:29.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:29.132649+0000) 2019-10-23T14:05:29.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:29.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:29.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:29.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:30.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:30.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:30.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:30.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:31.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:31.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:31.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:31.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:31.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:05:31.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:31.619813+0000) 2019-10-23T14:05:32.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:32.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:32.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:32.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:33.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:33.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:33.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:33.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:34.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:34.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:34.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:34.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:34.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:05:34.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:34.595451+0000) 2019-10-23T14:05:34.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:05:34.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:34.636068+0000) 2019-10-23T14:05:35.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:35.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:35.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:35.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:36.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:36.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:36.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:36.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:37.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:37.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:37.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:37.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:38.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:05:38.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:38.137298+0000) 2019-10-23T14:05:38.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:38.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:38.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:38.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:39.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:05:39.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:39.118557+0000) 2019-10-23T14:05:39.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:05:39.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:39.132742+0000) 2019-10-23T14:05:39.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:39.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:39.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:39.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:40.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:40.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:40.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:40.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:41.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:41.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:41.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:41.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:41.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:05:41.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:41.619910+0000) 2019-10-23T14:05:42.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:42.595+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:42.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:42.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:43.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:43.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:43.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:43.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:44.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:05:44.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:44.595601+0000) 2019-10-23T14:05:44.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:05:44.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:44.636177+0000) 2019-10-23T14:05:44.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:44.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:44.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:44.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:45.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:45.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:45.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:45.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:46.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:46.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:46.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:46.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:47.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:47.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:47.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:47.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:48.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:05:48.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:48.137396+0000) 2019-10-23T14:05:48.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:48.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:48.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:48.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:49.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:05:49.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:49.118656+0000) 2019-10-23T14:05:49.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:05:49.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:49.132839+0000) 2019-10-23T14:05:49.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:49.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:49.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:49.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:50.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:50.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:50.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:50.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:51.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:51.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:51.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:51.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:51.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:05:51.618+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:51.620006+0000) 2019-10-23T14:05:52.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:52.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:52.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:52.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:53.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:53.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:53.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:53.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:54.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:05:54.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:54.595758+0000) 2019-10-23T14:05:54.640 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:05:54.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:54.636285+0000) 2019-10-23T14:05:54.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:54.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:54.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:54.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:55.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:55.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:55.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:55.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:56.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:56.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:56.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:56.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:57.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:57.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:57.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:57.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:58.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:05:58.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:58.137494+0000) 2019-10-23T14:05:58.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:58.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:58.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:58.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:05:59.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:05:59.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:59.118752+0000) 2019-10-23T14:05:59.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:05:59.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:05:59.132932+0000) 2019-10-23T14:05:59.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:59.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:05:59.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:05:59.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:00.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:00.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:00.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:00.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:01.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:06:01.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:01.620106+0000) 2019-10-23T14:06:01.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:01.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:01.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:01.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:02.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:02.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:02.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:02.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:03.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:03.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:03.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:03.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:04.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:06:04.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:04.595871+0000) 2019-10-23T14:06:04.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:06:04.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:04.636394+0000) 2019-10-23T14:06:04.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:04.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:04.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:04.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:05.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:05.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:05.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:05.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:06.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:06.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:06.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:06.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:07.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:07.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:07.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:07.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:08.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:06:08.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:08.137587+0000) 2019-10-23T14:06:08.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:08.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:08.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:08.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:09.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:06:09.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:09.118860+0000) 2019-10-23T14:06:09.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:06:09.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:09.133028+0000) 2019-10-23T14:06:09.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:09.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:09.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:09.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:10.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:10.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:10.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:10.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:11.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:06:11.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:11.620202+0000) 2019-10-23T14:06:11.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:11.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:11.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:11.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:12.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:12.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:12.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:12.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:13.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:13.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:13.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:13.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:14.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:06:14.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:14.595993+0000) 2019-10-23T14:06:14.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:06:14.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:14.636504+0000) 2019-10-23T14:06:14.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:14.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:14.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:14.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:15.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:15.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:15.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:15.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:16.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:16.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:16.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:16.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:17.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:17.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:17.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:18.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:06:18.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:18.137692+0000) 2019-10-23T14:06:18.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:18.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:18.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:18.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:19.121 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:06:19.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:19.118956+0000) 2019-10-23T14:06:19.135 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:06:19.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:19.133121+0000) 2019-10-23T14:06:19.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:19.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:19.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:19.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:20.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:20.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:20.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:20.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:21.624 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:06:21.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:21.620297+0000) 2019-10-23T14:06:21.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:21.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:21.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:21.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:22.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:22.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:22.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:22.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:23.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:23.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:23.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:23.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:24.598 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:06:24.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:24.596111+0000) 2019-10-23T14:06:24.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:06:24.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:24.636618+0000) 2019-10-23T14:06:24.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:24.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:24.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:24.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:25.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:25.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:25.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:25.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:26.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:26.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:26.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:26.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:27.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:27.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:27.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:27.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:28.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:06:28.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:28.137793+0000) 2019-10-23T14:06:28.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:28.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:28.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:28.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:29.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:06:29.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:29.119051+0000) 2019-10-23T14:06:29.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:06:29.131+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:29.133215+0000) 2019-10-23T14:06:29.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:29.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:29.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:29.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:30.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:30.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:30.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:30.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:31.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:06:31.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:31.620395+0000) 2019-10-23T14:06:31.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:31.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:31.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:31.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:32.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:32.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:32.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:32.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:33.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:33.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:33.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:33.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:34.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:06:34.594+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:34.596229+0000) 2019-10-23T14:06:34.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:06:34.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:34.636726+0000) 2019-10-23T14:06:34.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:34.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:34.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:34.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:35.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:35.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:35.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:35.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:36.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:36.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:36.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:36.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:37.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:37.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:37.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:37.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:38.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:06:38.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:38.137889+0000) 2019-10-23T14:06:38.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:38.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:38.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:38.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:39.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:06:39.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:39.119147+0000) 2019-10-23T14:06:39.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:06:39.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:39.133299+0000) 2019-10-23T14:06:39.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:39.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:39.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:39.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:40.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:40.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:40.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:40.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:41.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:06:41.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:41.620490+0000) 2019-10-23T14:06:41.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:41.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:41.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:41.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:42.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:42.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:42.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:42.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:43.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:43.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:43.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:43.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:44.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:06:44.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:44.596328+0000) 2019-10-23T14:06:44.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:06:44.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:44.636835+0000) 2019-10-23T14:06:44.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:44.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:44.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:44.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:45.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:45.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:45.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:45.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:46.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:46.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:46.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:46.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:47.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:47.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:47.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:47.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:48.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:06:48.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:48.137981+0000) 2019-10-23T14:06:48.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:48.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:48.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:48.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:49.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:06:49.117+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:49.119241+0000) 2019-10-23T14:06:49.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:06:49.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:49.133394+0000) 2019-10-23T14:06:49.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:49.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:49.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:49.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:50.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:50.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:50.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:50.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:51.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:06:51.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:51.620586+0000) 2019-10-23T14:06:51.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:51.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:51.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:51.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:52.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:52.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:52.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:52.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:53.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:53.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:53.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:53.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:54.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:06:54.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:54.596444+0000) 2019-10-23T14:06:54.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:06:54.635+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:54.636945+0000) 2019-10-23T14:06:54.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:54.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:54.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:54.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:55.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:55.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:55.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:55.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:56.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:56.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:56.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:56.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:57.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:57.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:57.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:57.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:58.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:06:58.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:58.138074+0000) 2019-10-23T14:06:58.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:58.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:58.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:58.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:06:59.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:06:59.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:59.119333+0000) 2019-10-23T14:06:59.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:06:59.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:06:59.133489+0000) 2019-10-23T14:06:59.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:59.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:06:59.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:06:59.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:00.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:00.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:00.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:00.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:01.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:07:01.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:01.620682+0000) 2019-10-23T14:07:01.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:01.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:01.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:01.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:02.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:02.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:02.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:02.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:03.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:03.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:03.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:03.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:04.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:07:04.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:04.596559+0000) 2019-10-23T14:07:04.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:07:04.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:04.637058+0000) 2019-10-23T14:07:04.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:04.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:04.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:04.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:05.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:05.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:05.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:05.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:06.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:06.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:06.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:06.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:07.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:07.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:07.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:07.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:08.140 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:07:08.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:08.138167+0000) 2019-10-23T14:07:08.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:08.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:08.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:08.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:09.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:07:09.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:09.119431+0000) 2019-10-23T14:07:09.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:07:09.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:09.133587+0000) 2019-10-23T14:07:09.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:09.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:09.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:09.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:10.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:10.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:10.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:11.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:07:11.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:11.620779+0000) 2019-10-23T14:07:11.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:11.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:11.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:11.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:12.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:12.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:12.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:12.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:13.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:13.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:14.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:07:14.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:14.596676+0000) 2019-10-23T14:07:14.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:07:14.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:14.637163+0000) 2019-10-23T14:07:14.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:14.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:14.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:14.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:15.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:15.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:15.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:15.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:16.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:16.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:16.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:16.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:17.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:17.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:17.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:17.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:18.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:07:18.136+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:18.138260+0000) 2019-10-23T14:07:18.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:18.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:18.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:18.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:19.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:07:19.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:19.119523+0000) 2019-10-23T14:07:19.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:07:19.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:19.133683+0000) 2019-10-23T14:07:19.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:19.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:19.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:19.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:20.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:20.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:20.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:20.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:21.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:21.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:21.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:21.590+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:21.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:07:21.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:21.620878+0000) 2019-10-23T14:07:22.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:22.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:22.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:22.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:23.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:23.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T13:56:53.859796+0000 (oldest deadline 2019-10-23T13:57:13.859796+0000) 2019-10-23T14:07:23.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:23.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:24.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:24.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:24.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:07:24.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:24.596798+0000) 2019-10-23T14:07:24.641 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:07:24.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:24.637274+0000) 2019-10-23T14:07:25.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:25.561+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:26.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:26.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:27.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:27.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:28.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:07:28.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:28.138359+0000) 2019-10-23T14:07:28.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:28.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:29.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:07:29.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:29.119614+0000) 2019-10-23T14:07:29.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:07:29.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:29.133776+0000) 2019-10-23T14:07:29.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:29.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:30.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:30.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:31.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:31.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:31.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:07:31.619+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:31.620971+0000) 2019-10-23T14:07:32.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:32.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:33.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:33.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:34.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:34.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:34.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:07:34.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:34.596917+0000) 2019-10-23T14:07:34.642 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:07:34.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:34.637383+0000) 2019-10-23T14:07:35.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:35.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:36.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:36.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:37.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:37.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:38.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:07:38.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:38.138458+0000) 2019-10-23T14:07:38.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:38.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:39.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:07:39.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:39.119709+0000) 2019-10-23T14:07:39.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:07:39.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:39.133874+0000) 2019-10-23T14:07:39.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:39.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:40.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:40.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:41.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:41.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:41.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:07:41.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:41.621069+0000) 2019-10-23T14:07:42.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:42.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:43.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:43.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:44.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:44.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:44.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:07:44.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:44.597038+0000) 2019-10-23T14:07:44.642 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:07:44.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:44.637492+0000) 2019-10-23T14:07:45.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:45.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:46.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:46.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:47.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:47.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:47.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:47.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:48.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:07:48.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:48.138555+0000) 2019-10-23T14:07:48.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:48.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:48.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:48.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:49.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:07:49.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:49.119807+0000) 2019-10-23T14:07:49.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:07:49.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:49.133968+0000) 2019-10-23T14:07:49.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:49.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:49.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:49.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:50.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:50.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:50.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:50.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:51.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:51.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:51.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:51.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:51.625 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:07:51.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:51.621165+0000) 2019-10-23T14:07:52.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:52.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:52.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:52.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:53.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:53.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:53.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:53.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:54.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:54.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:54.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:54.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:54.599 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:07:54.595+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:54.597151+0000) 2019-10-23T14:07:54.642 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:07:54.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:54.637601+0000) 2019-10-23T14:07:55.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:55.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:55.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:55.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:56.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:56.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:56.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:56.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:57.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:57.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:57.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:57.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:58.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:07:58.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:58.138653+0000) 2019-10-23T14:07:58.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:58.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:58.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:58.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:07:59.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:07:59.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:59.119900+0000) 2019-10-23T14:07:59.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:07:59.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:07:59.134058+0000) 2019-10-23T14:07:59.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:59.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:07:59.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:07:59.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:00.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:00.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:00.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:00.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:01.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:01.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:01.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:01.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:01.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:08:01.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:01.621261+0000) 2019-10-23T14:08:02.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:02.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:02.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:02.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:03.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:03.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:03.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:03.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:04.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:04.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:04.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:04.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:04.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:08:04.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:04.597265+0000) 2019-10-23T14:08:04.642 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:08:04.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:04.637710+0000) 2019-10-23T14:08:05.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:05.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:05.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:05.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:06.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:06.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:06.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:06.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:07.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:07.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:07.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:07.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:08.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:08:08.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:08.138751+0000) 2019-10-23T14:08:08.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:08.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:08.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:08.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:09.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:08:09.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:09.119994+0000) 2019-10-23T14:08:09.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:08:09.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:09.134154+0000) 2019-10-23T14:08:09.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:09.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:09.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:09.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:10.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:10.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:10.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:10.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:11.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:11.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:11.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:11.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:11.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:08:11.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:11.621357+0000) 2019-10-23T14:08:12.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:12.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:12.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:12.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:13.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:13.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:13.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:13.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:14.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:08:14.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:14.597385+0000) 2019-10-23T14:08:14.642 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:08:14.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:14.637820+0000) 2019-10-23T14:08:14.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:14.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:14.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:14.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:15.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:15.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:15.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:15.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:16.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:16.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:16.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:16.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:17.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:17.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:17.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:17.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:18.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:08:18.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:18.138848+0000) 2019-10-23T14:08:18.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:18.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:18.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:18.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:19.122 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:08:19.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:19.120088+0000) 2019-10-23T14:08:19.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:08:19.132+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:19.134246+0000) 2019-10-23T14:08:19.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:19.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:19.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:19.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:20.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:20.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:20.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:20.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:21.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:08:21.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:21.621454+0000) 2019-10-23T14:08:21.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:21.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:21.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:21.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:22.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:22.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:22.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:22.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:23.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:23.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:23.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:23.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:24.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:08:24.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:24.597492+0000) 2019-10-23T14:08:24.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:08:24.636+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:24.637927+0000) 2019-10-23T14:08:24.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:24.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:24.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:24.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:25.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:25.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:25.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:25.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:26.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:26.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:26.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:26.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:27.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:27.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:27.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:27.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:28.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:08:28.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:28.138947+0000) 2019-10-23T14:08:28.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:28.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:28.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:28.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:29.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:08:29.118+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:29.120184+0000) 2019-10-23T14:08:29.136 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:08:29.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:29.134342+0000) 2019-10-23T14:08:29.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:29.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:29.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:29.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:30.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:30.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:30.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:30.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:31.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:08:31.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:31.621549+0000) 2019-10-23T14:08:31.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:31.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:31.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:31.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:32.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:32.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:32.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:32.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:33.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:33.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:33.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:33.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:34.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:08:34.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:34.597609+0000) 2019-10-23T14:08:34.642 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:08:34.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:34.638040+0000) 2019-10-23T14:08:34.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:34.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:34.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:34.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:35.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:35.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:35.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:35.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:36.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:36.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:36.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:36.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:37.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:37.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:37.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:37.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:38.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:08:38.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:38.139045+0000) 2019-10-23T14:08:38.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:38.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:38.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:38.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:39.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:08:39.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:39.120278+0000) 2019-10-23T14:08:39.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:08:39.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:39.134439+0000) 2019-10-23T14:08:39.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:39.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:39.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:39.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:40.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:40.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:40.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:40.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:41.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:08:41.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:41.621642+0000) 2019-10-23T14:08:41.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:41.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:41.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:41.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:42.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:42.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:42.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:42.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:43.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:43.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:43.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:43.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:44.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:08:44.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:44.597727+0000) 2019-10-23T14:08:44.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:08:44.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:44.638200+0000) 2019-10-23T14:08:44.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:44.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:44.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:44.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:45.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:45.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:45.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:45.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:46.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:46.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:46.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:46.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:47.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:47.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:47.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:47.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:48.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:08:48.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:48.139139+0000) 2019-10-23T14:08:48.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:48.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:48.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:48.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:49.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:08:49.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:49.120380+0000) 2019-10-23T14:08:49.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:08:49.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:49.134533+0000) 2019-10-23T14:08:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:49.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:49.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:49.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:50.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:50.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:50.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:50.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:51.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:08:51.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:51.621739+0000) 2019-10-23T14:08:51.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:51.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:51.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:51.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:52.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:52.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:52.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:52.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:53.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:53.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:53.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:53.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:54.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:08:54.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:54.597840+0000) 2019-10-23T14:08:54.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:08:54.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:54.638328+0000) 2019-10-23T14:08:54.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:54.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:54.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:54.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:55.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:55.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:55.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:55.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:56.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:56.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:56.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:56.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:57.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:57.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:57.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:57.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:58.141 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:08:58.137+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:58.139233+0000) 2019-10-23T14:08:58.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:58.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:58.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:58.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:08:59.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:08:59.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:59.120471+0000) 2019-10-23T14:08:59.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:08:59.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:08:59.134625+0000) 2019-10-23T14:08:59.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:59.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:08:59.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:08:59.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:00.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:00.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:00.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:00.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:01.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:09:01.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:01.621831+0000) 2019-10-23T14:09:01.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:01.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:01.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:01.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:02.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:02.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:02.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:02.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:03.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:03.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:03.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:03.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:04.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:09:04.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:04.597964+0000) 2019-10-23T14:09:04.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:09:04.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:04.638435+0000) 2019-10-23T14:09:04.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:04.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:04.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:04.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:05.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:05.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:05.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:05.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:06.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:06.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:06.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:06.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:07.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:07.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:07.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:07.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:08.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:09:08.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:08.139298+0000) 2019-10-23T14:09:08.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:08.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:08.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:08.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:09.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:09:09.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:09.120566+0000) 2019-10-23T14:09:09.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:09:09.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:09.134721+0000) 2019-10-23T14:09:09.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:09.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:09.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:09.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:10.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:10.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:10.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:10.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:11.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:09:11.620+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:11.621923+0000) 2019-10-23T14:09:11.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:11.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:11.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:11.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:12.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:12.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:12.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:12.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:13.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:13.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:13.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:13.923+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:14.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:09:14.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:14.598081+0000) 2019-10-23T14:09:14.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:09:14.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:14.638543+0000) 2019-10-23T14:09:14.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:14.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:14.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:14.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:15.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:15.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:15.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:15.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:16.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:16.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:16.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:16.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:17.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:17.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:17.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:17.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:18.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:09:18.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:18.139387+0000) 2019-10-23T14:09:18.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:18.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:18.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:18.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:19.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:09:19.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:19.120653+0000) 2019-10-23T14:09:19.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:09:19.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:19.134815+0000) 2019-10-23T14:09:19.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:19.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:19.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:19.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:20.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:20.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:20.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:20.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:21.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:09:21.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:21.622018+0000) 2019-10-23T14:09:21.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:21.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:21.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:21.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:22.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:22.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:22.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:22.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:23.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:23.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:23.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:23.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:24.600 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:09:24.596+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:24.598197+0000) 2019-10-23T14:09:24.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:09:24.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:24.638647+0000) 2019-10-23T14:09:24.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:24.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:24.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:24.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:25.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:25.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:25.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:25.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:26.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:26.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:26.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:26.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:27.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:27.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:27.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:27.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:28.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:09:28.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:28.139487+0000) 2019-10-23T14:09:28.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:28.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:28.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:28.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:29.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:09:29.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:29.120747+0000) 2019-10-23T14:09:29.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:09:29.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:29.134914+0000) 2019-10-23T14:09:29.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:29.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:29.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:29.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:30.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:30.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:30.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:30.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:31.626 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:09:31.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:31.622122+0000) 2019-10-23T14:09:31.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:31.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:31.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:31.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:32.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:32.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:32.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:32.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:33.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:33.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:33.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:33.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:34.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:09:34.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:34.598319+0000) 2019-10-23T14:09:34.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:09:34.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:34.638752+0000) 2019-10-23T14:09:34.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:34.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:34.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:34.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:35.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:35.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:35.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:35.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:36.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:36.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:36.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:36.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:37.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:37.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:37.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:37.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:38.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:09:38.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:38.139585+0000) 2019-10-23T14:09:38.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:38.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:38.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:38.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:39.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:09:39.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:39.120844+0000) 2019-10-23T14:09:39.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:09:39.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:39.135006+0000) 2019-10-23T14:09:39.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:39.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:39.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:39.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:40.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:40.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:40.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:40.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:41.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:09:41.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:41.622218+0000) 2019-10-23T14:09:41.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:41.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:41.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:41.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:42.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:42.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:42.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:42.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:43.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:43.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:43.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:43.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:44.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:09:44.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:44.598437+0000) 2019-10-23T14:09:44.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:09:44.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:44.638855+0000) 2019-10-23T14:09:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:44.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:44.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:45.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:45.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:45.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:45.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:46.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:46.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:46.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:46.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:47.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:47.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:47.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:47.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:48.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:09:48.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:48.139681+0000) 2019-10-23T14:09:48.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:48.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:48.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:48.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:49.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:09:49.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:49.120940+0000) 2019-10-23T14:09:49.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:09:49.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:49.135099+0000) 2019-10-23T14:09:49.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:49.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:49.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:49.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:50.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:50.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:50.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:50.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:51.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:09:51.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:51.622317+0000) 2019-10-23T14:09:51.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:51.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:51.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:51.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:52.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:52.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:52.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:52.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:53.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:53.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:53.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:53.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:54.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:09:54.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:54.598555+0000) 2019-10-23T14:09:54.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:09:54.637+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:54.638959+0000) 2019-10-23T14:09:54.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:54.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:54.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:54.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:55.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:55.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:55.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:55.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:56.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:56.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:56.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:57.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:57.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:57.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:57.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:58.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:09:58.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:58.139777+0000) 2019-10-23T14:09:58.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:58.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:58.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:58.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:09:59.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:09:59.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:59.121032+0000) 2019-10-23T14:09:59.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:09:59.133+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:09:59.135193+0000) 2019-10-23T14:09:59.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:59.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:09:59.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:09:59.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:00.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:00.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:00.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:00.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:01.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:10:01.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:01.622413+0000) 2019-10-23T14:10:01.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:01.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:01.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:01.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:02.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:02.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:02.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:02.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:03.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:03.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:03.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:04.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:10:04.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:04.598674+0000) 2019-10-23T14:10:04.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:10:04.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:04.639062+0000) 2019-10-23T14:10:04.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:04.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:04.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:04.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:05.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:05.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:05.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:05.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:06.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:06.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:06.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:06.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:07.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:07.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:07.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:07.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:08.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:10:08.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:08.139877+0000) 2019-10-23T14:10:08.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:08.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:08.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:08.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:09.123 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:10:09.119+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:09.121127+0000) 2019-10-23T14:10:09.137 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:10:09.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:09.135294+0000) 2019-10-23T14:10:09.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:09.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:09.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:09.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:10.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:10.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:10.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:10.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:11.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:10:11.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:11.622527+0000) 2019-10-23T14:10:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:12.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:12.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:13.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:13.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:13.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:13.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:14.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:14.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:14.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:14.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:14.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:10:14.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:14.598798+0000) 2019-10-23T14:10:14.643 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:10:14.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:14.639174+0000) 2019-10-23T14:10:15.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:15.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:15.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:15.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:16.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:16.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:16.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:16.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:17.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:17.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:17.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:17.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:18.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:18.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:18.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:18.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:18.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:10:18.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:18.139975+0000) 2019-10-23T14:10:19.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:10:19.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:19.121221+0000) 2019-10-23T14:10:19.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:10:19.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:19.135389+0000) 2019-10-23T14:10:19.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:19.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:19.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:19.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:20.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:20.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:20.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:20.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:21.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:21.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:21.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:21.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:21.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:10:21.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:21.622623+0000) 2019-10-23T14:10:22.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:22.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:22.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:22.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:23.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:23.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:23.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:23.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:24.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:24.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:24.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:24.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:24.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:10:24.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:24.598913+0000) 2019-10-23T14:10:24.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:10:24.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:24.639281+0000) 2019-10-23T14:10:25.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:25.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:25.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:25.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:26.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:25.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:26.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:25.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:26.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:26.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:26.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:26.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:27.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:27.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:27.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:27.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:28.142 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:10:28.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:28.140073+0000) 2019-10-23T14:10:29.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:29.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:29.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:29.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:29.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:10:29.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:29.121317+0000) 2019-10-23T14:10:29.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:10:29.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:29.135486+0000) 2019-10-23T14:10:29.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:29.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:29.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:29.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:30.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:30.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:30.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:30.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:31.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:10:31.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:31.622720+0000) 2019-10-23T14:10:31.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:31.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:31.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:31.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:33.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:32.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:33.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:32.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:33.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:33.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:33.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:33.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:34.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:10:34.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:34.599026+0000) 2019-10-23T14:10:34.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:10:34.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:34.639389+0000) 2019-10-23T14:10:35.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:35.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:35.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:35.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:36.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:35.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:36.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:36.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:37.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:37.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:37.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:37.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:38.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:38.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:38.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:38.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:38.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:10:38.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:38.140170+0000) 2019-10-23T14:10:39.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:39.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:39.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:39.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:39.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:10:39.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:39.121417+0000) 2019-10-23T14:10:39.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:10:39.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:39.135580+0000) 2019-10-23T14:10:40.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:40.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:40.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:40.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:41.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:41.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:41.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:41.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:41.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:10:41.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:41.622819+0000) 2019-10-23T14:10:42.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:42.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:42.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:42.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:43.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:43.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:43.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:43.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:44.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:44.108+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:44.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:44.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:44.601 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:10:44.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:44.599137+0000) 2019-10-23T14:10:44.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:10:44.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:44.639494+0000) 2019-10-23T14:10:45.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:45.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:45.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:45.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:46.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:46.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:46.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:46.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:47.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:47.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:47.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:47.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:48.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:48.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:48.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:48.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:48.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:10:48.138+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:48.140267+0000) 2019-10-23T14:10:49.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:49.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:49.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:49.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:49.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:10:49.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:49.121508+0000) 2019-10-23T14:10:49.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:10:49.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:49.135675+0000) 2019-10-23T14:10:49.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:49.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:49.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:49.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:51.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:51.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:51.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:51.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:51.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:10:51.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:51.622916+0000) 2019-10-23T14:10:52.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:52.007+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:52.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:52.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:52.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:52.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:52.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:52.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:53.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:53.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:53.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:53.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:54.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:10:54.597+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:54.599252+0000) 2019-10-23T14:10:54.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:10:54.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:54.639602+0000) 2019-10-23T14:10:54.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:54.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:54.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:54.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:55.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:55.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:55.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:55.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:56.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:56.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:56.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:56.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:57.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:57.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:57.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:57.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:58.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:10:58.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:58.140366+0000) 2019-10-23T14:10:58.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:58.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:58.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:58.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:10:59.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:10:59.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:59.121599+0000) 2019-10-23T14:10:59.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:10:59.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:10:59.135769+0000) 2019-10-23T14:10:59.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:59.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:10:59.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:10:59.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:00.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:00.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:00.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:00.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:01.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:11:01.621+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:01.623010+0000) 2019-10-23T14:11:01.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:01.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:01.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:01.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:02.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:02.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:02.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:02.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:04.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:04.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:04.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:04.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:04.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:11:04.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:04.599322+0000) 2019-10-23T14:11:04.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:11:04.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:04.639711+0000) 2019-10-23T14:11:04.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:04.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:04.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:04.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:06.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:06.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:06.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:06.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:07.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:07.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:07.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:07.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:07.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:07.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:07.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:07.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:08.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:11:08.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:08.140459+0000) 2019-10-23T14:11:09.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:08.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:09.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:08.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:09.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:11:09.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:09.121694+0000) 2019-10-23T14:11:09.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:11:09.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:09.135864+0000) 2019-10-23T14:11:10.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:09.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:10.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:09.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:10.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:10.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:10.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:10.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:11.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:11:11.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:11.623106+0000) 2019-10-23T14:11:11.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:11.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:11.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:11.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:12.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:12.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:12.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:12.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:14.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:14.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:14.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:14.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:14.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:11:14.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:14.599440+0000) 2019-10-23T14:11:14.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:11:14.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:14.639821+0000) 2019-10-23T14:11:15.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:15.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:15.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:15.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:16.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:16.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:16.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:16.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:17.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:17.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:17.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:17.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:17.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:17.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:17.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:17.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:18.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:11:18.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:18.140553+0000) 2019-10-23T14:11:18.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:18.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:18.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:18.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:19.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:11:19.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:19.121791+0000) 2019-10-23T14:11:19.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:11:19.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:19.135955+0000) 2019-10-23T14:11:20.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:20.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:20.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:20.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:21.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:21.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:21.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:21.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:21.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:11:21.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:21.623205+0000) 2019-10-23T14:11:21.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:21.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:21.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:21.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:22.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:22.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:22.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:22.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:24.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:24.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:24.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:24.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:24.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:11:24.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:24.599550+0000) 2019-10-23T14:11:24.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:11:24.638+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:24.639932+0000) 2019-10-23T14:11:25.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:25.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:25.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:25.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:26.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:25.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:26.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:25.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:26.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:26.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:26.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:26.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:27.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:27.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:27.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:27.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:28.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:11:28.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:28.140651+0000) 2019-10-23T14:11:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:28.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:28.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:29.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:11:29.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:29.121888+0000) 2019-10-23T14:11:29.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:11:29.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:29.136053+0000) 2019-10-23T14:11:29.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:29.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:29.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:29.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:30.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:30.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:30.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:30.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:31.627 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:11:31.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:31.623303+0000) 2019-10-23T14:11:31.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:31.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:31.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:31.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:32.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:32.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:32.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:32.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:33.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:33.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:33.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:33.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:34.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:11:34.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:34.599661+0000) 2019-10-23T14:11:34.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:11:34.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:34.640047+0000) 2019-10-23T14:11:34.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:34.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:34.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:34.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:35.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:35.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:35.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:35.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:36.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:36.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:36.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:36.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:37.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:37.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:37.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:37.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:38.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:11:38.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:38.140741+0000) 2019-10-23T14:11:38.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:38.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:38.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:38.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:39.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:11:39.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:39.121986+0000) 2019-10-23T14:11:39.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:11:39.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:39.136150+0000) 2019-10-23T14:11:39.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:39.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:39.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:39.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:40.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:40.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:40.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:40.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:41.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:11:41.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:41.623400+0000) 2019-10-23T14:11:41.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:41.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:41.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:41.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:42.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:42.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:42.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:42.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:43.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:43.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:43.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:43.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:44.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:11:44.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:44.599776+0000) 2019-10-23T14:11:44.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:11:44.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:44.640154+0000) 2019-10-23T14:11:44.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:44.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:44.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:44.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:45.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:45.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:45.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:45.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:46.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:46.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:46.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:46.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:47.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:47.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:47.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:47.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:48.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:11:48.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:48.140836+0000) 2019-10-23T14:11:48.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:48.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:48.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:48.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:49.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:11:49.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:49.122085+0000) 2019-10-23T14:11:49.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:11:49.134+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:49.136244+0000) 2019-10-23T14:11:49.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:49.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:49.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:49.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:50.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:50.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:50.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:50.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:51.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:11:51.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:51.623497+0000) 2019-10-23T14:11:51.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:51.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:51.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:51.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:52.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:52.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:52.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:52.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:53.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:53.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:53.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:53.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:54.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:11:54.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:54.599888+0000) 2019-10-23T14:11:54.644 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:11:54.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:54.640261+0000) 2019-10-23T14:11:54.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:54.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:54.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:54.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:55.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:55.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:55.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:55.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:56.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:56.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:56.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:56.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:57.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:57.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:57.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:57.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:58.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:11:58.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:58.140935+0000) 2019-10-23T14:11:58.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:58.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:58.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:58.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:11:59.124 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:11:59.120+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:59.122184+0000) 2019-10-23T14:11:59.138 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:11:59.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:11:59.136298+0000) 2019-10-23T14:11:59.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:59.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:11:59.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:11:59.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:00.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:00.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:00.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:00.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:01.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:01.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:01.623591+0000) 2019-10-23T14:12:01.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:01.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:01.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:01.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:02.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:02.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:02.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:02.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:03.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:03.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:03.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:03.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:04.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:12:04.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:04.599996+0000) 2019-10-23T14:12:04.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:12:04.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:04.640371+0000) 2019-10-23T14:12:04.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:04.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:04.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:04.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:05.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:05.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:05.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:05.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:06.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:06.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:06.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:06.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:07.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:07.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:07.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:07.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:08.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:12:08.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:08.141029+0000) 2019-10-23T14:12:08.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:08.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:08.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:08.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:09.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:12:09.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:09.122286+0000) 2019-10-23T14:12:09.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:12:09.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:09.136394+0000) 2019-10-23T14:12:09.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:09.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:09.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:09.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:10.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:10.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:10.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:10.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:11.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:11.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:11.623685+0000) 2019-10-23T14:12:11.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:11.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:11.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:11.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:12.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:12.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:12.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:12.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:13.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:13.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:13.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:13.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:14.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:12:14.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:14.600112+0000) 2019-10-23T14:12:14.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:12:14.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:14.640478+0000) 2019-10-23T14:12:14.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:14.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:14.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:14.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:15.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:15.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:15.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:15.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:16.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:16.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:16.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:16.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:17.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:17.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:17.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:17.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:18.143 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:12:18.139+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:18.141126+0000) 2019-10-23T14:12:18.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:18.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:18.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:18.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:19.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:12:19.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:19.122384+0000) 2019-10-23T14:12:19.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:12:19.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:19.136491+0000) 2019-10-23T14:12:19.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:19.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:19.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:19.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:20.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:20.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:20.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:20.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:21.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:21.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:21.623774+0000) 2019-10-23T14:12:21.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:21.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:21.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:21.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:22.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:22.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:22.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:22.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:23.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:23.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:23.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:23.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:24.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:12:24.598+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:24.600226+0000) 2019-10-23T14:12:24.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:12:24.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:24.640586+0000) 2019-10-23T14:12:24.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:24.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:24.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:24.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:25.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:25.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:25.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:25.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:26.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:26.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:26.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:26.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:27.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:27.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:27.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:27.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:28.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:12:28.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:28.141223+0000) 2019-10-23T14:12:28.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:28.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:28.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:28.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:29.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:12:29.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:29.122482+0000) 2019-10-23T14:12:29.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:12:29.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:29.136585+0000) 2019-10-23T14:12:29.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:29.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:29.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:29.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:30.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:30.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:30.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:30.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:31.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:31.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:31.623866+0000) 2019-10-23T14:12:31.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:31.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:31.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:31.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:32.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:32.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:32.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:32.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:33.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:33.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:33.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:33.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:34.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:12:34.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:34.600323+0000) 2019-10-23T14:12:34.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:12:34.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:34.640694+0000) 2019-10-23T14:12:34.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:34.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:34.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:34.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:35.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:35.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:35.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:35.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:36.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:36.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:36.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:36.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:37.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:37.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:37.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:37.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:38.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:12:38.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:38.141320+0000) 2019-10-23T14:12:38.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:38.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:38.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:38.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:39.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:12:39.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:39.122579+0000) 2019-10-23T14:12:39.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:12:39.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:39.136678+0000) 2019-10-23T14:12:39.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:39.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:39.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:39.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:40.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:40.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:40.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:40.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:41.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:41.622+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:41.623953+0000) 2019-10-23T14:12:41.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:41.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:41.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:41.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:42.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:42.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:42.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:42.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:43.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:43.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:43.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:43.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:44.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:12:44.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:44.600445+0000) 2019-10-23T14:12:44.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:44.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:44.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:44.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:44.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:12:44.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:44.640805+0000) 2019-10-23T14:12:45.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:45.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:45.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:45.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:46.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:46.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:46.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:46.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:47.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:47.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:47.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:47.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:48.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:12:48.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:48.141419+0000) 2019-10-23T14:12:48.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:48.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:48.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:48.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:49.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:12:49.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:49.122675+0000) 2019-10-23T14:12:49.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:12:49.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:49.136774+0000) 2019-10-23T14:12:49.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:49.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:49.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:49.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:50.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:50.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:50.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:50.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:51.628 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:51.623+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:51.624037+0000) 2019-10-23T14:12:51.629 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:51.623+0000 7f2d2295b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:51.624672+0000) 2019-10-23T14:12:51.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:51.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:51.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:51.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:52.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:52.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:52.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:52.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:53.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:53.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:53.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:53.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:54.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:12:54.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:54.600563+0000) 2019-10-23T14:12:54.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:12:54.639+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:54.640914+0000) 2019-10-23T14:12:54.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:54.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:54.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:54.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:55.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:55.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:55.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:55.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:56.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:12:56.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:56.124236+0000) 2019-10-23T14:12:56.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:56.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:56.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:56.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:57.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:57.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:57.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:57.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:58.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:12:58.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:58.141520+0000) 2019-10-23T14:12:58.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:58.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:58.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:58.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:12:59.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:12:59.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:59.122768+0000) 2019-10-23T14:12:59.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:12:59.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:12:59.136872+0000) 2019-10-23T14:12:59.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:59.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:12:59.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:12:59.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:00.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:00.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:00.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:00.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:01.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:01.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:01.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:01.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:02.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:02.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:02.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:02.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:03.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:03.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:03.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:03.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:04.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:13:04.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:04.600678+0000) 2019-10-23T14:13:04.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:13:04.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:04.641032+0000) 2019-10-23T14:13:04.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:04.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:04.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:04.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:05.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:05.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:05.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:05.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:06.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:13:06.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:06.124331+0000) 2019-10-23T14:13:06.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:06.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:06.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:06.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:07.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:07.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:07.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:07.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:08.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:13:08.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:08.141617+0000) 2019-10-23T14:13:08.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:08.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:08.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:08.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:09.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:13:09.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:09.122867+0000) 2019-10-23T14:13:09.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:13:09.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:09.136965+0000) 2019-10-23T14:13:09.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:09.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:09.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:09.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:10.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:10.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:10.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:10.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:11.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:11.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:11.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:11.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:12.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:12.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:12.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:12.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:13.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:13.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:13.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:13.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:14.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:13:14.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:14.600789+0000) 2019-10-23T14:13:14.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:13:14.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:14.641142+0000) 2019-10-23T14:13:14.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:14.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:14.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:14.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:15.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:15.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:15.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:15.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:16.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:13:16.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:16.124428+0000) 2019-10-23T14:13:16.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:16.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:16.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:16.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:17.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:17.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:17.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:17.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:18.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:13:18.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:18.141716+0000) 2019-10-23T14:13:18.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:18.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:18.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:18.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:19.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:13:19.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:19.122968+0000) 2019-10-23T14:13:19.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:13:19.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:19.137067+0000) 2019-10-23T14:13:19.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:19.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:19.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:19.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:20.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:20.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:20.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:20.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:21.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:21.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:21.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:21.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:22.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:22.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:23.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:23.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:23.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:23.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:24.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:13:24.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:24.600901+0000) 2019-10-23T14:13:24.645 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:13:24.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:24.641252+0000) 2019-10-23T14:13:24.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:24.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:24.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:24.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:25.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:25.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:25.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:25.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:26.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:13:26.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:26.124527+0000) 2019-10-23T14:13:26.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:26.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:26.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:26.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:27.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:27.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:27.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:27.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:28.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:13:28.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:28.141808+0000) 2019-10-23T14:13:28.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:28.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:28.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:28.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:29.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:13:29.121+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:29.123065+0000) 2019-10-23T14:13:29.139 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:13:29.135+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:29.137167+0000) 2019-10-23T14:13:29.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:29.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:29.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:29.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:30.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:30.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:30.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:30.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:31.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:31.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:31.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:31.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:32.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:32.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:32.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:32.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:33.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:33.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:33.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:33.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:34.603 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:13:34.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:34.601018+0000) 2019-10-23T14:13:34.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:13:34.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:34.641360+0000) 2019-10-23T14:13:34.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:34.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:34.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:34.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:35.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:35.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:35.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:35.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:36.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:13:36.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:36.124625+0000) 2019-10-23T14:13:36.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:36.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:36.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:36.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:37.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:37.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:37.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:37.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:38.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:13:38.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:38.141909+0000) 2019-10-23T14:13:38.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:38.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:38.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:38.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:39.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:13:39.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:39.123162+0000) 2019-10-23T14:13:39.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:13:39.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:39.137266+0000) 2019-10-23T14:13:39.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:39.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:39.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:39.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:40.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:40.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:40.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:40.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:41.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:41.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:41.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:41.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:42.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:42.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:42.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:42.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:43.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:43.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:43.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:43.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:44.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:13:44.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:44.601140+0000) 2019-10-23T14:13:44.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:13:44.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:44.641466+0000) 2019-10-23T14:13:44.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:44.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:44.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:44.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:45.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:45.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:45.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:45.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:46.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:13:46.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:46.124724+0000) 2019-10-23T14:13:46.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:46.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:46.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:46.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:47.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:47.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:47.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:47.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:48.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:13:48.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:48.142006+0000) 2019-10-23T14:13:48.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:48.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:48.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:48.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:49.125 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:13:49.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:49.123254+0000) 2019-10-23T14:13:49.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:13:49.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:49.137367+0000) 2019-10-23T14:13:49.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:49.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:49.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:49.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:50.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:50.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:50.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:50.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:51.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:51.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:51.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:51.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:52.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:52.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:52.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:52.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:53.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:53.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:53.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:53.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:54.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:13:54.599+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:54.601250+0000) 2019-10-23T14:13:54.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:13:54.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:54.641573+0000) 2019-10-23T14:13:54.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:54.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:54.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:54.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:55.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:55.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:55.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:55.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:56.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:13:56.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:56.124817+0000) 2019-10-23T14:13:56.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:56.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:56.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:56.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:57.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:57.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:57.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:57.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:58.144 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:13:58.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:58.142102+0000) 2019-10-23T14:13:58.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:58.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:58.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:58.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:13:59.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:13:59.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:59.123356+0000) 2019-10-23T14:13:59.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:13:59.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:13:59.137457+0000) 2019-10-23T14:13:59.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:59.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:13:59.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:13:59.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:00.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:00.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:00.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:00.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:01.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:01.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:01.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:01.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:02.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:02.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:02.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:02.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:03.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:03.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:03.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:03.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:04.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:14:04.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:04.601328+0000) 2019-10-23T14:14:04.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:14:04.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:04.641681+0000) 2019-10-23T14:14:04.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:04.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:04.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:04.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:05.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:05.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:05.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:05.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:06.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:14:06.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:06.124910+0000) 2019-10-23T14:14:06.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:06.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:06.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:06.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:07.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:07.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:07.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:07.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:08.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:14:08.140+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:08.142202+0000) 2019-10-23T14:14:08.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:08.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:08.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:08.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:09.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:14:09.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:09.123457+0000) 2019-10-23T14:14:09.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:14:09.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:09.137554+0000) 2019-10-23T14:14:09.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:09.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:09.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:09.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:10.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:10.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:10.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:10.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:11.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:11.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:11.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:11.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:12.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:12.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:12.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:12.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:13.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:13.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:13.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:13.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:14.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:14:14.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:14.601442+0000) 2019-10-23T14:14:14.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:14:14.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:14.641787+0000) 2019-10-23T14:14:14.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:14.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:14.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:14.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:15.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:15.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:15.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:15.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:16.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:14:16.123+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:16.125007+0000) 2019-10-23T14:14:16.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:16.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:16.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:16.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:17.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:17.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:17.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:17.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:18.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:14:18.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:18.142301+0000) 2019-10-23T14:14:18.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:18.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:18.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:18.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:19.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:14:19.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:19.123558+0000) 2019-10-23T14:14:19.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:14:19.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:19.137654+0000) 2019-10-23T14:14:19.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:19.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:19.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:19.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:20.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:20.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:20.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:20.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:21.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:21.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:21.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:21.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:22.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:22.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:22.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:22.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:23.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:23.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:23.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:23.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:24.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:14:24.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:24.601568+0000) 2019-10-23T14:14:24.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:14:24.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:24.641894+0000) 2019-10-23T14:14:24.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:24.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:24.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:24.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:25.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:25.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:25.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:25.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:26.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:14:26.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:26.125109+0000) 2019-10-23T14:14:26.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:26.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:26.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:26.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:27.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:27.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:27.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:27.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:28.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:14:28.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:28.142398+0000) 2019-10-23T14:14:28.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:28.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:28.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:28.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:29.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:14:29.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:29.123654+0000) 2019-10-23T14:14:29.144 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:14:29.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:29.137750+0000) 2019-10-23T14:14:29.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:29.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:29.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:29.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:30.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:30.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:30.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:30.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:31.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:31.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:31.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:31.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:32.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:32.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:32.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:32.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:33.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:33.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:33.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:33.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:34.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:14:34.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:34.601692+0000) 2019-10-23T14:14:34.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:14:34.640+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:34.642001+0000) 2019-10-23T14:14:34.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:34.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:34.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:34.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:35.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:35.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:35.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:35.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:36.129 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:14:36.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:36.125205+0000) 2019-10-23T14:14:36.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:36.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:36.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:36.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:37.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:37.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:38.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:14:38.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:38.142493+0000) 2019-10-23T14:14:38.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:38.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:38.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:38.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:39.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:14:39.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:39.123749+0000) 2019-10-23T14:14:39.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:14:39.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:39.137844+0000) 2019-10-23T14:14:39.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:39.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:39.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:39.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:40.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:40.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:40.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:40.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:41.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:41.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:41.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:41.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:42.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:42.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:42.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:42.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:43.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:43.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:43.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:43.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:44.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:14:44.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:44.601810+0000) 2019-10-23T14:14:44.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:14:44.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:44.642109+0000) 2019-10-23T14:14:44.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:44.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:44.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:44.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:45.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:45.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:45.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:45.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:46.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:14:46.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:46.125303+0000) 2019-10-23T14:14:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:46.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:46.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:46.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:47.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:47.775+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:47.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:47.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:48.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:14:48.142+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:48.142591+0000) 2019-10-23T14:14:48.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:48.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:48.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:48.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:49.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:14:49.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:49.123849+0000) 2019-10-23T14:14:49.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:14:49.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:49.137943+0000) 2019-10-23T14:14:49.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:49.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:49.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:49.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:50.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:50.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:50.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:50.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:51.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:51.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:51.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:51.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:52.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:52.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:52.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:52.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:53.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:53.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:53.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:53.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:54.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:14:54.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:54.601924+0000) 2019-10-23T14:14:54.646 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:14:54.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:54.642219+0000) 2019-10-23T14:14:54.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:54.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:54.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:54.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:55.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:55.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:55.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:55.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:56.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:14:56.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:56.125396+0000) 2019-10-23T14:14:56.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:56.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:56.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:56.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:57.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:57.693+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:57.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:57.693+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:58.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:14:58.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:58.142686+0000) 2019-10-23T14:14:58.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:58.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:58.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:58.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:14:59.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:14:59.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:59.123946+0000) 2019-10-23T14:14:59.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:14:59.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:14:59.138038+0000) 2019-10-23T14:14:59.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:59.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:14:59.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:14:59.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:00.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:00.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:00.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:00.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:01.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:01.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:01.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:01.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:02.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:02.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:02.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:02.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:03.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:03.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:03.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:03.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:04.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:15:04.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:04.602035+0000) 2019-10-23T14:15:04.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:15:04.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:04.642328+0000) 2019-10-23T14:15:04.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:04.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:04.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:04.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:05.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:05.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:05.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:05.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:06.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:15:06.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:06.125493+0000) 2019-10-23T14:15:06.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:06.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:06.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:06.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:07.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:07.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:07.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:07.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:08.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:15:08.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:08.142781+0000) 2019-10-23T14:15:08.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:08.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:08.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:08.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:09.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:15:09.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:09.124045+0000) 2019-10-23T14:15:09.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:15:09.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:09.138133+0000) 2019-10-23T14:15:09.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:09.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:09.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:09.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:10.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:10.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:10.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:10.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:11.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:11.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:11.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:11.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:12.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:12.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:12.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:12.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:13.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:13.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:13.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:13.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:14.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:15:14.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:14.602151+0000) 2019-10-23T14:15:14.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:15:14.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:14.642432+0000) 2019-10-23T14:15:14.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:14.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:14.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:14.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:15.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:15.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:15.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:15.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:16.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:15:16.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:16.125590+0000) 2019-10-23T14:15:16.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:16.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:16.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:16.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:17.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:17.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:17.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:17.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:18.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:15:18.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:18.142880+0000) 2019-10-23T14:15:18.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:18.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:18.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:18.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:19.126 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:15:19.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:19.124139+0000) 2019-10-23T14:15:19.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:15:19.136+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:19.138226+0000) 2019-10-23T14:15:19.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:19.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:19.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:19.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:20.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:20.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:20.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:20.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:21.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:21.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:21.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:21.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:22.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:22.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:22.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:22.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:23.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:23.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:23.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:23.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:24.604 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:15:24.600+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:24.602266+0000) 2019-10-23T14:15:24.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:24.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:24.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:24.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:24.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:15:24.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:24.642539+0000) 2019-10-23T14:15:25.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:25.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:25.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:25.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:26.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:15:26.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:26.125687+0000) 2019-10-23T14:15:26.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:26.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:26.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:26.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:27.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:27.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:27.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:27.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:28.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:15:28.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:28.142977+0000) 2019-10-23T14:15:28.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:28.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:28.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:28.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:29.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:15:29.122+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:29.124232+0000) 2019-10-23T14:15:29.140 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:15:29.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:29.138317+0000) 2019-10-23T14:15:29.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:29.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:29.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:29.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:30.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:30.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:30.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:30.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:31.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:31.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:31.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:31.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:32.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:32.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:32.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:32.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:33.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:33.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:33.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:33.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:34.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:15:34.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:34.602380+0000) 2019-10-23T14:15:34.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:15:34.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:34.642650+0000) 2019-10-23T14:15:34.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:34.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:34.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:34.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:35.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:35.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:35.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:35.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:36.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:15:36.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:36.125779+0000) 2019-10-23T14:15:36.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:36.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:36.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:36.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:37.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:37.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:37.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:37.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:38.146 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:15:38.141+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:38.143075+0000) 2019-10-23T14:15:38.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:38.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:38.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:38.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:39.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:15:39.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:39.124327+0000) 2019-10-23T14:15:39.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:15:39.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:39.138411+0000) 2019-10-23T14:15:39.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:39.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:39.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:39.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:40.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:40.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:40.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:40.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:41.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:41.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:41.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:41.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:42.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:42.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:42.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:42.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:43.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:43.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:43.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:43.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:44.613 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:15:44.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:44.602490+0000) 2019-10-23T14:15:44.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:15:44.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:44.642758+0000) 2019-10-23T14:15:44.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:44.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:44.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:44.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:45.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:45.868+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:45.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:45.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:46.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:15:46.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:46.125873+0000) 2019-10-23T14:15:46.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:46.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:46.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:46.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:47.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:47.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:47.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:47.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:48.145 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:15:48.142+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:48.143172+0000) 2019-10-23T14:15:48.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:48.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:48.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:48.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:49.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:15:49.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:49.124418+0000) 2019-10-23T14:15:49.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:15:49.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:49.138506+0000) 2019-10-23T14:15:49.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:49.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:49.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:49.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:50.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:50.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:50.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:50.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:51.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:51.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:51.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:51.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:52.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:52.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:52.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:52.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:53.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:53.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:53.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:53.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:54.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:15:54.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:54.602602+0000) 2019-10-23T14:15:54.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:15:54.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:54.642865+0000) 2019-10-23T14:15:54.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:54.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:54.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:54.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:55.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:55.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:55.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:55.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:56.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:15:56.124+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:56.125969+0000) 2019-10-23T14:15:56.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:56.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:56.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:56.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:57.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:57.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:57.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:57.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:58.146 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:15:58.142+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:58.143269+0000) 2019-10-23T14:15:58.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:58.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:58.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:58.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:15:59.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:15:59.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:59.124512+0000) 2019-10-23T14:15:59.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:15:59.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:15:59.138600+0000) 2019-10-23T14:15:59.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:59.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:15:59.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:15:59.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:01.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:01.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:01.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:01.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:02.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:02.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:02.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:02.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:03.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:03.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:03.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:03.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:04.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:04.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:04.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:04.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:04.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:16:04.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:04.602719+0000) 2019-10-23T14:16:04.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:16:04.641+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:04.642969+0000) 2019-10-23T14:16:04.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:04.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:04.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:04.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:05.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:05.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:05.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:05.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:06.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:16:06.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:06.126067+0000) 2019-10-23T14:16:06.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:06.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:06.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:06.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:07.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:07.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:07.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:07.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:08.146 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:08.142+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:08.143363+0000) 2019-10-23T14:16:08.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:08.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:08.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:08.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:09.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:16:09.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:09.124609+0000) 2019-10-23T14:16:09.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:16:09.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:09.138699+0000) 2019-10-23T14:16:09.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:09.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:09.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:09.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:11.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:10.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:11.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:10.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:11.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:11.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:11.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:11.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:12.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:12.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:12.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:12.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:13.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:13.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:13.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:13.916+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:14.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:16:14.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:14.602835+0000) 2019-10-23T14:16:14.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:16:14.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:14.643075+0000) 2019-10-23T14:16:14.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:14.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:14.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:14.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:15.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:15.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:15.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:15.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:16.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:16:16.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:16.126161+0000) 2019-10-23T14:16:16.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:16.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:16.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:16.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:17.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:17.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:17.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:17.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:18.146 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:18.142+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:18.143456+0000) 2019-10-23T14:16:18.146 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:18.142+0000 7fc3e2687700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:18.144105+0000) 2019-10-23T14:16:19.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:19.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:19.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:19.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:19.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:16:19.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:19.124699+0000) 2019-10-23T14:16:19.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:16:19.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:19.138795+0000) 2019-10-23T14:16:20.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:20.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:20.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:20.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:21.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:21.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:21.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:22.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:22.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:22.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:22.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:22.646 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:22.642+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:22.643634+0000) 2019-10-23T14:16:23.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:23.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:23.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:23.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:24.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:24.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:24.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:24.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:24.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:16:24.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:24.602946+0000) 2019-10-23T14:16:24.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:16:24.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:24.643185+0000) 2019-10-23T14:16:25.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:25.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:25.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:25.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:26.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:26.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:26.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:26.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:26.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:16:26.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:26.126255+0000) 2019-10-23T14:16:27.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:27.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:27.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:27.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:28.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:28.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:28.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:28.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:29.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:29.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:29.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:29.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:29.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:16:29.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:29.124797+0000) 2019-10-23T14:16:29.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:16:29.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:29.138891+0000) 2019-10-23T14:16:30.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:30.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:30.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:30.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:31.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:31.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:31.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:31.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:32.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:32.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:32.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:32.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:32.646 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:32.642+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:32.643729+0000) 2019-10-23T14:16:32.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:32.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:32.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:32.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:33.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:33.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:33.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:33.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:34.605 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:16:34.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:34.603060+0000) 2019-10-23T14:16:34.647 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:16:34.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:34.643294+0000) 2019-10-23T14:16:34.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:34.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:34.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:34.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:35.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:35.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:35.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:35.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:36.130 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:16:36.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:36.126349+0000) 2019-10-23T14:16:36.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:36.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:36.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:36.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:38.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:37.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:38.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:37.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:38.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:38.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:38.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:38.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:39.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:16:39.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:39.124893+0000) 2019-10-23T14:16:39.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:16:39.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:39.138988+0000) 2019-10-23T14:16:39.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:39.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:39.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:39.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:40.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:40.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:40.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:40.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:41.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:41.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:41.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:41.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:42.646 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:42.642+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:42.643825+0000) 2019-10-23T14:16:42.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:42.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:42.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:42.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:43.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:43.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:43.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:43.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:44.609 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:16:44.601+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:44.603171+0000) 2019-10-23T14:16:44.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:16:44.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:44.643401+0000) 2019-10-23T14:16:44.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:44.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:44.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:44.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:45.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:45.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:45.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:45.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:46.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:16:46.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:46.126444+0000) 2019-10-23T14:16:46.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:46.941+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:46.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:46.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:47.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:47.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:47.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:47.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:48.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:48.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:48.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:48.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:49.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:16:49.123+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:49.124991+0000) 2019-10-23T14:16:49.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:16:49.137+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:49.139081+0000) 2019-10-23T14:16:49.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:49.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:49.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:49.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:50.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:50.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:50.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:50.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:51.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:51.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:51.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:51.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:52.646 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:16:52.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:52.643919+0000) 2019-10-23T14:16:52.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:52.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:52.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:52.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:53.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:53.932+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:53.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:53.932+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:54.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:16:54.603+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:54.603296+0000) 2019-10-23T14:16:54.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:16:54.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:54.643507+0000) 2019-10-23T14:16:54.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:54.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:54.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:54.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:55.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:55.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:55.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:55.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:56.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:16:56.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:56.126542+0000) 2019-10-23T14:16:56.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:56.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:56.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:56.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:57.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:57.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:57.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:57.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:58.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:58.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:58.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:58.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:16:59.127 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:16:59.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:59.125091+0000) 2019-10-23T14:16:59.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:16:59.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:16:59.139175+0000) 2019-10-23T14:16:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:59.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:16:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:16:59.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:00.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:00.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:00.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:00.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:01.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:01.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:01.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:01.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:02.646 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:17:02.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:02.644019+0000) 2019-10-23T14:17:02.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:02.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:02.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:02.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:03.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:03.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:03.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:03.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:04.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:17:04.603+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:04.603409+0000) 2019-10-23T14:17:04.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:17:04.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:04.643614+0000) 2019-10-23T14:17:04.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:04.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:04.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:04.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:05.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:05.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:05.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:05.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:06.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:17:06.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:06.126635+0000) 2019-10-23T14:17:06.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:06.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:06.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:06.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:07.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:07.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:07.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:07.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:08.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:08.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:08.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:08.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:09.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:17:09.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:09.125188+0000) 2019-10-23T14:17:09.141 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:17:09.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:09.139268+0000) 2019-10-23T14:17:09.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:09.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:09.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:09.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:10.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:10.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:10.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:10.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:11.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:11.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:11.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:11.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:12.646 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:17:12.642+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:12.644112+0000) 2019-10-23T14:17:12.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:12.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:12.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:12.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:13.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:13.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:13.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:13.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:14.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:17:14.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:14.603516+0000) 2019-10-23T14:17:14.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:17:14.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:14.643721+0000) 2019-10-23T14:17:14.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:14.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:14.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:14.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:15.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:15.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:15.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:15.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:16.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:17:16.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:16.126732+0000) 2019-10-23T14:17:16.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:16.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:16.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:16.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:17.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:17.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:17.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:17.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:18.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:18.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:18.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:18.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:19.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:17:19.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:19.125283+0000) 2019-10-23T14:17:19.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:17:19.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:19.139368+0000) 2019-10-23T14:17:19.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:19.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:19.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:19.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:20.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:20.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:20.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:20.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:21.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:21.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:21.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:21.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:22.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:17:22.642+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:22.644204+0000) 2019-10-23T14:17:22.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:22.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:22.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:22.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:23.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:23.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:23.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:23.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:24.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:17:24.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:24.603624+0000) 2019-10-23T14:17:24.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:17:24.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:24.643828+0000) 2019-10-23T14:17:24.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:24.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:24.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:24.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:25.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:25.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:25.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:25.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:26.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:17:26.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:26.126828+0000) 2019-10-23T14:17:26.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:26.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:26.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:26.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:27.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:27.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:27.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:27.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:28.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:28.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:28.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:28.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:29.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:17:29.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:29.125385+0000) 2019-10-23T14:17:29.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:17:29.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:29.139464+0000) 2019-10-23T14:17:29.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:29.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:29.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:29.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:30.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:30.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:30.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:30.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:31.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:31.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:31.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:31.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:32.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:17:32.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:32.644298+0000) 2019-10-23T14:17:32.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:32.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:32.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:32.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:33.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:33.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:33.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:33.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:34.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:17:34.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:34.603736+0000) 2019-10-23T14:17:34.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:17:34.642+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:34.643935+0000) 2019-10-23T14:17:34.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:34.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:34.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:34.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:35.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:35.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:35.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:35.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:36.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:17:36.125+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:36.126923+0000) 2019-10-23T14:17:36.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:36.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:36.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:36.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:37.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:37.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:37.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:37.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:38.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:38.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:38.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:38.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:39.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:17:39.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:39.125487+0000) 2019-10-23T14:17:39.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:17:39.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:39.139562+0000) 2019-10-23T14:17:39.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:39.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:39.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:39.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:40.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:40.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:40.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:40.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:41.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:41.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:41.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:41.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:42.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:17:42.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:42.644397+0000) 2019-10-23T14:17:42.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:42.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:42.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:42.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:43.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:43.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:43.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:43.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:44.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:17:44.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:44.603850+0000) 2019-10-23T14:17:44.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:17:44.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:44.644052+0000) 2019-10-23T14:17:44.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:44.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:44.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:44.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:45.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:45.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:45.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:45.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:46.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:17:46.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:46.127019+0000) 2019-10-23T14:17:46.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:46.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:46.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:46.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:47.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:47.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:47.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:47.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:48.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:48.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:48.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:48.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:49.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:17:49.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:49.125591+0000) 2019-10-23T14:17:49.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:17:49.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:49.139662+0000) 2019-10-23T14:17:49.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:49.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:49.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:49.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:50.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:50.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:50.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:50.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:51.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:51.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:51.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:51.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:52.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:17:52.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:52.644498+0000) 2019-10-23T14:17:52.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:52.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:52.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:52.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:53.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:53.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:53.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:53.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:54.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:17:54.602+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:54.603961+0000) 2019-10-23T14:17:54.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:17:54.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:54.644159+0000) 2019-10-23T14:17:54.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:54.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:54.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:54.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:55.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:55.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:55.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:55.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:56.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:17:56.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:56.127119+0000) 2019-10-23T14:17:56.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:56.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:56.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:56.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:57.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:57.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:57.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:57.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:58.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:58.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:58.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:58.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:17:59.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:17:59.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:59.125688+0000) 2019-10-23T14:17:59.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:17:59.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:17:59.139757+0000) 2019-10-23T14:17:59.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:59.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:17:59.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:17:59.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:00.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:00.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:18:00.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:00.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:01.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:01.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:18:01.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:01.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:02.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:18:02.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:02.644595+0000) 2019-10-23T14:18:02.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:02.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:18:02.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:02.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:03.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:03.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:07:27.086348+0000 (oldest deadline 2019-10-23T14:07:47.086348+0000) 2019-10-23T14:18:03.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:03.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:04.606 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:04.603+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:04.604074+0000) 2019-10-23T14:18:04.648 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:18:04.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:04.644267+0000) 2019-10-23T14:18:04.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:04.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:05.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:05.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:06.131 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:18:06.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:06.127217+0000) 2019-10-23T14:18:06.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:06.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:07.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:07.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:08.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:08.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:09.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:18:09.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:09.125786+0000) 2019-10-23T14:18:09.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:18:09.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:09.139857+0000) 2019-10-23T14:18:09.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:09.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:10.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:10.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:11.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:11.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:12.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:18:12.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:12.644695+0000) 2019-10-23T14:18:12.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:12.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:13.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:13.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:14.607 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:14.603+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:14.604183+0000) 2019-10-23T14:18:14.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:18:14.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:14.644370+0000) 2019-10-23T14:18:14.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:14.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:15.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:15.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:16.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:18:16.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:16.127311+0000) 2019-10-23T14:18:16.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:16.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:17.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:17.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:18.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:18.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:19.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:18:19.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:19.125887+0000) 2019-10-23T14:18:19.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:18:19.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:19.139958+0000) 2019-10-23T14:18:19.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:19.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:20.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:20.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:21.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:21.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:22.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:18:22.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:22.644795+0000) 2019-10-23T14:18:22.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:22.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:23.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:23.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:24.607 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:24.603+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:24.604291+0000) 2019-10-23T14:18:24.607 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:24.603+0000 7f0f60258700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:24.604883+0000) 2019-10-23T14:18:24.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:18:24.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:24.644474+0000) 2019-10-23T14:18:24.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:24.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:25.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:25.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:26.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:18:26.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:26.127404+0000) 2019-10-23T14:18:26.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:26.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:26.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:26.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:27.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:27.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:27.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:27.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:28.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:28.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:28.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:28.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:29.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:29.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:29.104468+0000) 2019-10-23T14:18:29.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:18:29.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:29.125984+0000) 2019-10-23T14:18:29.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:18:29.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:29.140054+0000) 2019-10-23T14:18:29.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:29.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:29.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:29.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:30.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:30.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:30.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:30.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:31.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:31.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:31.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:31.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:32.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:18:32.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:32.644893+0000) 2019-10-23T14:18:32.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:32.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:32.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:32.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:33.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:33.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:33.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:33.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:34.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:18:34.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:34.644580+0000) 2019-10-23T14:18:34.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:34.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:34.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:34.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:35.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:35.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:35.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:35.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:36.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:18:36.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:36.127501+0000) 2019-10-23T14:18:36.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:36.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:36.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:36.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:37.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:37.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:37.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:37.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:38.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:38.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:38.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:38.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:39.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:39.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:39.104562+0000) 2019-10-23T14:18:39.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:18:39.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:39.126081+0000) 2019-10-23T14:18:39.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:18:39.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:39.140144+0000) 2019-10-23T14:18:39.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:39.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:39.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:39.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:40.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:40.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:40.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:40.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:41.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:41.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:41.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:41.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:42.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:18:42.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:42.644991+0000) 2019-10-23T14:18:42.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:42.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:42.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:42.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:43.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:43.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:43.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:43.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:44.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:18:44.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:44.644686+0000) 2019-10-23T14:18:44.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:44.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:44.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:44.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:45.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:45.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:45.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:45.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:46.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:18:46.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:46.127595+0000) 2019-10-23T14:18:46.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:46.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:46.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:46.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:47.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:47.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:47.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:47.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:48.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:48.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:48.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:48.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:49.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:49.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:49.104656+0000) 2019-10-23T14:18:49.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:18:49.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:49.126178+0000) 2019-10-23T14:18:49.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:18:49.138+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:49.140238+0000) 2019-10-23T14:18:49.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:49.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:49.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:49.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:50.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:50.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:50.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:50.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:51.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:51.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:51.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:51.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:52.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:18:52.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:52.645087+0000) 2019-10-23T14:18:52.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:52.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:52.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:52.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:53.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:53.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:53.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:53.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:54.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:18:54.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:54.644790+0000) 2019-10-23T14:18:54.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:54.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:54.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:54.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:55.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:55.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:55.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:55.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:56.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:18:56.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:56.127694+0000) 2019-10-23T14:18:56.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:56.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:56.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:56.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:57.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:57.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:57.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:57.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:58.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:58.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:58.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:58.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:18:59.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:18:59.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:59.104755+0000) 2019-10-23T14:18:59.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:18:59.124+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:59.126272+0000) 2019-10-23T14:18:59.142 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:18:59.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:18:59.140331+0000) 2019-10-23T14:18:59.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:59.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:18:59.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:18:59.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:00.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:00.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:00.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:00.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:01.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:01.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:01.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:01.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:02.647 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:19:02.643+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:02.645189+0000) 2019-10-23T14:19:02.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:02.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:02.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:02.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:03.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:03.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:03.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:03.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:04.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:19:04.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:04.644899+0000) 2019-10-23T14:19:04.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:04.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:04.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:04.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:05.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:05.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:05.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:05.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:06.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:19:06.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:06.127791+0000) 2019-10-23T14:19:06.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:06.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:06.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:06.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:07.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:07.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:07.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:07.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:08.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:08.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:08.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:08.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:09.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:19:09.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:09.104850+0000) 2019-10-23T14:19:09.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:19:09.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:09.126371+0000) 2019-10-23T14:19:09.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:19:09.140+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:09.140431+0000) 2019-10-23T14:19:09.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:09.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:09.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:09.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:10.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:10.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:10.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:10.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:11.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:11.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:11.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:11.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:12.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:19:12.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:12.645279+0000) 2019-10-23T14:19:12.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:12.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:12.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:12.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:13.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:13.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:13.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:13.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:14.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:19:14.643+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:14.645004+0000) 2019-10-23T14:19:14.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:14.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:14.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:14.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:15.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:15.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:15.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:15.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:16.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:19:16.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:16.127889+0000) 2019-10-23T14:19:16.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:16.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:16.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:16.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:17.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:17.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:17.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:17.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:18.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:18.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:18.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:18.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:19.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:19:19.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:19.104947+0000) 2019-10-23T14:19:19.128 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:19:19.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:19.126463+0000) 2019-10-23T14:19:19.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:19:19.140+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:19.140527+0000) 2019-10-23T14:19:19.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:19.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:19.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:19.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:20.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:20.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:20.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:20.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:21.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:21.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:21.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:21.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:22.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:19:22.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:22.645377+0000) 2019-10-23T14:19:22.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:22.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:22.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:22.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:23.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:23.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:23.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:23.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:24.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:24.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:24.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:24.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:24.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:19:24.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:24.645105+0000) 2019-10-23T14:19:25.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:25.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:25.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:25.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:26.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:19:26.126+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:26.127981+0000) 2019-10-23T14:19:26.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:26.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:26.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:26.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:27.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:27.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:27.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:27.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:28.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:28.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:28.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:28.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:29.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:19:29.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:29.105044+0000) 2019-10-23T14:19:29.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:19:29.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:29.126555+0000) 2019-10-23T14:19:29.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:19:29.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:29.140622+0000) 2019-10-23T14:19:29.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:29.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:29.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:29.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:30.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:30.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:30.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:30.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:31.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:31.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:31.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:31.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:32.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:32.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:32.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:32.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:32.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:19:32.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:32.645469+0000) 2019-10-23T14:19:33.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:33.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:33.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:33.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:34.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:34.582+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:34.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:34.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:34.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:19:34.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:34.645209+0000) 2019-10-23T14:19:35.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:35.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:35.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:35.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:36.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:19:36.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:36.128073+0000) 2019-10-23T14:19:36.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:36.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:36.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:36.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:37.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:37.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:37.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:37.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:38.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:38.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:38.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:38.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:39.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:19:39.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:39.105141+0000) 2019-10-23T14:19:39.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:19:39.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:39.126654+0000) 2019-10-23T14:19:39.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:19:39.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:39.140720+0000) 2019-10-23T14:19:39.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:39.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:39.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:39.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:40.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:40.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:40.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:40.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:41.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:41.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:41.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:41.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:42.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:42.570+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:42.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:42.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:42.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:19:42.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:42.645560+0000) 2019-10-23T14:19:43.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:43.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:43.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:43.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:44.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:44.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:44.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:44.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:44.649 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:19:44.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:44.645316+0000) 2019-10-23T14:19:45.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:45.539+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:45.545 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:45.539+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:46.132 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:19:46.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:46.128165+0000) 2019-10-23T14:19:46.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:46.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:46.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:46.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:47.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:47.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:47.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:47.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:48.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:48.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:48.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:48.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:49.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:19:49.103+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:49.105239+0000) 2019-10-23T14:19:49.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:19:49.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:49.126727+0000) 2019-10-23T14:19:49.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:19:49.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:49.140814+0000) 2019-10-23T14:19:49.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:49.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:49.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:49.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:50.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:50.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:50.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:50.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:51.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:51.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:51.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:51.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:52.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:52.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:52.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:52.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:52.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:19:52.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:52.645657+0000) 2019-10-23T14:19:53.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:53.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:53.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:53.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:54.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:54.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:54.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:54.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:54.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:19:54.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:54.645424+0000) 2019-10-23T14:19:55.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:55.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:55.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:55.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:56.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:19:56.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:56.128258+0000) 2019-10-23T14:19:56.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:56.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:56.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:56.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:57.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:57.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:57.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:57.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:58.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:58.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:58.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:58.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:19:59.107 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:19:59.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:59.105296+0000) 2019-10-23T14:19:59.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:19:59.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:59.126825+0000) 2019-10-23T14:19:59.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:19:59.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:19:59.140907+0000) 2019-10-23T14:19:59.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:59.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:19:59.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:19:59.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:00.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:00.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:00.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:00.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:01.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:01.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:01.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:01.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:02.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:02.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:02.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:02.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:02.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:20:02.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:02.645753+0000) 2019-10-23T14:20:03.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:03.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:03.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:03.362+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:04.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:04.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:04.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:04.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:04.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:20:04.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:04.645533+0000) 2019-10-23T14:20:05.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:05.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:05.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:05.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:06.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:20:06.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:06.128354+0000) 2019-10-23T14:20:06.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:06.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:06.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:06.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:07.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:07.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:07.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:07.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:08.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:08.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:08.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:08.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:09.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:20:09.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:09.105394+0000) 2019-10-23T14:20:09.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:20:09.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:09.126919+0000) 2019-10-23T14:20:09.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:09.139+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:09.141004+0000) 2019-10-23T14:20:09.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:09.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:09.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:09.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:10.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:10.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:10.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:10.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:11.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:11.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:11.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:11.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:12.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:12.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:12.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:12.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:12.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:20:12.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:12.645853+0000) 2019-10-23T14:20:13.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:13.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:13.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:13.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:14.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:14.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:14.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:14.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:14.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:20:14.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:14.645638+0000) 2019-10-23T14:20:15.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:15.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:15.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:15.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:16.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:20:16.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:16.128447+0000) 2019-10-23T14:20:16.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:16.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:16.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:16.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:17.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:17.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:17.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:17.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:18.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:18.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:18.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:18.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:19.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:20:19.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:19.105489+0000) 2019-10-23T14:20:19.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:20:19.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:19.127015+0000) 2019-10-23T14:20:19.143 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:19.140+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:19.141094+0000) 2019-10-23T14:20:19.144 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:19.141+0000 7f9e31a91700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:19.141652+0000) 2019-10-23T14:20:19.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:19.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:19.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:19.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:20.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:20.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:20.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:20.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:21.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:21.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:21.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:21.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:22.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:22.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:22.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:22.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:22.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:20:22.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:22.645952+0000) 2019-10-23T14:20:23.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:23.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:23.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:23.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:23.643 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:23.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:23.641282+0000) 2019-10-23T14:20:24.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:24.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:24.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:24.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:24.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:20:24.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:24.645743+0000) 2019-10-23T14:20:25.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:25.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:25.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:25.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:26.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:20:26.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:26.128540+0000) 2019-10-23T14:20:26.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:26.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:26.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:26.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:27.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:27.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:27.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:27.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:28.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:28.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:28.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:28.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:29.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:20:29.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:29.105586+0000) 2019-10-23T14:20:29.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:20:29.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:29.127112+0000) 2019-10-23T14:20:29.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:29.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:29.278 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:29.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:30.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:30.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:30.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:30.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:31.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:31.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:31.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:31.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:32.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:32.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:32.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:32.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:32.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:20:32.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:32.646053+0000) 2019-10-23T14:20:33.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:33.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:33.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:33.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:33.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:33.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:33.641382+0000) 2019-10-23T14:20:34.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:34.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:34.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:34.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:34.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:20:34.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:34.645852+0000) 2019-10-23T14:20:35.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:35.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:35.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:35.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:36.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:20:36.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:36.128633+0000) 2019-10-23T14:20:36.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:36.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:36.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:36.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:37.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:37.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:37.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:37.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:38.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:38.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:38.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:38.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:39.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:20:39.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:39.105683+0000) 2019-10-23T14:20:39.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:20:39.125+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:39.127208+0000) 2019-10-23T14:20:39.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:39.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:39.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:39.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:40.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:40.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:40.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:40.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:41.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:41.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:41.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:41.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:42.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:42.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:42.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:42.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:42.648 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:20:42.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:42.646145+0000) 2019-10-23T14:20:43.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:43.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:43.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:43.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:43.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:43.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:43.641478+0000) 2019-10-23T14:20:44.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:44.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:44.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:44.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:44.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:20:44.644+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:44.645959+0000) 2019-10-23T14:20:45.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:45.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:45.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:45.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:46.134 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:20:46.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:46.128731+0000) 2019-10-23T14:20:46.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:46.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:46.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:46.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:47.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:47.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:47.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:47.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:48.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:48.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:48.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:48.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:49.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:20:49.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:49.105780+0000) 2019-10-23T14:20:49.129 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:20:49.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:49.127303+0000) 2019-10-23T14:20:49.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:49.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:49.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:49.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:50.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:50.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:50.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:50.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:51.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:51.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:51.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:51.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:52.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:52.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:52.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:52.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:52.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:20:52.644+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:52.646242+0000) 2019-10-23T14:20:53.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:53.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:53.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:53.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:53.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:20:53.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:53.641573+0000) 2019-10-23T14:20:54.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:54.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:54.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:54.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:54.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:20:54.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:54.646064+0000) 2019-10-23T14:20:55.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:55.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:55.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:55.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:56.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:20:56.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:56.128822+0000) 2019-10-23T14:20:56.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:56.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:56.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:56.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:57.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:57.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:57.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:57.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:58.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:58.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:58.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:58.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:20:59.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:20:59.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:59.105875+0000) 2019-10-23T14:20:59.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:20:59.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:20:59.127397+0000) 2019-10-23T14:20:59.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:59.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:20:59.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:20:59.220+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:00.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:00.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:00.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:00.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:01.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:01.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:01.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:01.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:02.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:02.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:02.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:02.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:02.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:21:02.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:02.646296+0000) 2019-10-23T14:21:03.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:03.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:03.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:03.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:03.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:21:03.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:03.641669+0000) 2019-10-23T14:21:04.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:04.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:04.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:04.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:04.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:21:04.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:04.646175+0000) 2019-10-23T14:21:05.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:05.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:05.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:05.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:06.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:21:06.127+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:06.128920+0000) 2019-10-23T14:21:06.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:06.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:06.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:06.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:07.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:07.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:07.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:07.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:08.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:08.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:08.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:08.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:09.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:21:09.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:09.105971+0000) 2019-10-23T14:21:09.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:21:09.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:09.127493+0000) 2019-10-23T14:21:09.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:09.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:09.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:09.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:10.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:10.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:10.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:10.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:11.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:11.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:11.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:11.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:12.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:12.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:12.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:12.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:12.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:21:12.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:12.646395+0000) 2019-10-23T14:21:13.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:13.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:13.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:13.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:13.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:21:13.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:13.641768+0000) 2019-10-23T14:21:14.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:14.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:14.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:14.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:14.650 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:21:14.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:14.646282+0000) 2019-10-23T14:21:15.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:15.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:15.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:15.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:16.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:21:16.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:16.129020+0000) 2019-10-23T14:21:16.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:16.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:16.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:16.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:17.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:17.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:17.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:17.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:18.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:18.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:18.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:18.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:19.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:21:19.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:19.106066+0000) 2019-10-23T14:21:19.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:21:19.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:19.127590+0000) 2019-10-23T14:21:19.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:19.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:19.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:19.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:20.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:20.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:20.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:20.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:21.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:21.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:21.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:21.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:22.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:22.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:22.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:22.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:22.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:21:22.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:22.646490+0000) 2019-10-23T14:21:23.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:23.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:23.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:23.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:23.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:21:23.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:23.641864+0000) 2019-10-23T14:21:24.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:24.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:24.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:24.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:24.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:21:24.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:24.646386+0000) 2019-10-23T14:21:25.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:25.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:25.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:25.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:26.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:26.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:26.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:26.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:26.140 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:21:26.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:26.129120+0000) 2019-10-23T14:21:27.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:27.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:27.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:27.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:28.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:28.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:28.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:28.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:29.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:29.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:29.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:29.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:29.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:21:29.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:29.106165+0000) 2019-10-23T14:21:29.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:21:29.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:29.127684+0000) 2019-10-23T14:21:30.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:30.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:30.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:30.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:31.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:31.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:31.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:31.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:32.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:32.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:32.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:32.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:32.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:21:32.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:32.646592+0000) 2019-10-23T14:21:33.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:33.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:33.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:33.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:33.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:21:33.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:33.641957+0000) 2019-10-23T14:21:34.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:34.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:34.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:34.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:34.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:21:34.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:34.646494+0000) 2019-10-23T14:21:35.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:35.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:35.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:35.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:36.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:36.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:36.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:36.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:36.133 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:21:36.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:36.129218+0000) 2019-10-23T14:21:37.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:37.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:37.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:37.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:38.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:38.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:38.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:38.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:39.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:39.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:39.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:39.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:39.108 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:21:39.104+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:39.106262+0000) 2019-10-23T14:21:39.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:21:39.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:39.127778+0000) 2019-10-23T14:21:40.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:40.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:40.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:40.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:41.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:41.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:41.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:41.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:42.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:42.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:42.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:42.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:42.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:21:42.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:42.646690+0000) 2019-10-23T14:21:43.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:43.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:43.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:43.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:43.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:21:43.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:43.642053+0000) 2019-10-23T14:21:44.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:44.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:44.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:44.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:44.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:21:44.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:44.646600+0000) 2019-10-23T14:21:45.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:45.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:45.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:45.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:46.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:46.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:46.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:46.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:46.134 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:21:46.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:46.129314+0000) 2019-10-23T14:21:47.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:47.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:47.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:47.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:48.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:48.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:48.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:48.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:49.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:21:49.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:49.106358+0000) 2019-10-23T14:21:49.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:21:49.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:49.127874+0000) 2019-10-23T14:21:49.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:49.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:49.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:49.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:50.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:50.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:50.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:50.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:51.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:51.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:51.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:51.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:52.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:52.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:52.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:52.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:52.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:21:52.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:52.646784+0000) 2019-10-23T14:21:53.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:53.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:53.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:53.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:53.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:21:53.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:53.642149+0000) 2019-10-23T14:21:54.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:54.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:54.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:54.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:54.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:21:54.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:54.646703+0000) 2019-10-23T14:21:55.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:55.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:55.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:55.304+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:56.134 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:21:56.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:56.129412+0000) 2019-10-23T14:21:56.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:56.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:56.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:56.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:57.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:57.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:57.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:57.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:58.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:58.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:58.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:58.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:21:59.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:21:59.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:59.106458+0000) 2019-10-23T14:21:59.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:21:59.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:21:59.127971+0000) 2019-10-23T14:21:59.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:59.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:21:59.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:21:59.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:00.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:00.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:00.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:00.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:01.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:01.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:01.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:01.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:02.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:02.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:02.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:02.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:02.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:22:02.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:02.646878+0000) 2019-10-23T14:22:03.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:03.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:03.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:03.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:03.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:22:03.640+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:03.642242+0000) 2019-10-23T14:22:04.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:04.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:04.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:04.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:04.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:22:04.645+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:04.646884+0000) 2019-10-23T14:22:05.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:05.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:05.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:05.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:06.141 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:22:06.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:06.129547+0000) 2019-10-23T14:22:06.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:06.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:06.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:06.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:07.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:07.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:07.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:07.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:08.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:08.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:08.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:08.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:09.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:22:09.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:09.106555+0000) 2019-10-23T14:22:09.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:22:09.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:09.128062+0000) 2019-10-23T14:22:09.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:09.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:09.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:09.285+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:10.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:10.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:10.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:10.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:11.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:11.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:11.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:11.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:12.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:12.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:12.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:12.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:12.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:22:12.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:12.646975+0000) 2019-10-23T14:22:13.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:13.246+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:13.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:13.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:13.644 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:22:13.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:13.642297+0000) 2019-10-23T14:22:14.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:14.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:14.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:14.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:14.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:22:14.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:14.647089+0000) 2019-10-23T14:22:15.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:15.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:15.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:15.274+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:16.134 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:22:16.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:16.129731+0000) 2019-10-23T14:22:16.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:16.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:16.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:16.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:17.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:17.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:17.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:17.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:18.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:18.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:18.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:18.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 168 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:19.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:22:19.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:19.106647+0000) 2019-10-23T14:22:19.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:22:19.126+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:19.128158+0000) 2019-10-23T14:22:19.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:19.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:19.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:19.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:20.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:20.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:20.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:20.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:21.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:21.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:21.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:21.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:22.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:22.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:22.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:22.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:22.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:22:22.645+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:22.647072+0000) 2019-10-23T14:22:23.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:23.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:23.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:23.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:23.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:22:23.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:23.642391+0000) 2019-10-23T14:22:24.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:24.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:24.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:24.136+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:24.651 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:22:24.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:24.647223+0000) 2019-10-23T14:22:25.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:25.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:25.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:25.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:26.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:26.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:26.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:26.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:26.134 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:22:26.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:26.129869+0000) 2019-10-23T14:22:27.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:27.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:27.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:27.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:28.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:28.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:28.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:28.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:28.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:28.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:28.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:28.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:29.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:22:29.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:29.106743+0000) 2019-10-23T14:22:29.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:22:29.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:29.128254+0000) 2019-10-23T14:22:29.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:29.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:29.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:29.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:30.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:30.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:30.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:30.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:31.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:31.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:31.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:31.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:32.649 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:22:32.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:32.647168+0000) 2019-10-23T14:22:33.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:33.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:33.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:33.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:33.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:22:33.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:33.642485+0000) 2019-10-23T14:22:33.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:33.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:33.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:33.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:34.652 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:22:34.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:34.647330+0000) 2019-10-23T14:22:35.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:34.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:35.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:34.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:36.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:36.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:36.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:36.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:36.134 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:22:36.128+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:36.129965+0000) 2019-10-23T14:22:37.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:36.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:37.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:36.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:38.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:38.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:38.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:38.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:39.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:39.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:39.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:39.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:39.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:22:39.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:39.106839+0000) 2019-10-23T14:22:39.130 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:22:39.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:39.128351+0000) 2019-10-23T14:22:40.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:40.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:40.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:40.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:41.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:41.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:41.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:41.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:42.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:42.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:42.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:42.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:42.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:22:42.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:42.647268+0000) 2019-10-23T14:22:43.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:43.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:43.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:43.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:43.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:22:43.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:43.642577+0000) 2019-10-23T14:22:44.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:44.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:44.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:44.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:44.652 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:22:44.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:44.647438+0000) 2019-10-23T14:22:45.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:45.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:45.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:45.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:46.143 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:22:46.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:46.130060+0000) 2019-10-23T14:22:46.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:46.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:46.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:46.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:47.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:47.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:47.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:47.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:48.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:48.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:48.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:48.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:49.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:22:49.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:49.106935+0000) 2019-10-23T14:22:49.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:22:49.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:49.128447+0000) 2019-10-23T14:22:49.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:49.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:49.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:49.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:50.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:50.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:50.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:50.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:51.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:51.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:51.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:51.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:52.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:52.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:52.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:52.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:52.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:22:52.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:52.647367+0000) 2019-10-23T14:22:53.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:53.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:53.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:53.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:53.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:22:53.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:53.642669+0000) 2019-10-23T14:22:54.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:54.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:54.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:54.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:54.652 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:22:54.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:54.647544+0000) 2019-10-23T14:22:55.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:55.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:55.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:55.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:56.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:22:56.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:56.130151+0000) 2019-10-23T14:22:56.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:56.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:56.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:56.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:57.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:57.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:57.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:57.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:58.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:58.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:58.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:58.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:22:59.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:22:59.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:59.107026+0000) 2019-10-23T14:22:59.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:22:59.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:22:59.128537+0000) 2019-10-23T14:22:59.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:59.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:22:59.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:22:59.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:00.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:00.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:00.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:00.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:01.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:01.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:01.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:01.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:02.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:02.043+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:02.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:02.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:02.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:23:02.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:02.647460+0000) 2019-10-23T14:23:03.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:03.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:03.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:03.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:03.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:23:03.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:03.642762+0000) 2019-10-23T14:23:04.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:04.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:04.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:04.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:04.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:23:04.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:04.647729+0000) 2019-10-23T14:23:05.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:05.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:05.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:05.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:06.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:06.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:06.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:06.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:06.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:23:06.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:06.130288+0000) 2019-10-23T14:23:07.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:07.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:07.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:07.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:08.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:08.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:08.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:08.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:09.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:09.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:09.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:09.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:09.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:23:09.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:09.107123+0000) 2019-10-23T14:23:09.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:23:09.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:09.128633+0000) 2019-10-23T14:23:10.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:10.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:10.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:10.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:11.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:11.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:11.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:11.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:12.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:12.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:12.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:12.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:12.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:23:12.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:12.647554+0000) 2019-10-23T14:23:13.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:13.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:13.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:13.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:13.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:23:13.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:13.642858+0000) 2019-10-23T14:23:14.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:14.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:14.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:14.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:14.652 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:23:14.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:14.647874+0000) 2019-10-23T14:23:15.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:15.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:15.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:15.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:16.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:23:16.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:16.130433+0000) 2019-10-23T14:23:16.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:16.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:16.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:16.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:17.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:17.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:17.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:17.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:18.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:18.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:18.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:18.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:19.109 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:23:19.105+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:19.107215+0000) 2019-10-23T14:23:19.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:23:19.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:19.128729+0000) 2019-10-23T14:23:19.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:19.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:19.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:19.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:20.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:20.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:20.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:20.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:21.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:21.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:21.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:21.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:22.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:22.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:22.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:22.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:22.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:23:22.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:22.647652+0000) 2019-10-23T14:23:23.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:23.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:23.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:23.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:23.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:23:23.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:23.642950+0000) 2019-10-23T14:23:24.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:24.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:24.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:24.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:24.652 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:23:24.646+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:24.647980+0000) 2019-10-23T14:23:25.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:25.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:25.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:25.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:26.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:23:26.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:26.130575+0000) 2019-10-23T14:23:26.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:26.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:26.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:26.138+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:27.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:27.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:27.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:27.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:28.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:28.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:28.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:28.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:29.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:29.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:29.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:29.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:29.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:23:29.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:29.107298+0000) 2019-10-23T14:23:29.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:23:29.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:29.128820+0000) 2019-10-23T14:23:30.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:30.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:30.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:30.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:31.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:31.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:31.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:31.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:32.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:32.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:32.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:32.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:32.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:23:32.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:32.647748+0000) 2019-10-23T14:23:33.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:33.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:33.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:33.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:33.648 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:23:33.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:33.643044+0000) 2019-10-23T14:23:34.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:34.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:34.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:34.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:34.652 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:23:34.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:34.648153+0000) 2019-10-23T14:23:35.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:35.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:35.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:35.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:36.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:36.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:36.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:36.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:36.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:23:36.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:36.130773+0000) 2019-10-23T14:23:37.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:37.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:37.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:37.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:38.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:38.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:38.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:38.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:39.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:23:39.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:39.107392+0000) 2019-10-23T14:23:39.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:39.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:39.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:39.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:39.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:23:39.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:39.128915+0000) 2019-10-23T14:23:40.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:40.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:40.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:40.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:41.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:41.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:41.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:41.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:42.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:42.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:42.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:42.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:42.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:23:42.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:42.647841+0000) 2019-10-23T14:23:43.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:43.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:43.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:43.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:43.647 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:23:43.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:43.643135+0000) 2019-10-23T14:23:44.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:44.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:44.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:44.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:44.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:23:44.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:44.648335+0000) 2019-10-23T14:23:45.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:45.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:45.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:45.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:46.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:23:46.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:46.130921+0000) 2019-10-23T14:23:46.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:46.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:46.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:46.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:47.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:47.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:47.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:47.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:48.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:48.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:48.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:48.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:49.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:23:49.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:49.107483+0000) 2019-10-23T14:23:49.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:23:49.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:49.129009+0000) 2019-10-23T14:23:49.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:49.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:49.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:49.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:50.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:50.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:50.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:50.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:51.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:51.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:51.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:51.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:52.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:52.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:52.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:52.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:52.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:23:52.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:52.647938+0000) 2019-10-23T14:23:53.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:53.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:53.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:53.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:53.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:23:53.641+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:53.643231+0000) 2019-10-23T14:23:54.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:54.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:54.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:54.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:54.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:23:54.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:54.648455+0000) 2019-10-23T14:23:55.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:55.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:55.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:55.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:56.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:56.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:56.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:56.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:56.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:23:56.129+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:56.131015+0000) 2019-10-23T14:23:57.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:57.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:57.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:57.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:58.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:58.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:58.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:58.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:59.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:59.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:23:59.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:23:59.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:23:59.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:23:59.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:59.107579+0000) 2019-10-23T14:23:59.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:23:59.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:23:59.129103+0000) 2019-10-23T14:24:00.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:00.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:00.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:00.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:01.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:01.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:01.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:01.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:02.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:02.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:02.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:02.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:02.653 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:24:02.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:02.648033+0000) 2019-10-23T14:24:03.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:03.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:03.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:03.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:03.645 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:03.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:03.643298+0000) 2019-10-23T14:24:04.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:04.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:04.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:04.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:04.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:24:04.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:04.648560+0000) 2019-10-23T14:24:05.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:05.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:05.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:05.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:06.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:06.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:06.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:06.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:06.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:24:06.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:06.131116+0000) 2019-10-23T14:24:07.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:07.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:07.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:07.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:08.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:08.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:09.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:09.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:09.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:09.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:09.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:24:09.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:09.107678+0000) 2019-10-23T14:24:09.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:24:09.127+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:09.129196+0000) 2019-10-23T14:24:10.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:10.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:10.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:10.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:11.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:11.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:11.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:11.029+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:12.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:12.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:12.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:12.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:12.650 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:24:12.646+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:12.648133+0000) 2019-10-23T14:24:13.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:13.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:13.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:13.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:13.646 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:13.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:13.643395+0000) 2019-10-23T14:24:14.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:14.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:14.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:14.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:14.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:24:14.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:14.648667+0000) 2019-10-23T14:24:15.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:14.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:15.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:15.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:16.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:16.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:16.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:16.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:16.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:24:16.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:16.131213+0000) 2019-10-23T14:24:17.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:17.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:17.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:17.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:18.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:18.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:18.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:18.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:18.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:18.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:18.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:18.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:19.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:24:19.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:19.107771+0000) 2019-10-23T14:24:19.131 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:24:19.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:19.129296+0000) 2019-10-23T14:24:19.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:19.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:19.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:19.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:21.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:21.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:21.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:21.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:22.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:21.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:22.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:21.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:22.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:24:22.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:22.648303+0000) 2019-10-23T14:24:22.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:22.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:22.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:22.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:23.647 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:23.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:23.643491+0000) 2019-10-23T14:24:24.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:23.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:24.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:23.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:24.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:24:24.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:24.648833+0000) 2019-10-23T14:24:24.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:24.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:24.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:24.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:25.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:25.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:25.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:25.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:26.135 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:24:26.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:26.131310+0000) 2019-10-23T14:24:26.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:26.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:26.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:26.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:27.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:27.967+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:27.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:27.967+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:29.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:29.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:29.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:29.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:29.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:24:29.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:29.107868+0000) 2019-10-23T14:24:29.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:24:29.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:29.129393+0000) 2019-10-23T14:24:29.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:29.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:29.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:29.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:30.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:30.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:30.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:30.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:31.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:31.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:31.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:31.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:32.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:24:32.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:32.648447+0000) 2019-10-23T14:24:32.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:32.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:32.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:32.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:33.646 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:33.642+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:33.643583+0000) 2019-10-23T14:24:34.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:34.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:34.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:34.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:34.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:24:34.647+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:34.648941+0000) 2019-10-23T14:24:35.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:35.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:35.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:35.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:36.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:36.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:36.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:36.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:36.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:24:36.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:36.131406+0000) 2019-10-23T14:24:37.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:37.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:37.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:37.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:38.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:38.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:38.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:38.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:39.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:24:39.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:39.107966+0000) 2019-10-23T14:24:39.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:39.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:39.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:39.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:39.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:24:39.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:39.129487+0000) 2019-10-23T14:24:40.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:40.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:40.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:40.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:41.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:41.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:41.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:41.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:42.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:41.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:42.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:41.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:42.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:24:42.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:42.648540+0000) 2019-10-23T14:24:43.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:43.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:43.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:43.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:43.646 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:43.643+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:43.643672+0000) 2019-10-23T14:24:43.646 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:43.643+0000 7f9e30a8f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:43.644196+0000) 2019-10-23T14:24:44.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:44.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:44.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:44.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:44.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:24:44.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:44.649050+0000) 2019-10-23T14:24:44.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:44.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:44.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:44.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:45.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:45.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:45.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:45.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:46.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:24:46.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:46.131504+0000) 2019-10-23T14:24:46.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:46.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:46.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:46.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:47.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:47.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:47.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:47.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:48.146 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:48.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:48.143855+0000) 2019-10-23T14:24:49.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:49.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:49.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:49.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:49.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:24:49.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:49.108062+0000) 2019-10-23T14:24:49.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:24:49.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:49.129582+0000) 2019-10-23T14:24:50.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:50.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:50.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:50.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:51.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:51.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:51.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:51.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:52.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:52.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:52.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:52.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:52.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:24:52.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:52.648635+0000) 2019-10-23T14:24:53.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:53.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:53.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:53.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:54.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:54.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:54.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:54.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:54.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:24:54.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:54.649159+0000) 2019-10-23T14:24:55.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:55.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:55.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:55.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:56.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:56.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:56.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:56.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:56.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:24:56.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:56.131599+0000) 2019-10-23T14:24:57.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:57.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:57.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:57.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:58.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:58.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:58.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:58.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:24:58.146 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:24:58.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:58.143947+0000) 2019-10-23T14:24:59.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:24:59.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:59.108155+0000) 2019-10-23T14:24:59.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:24:59.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:24:59.129674+0000) 2019-10-23T14:24:59.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:59.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:24:59.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:24:59.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:00.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:00.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:00.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:00.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:01.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:01.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:01.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:01.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:02.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:02.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:02.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:02.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:02.657 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:25:02.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:02.648729+0000) 2019-10-23T14:25:03.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:03.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:03.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:03.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:04.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:04.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:04.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:04.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:04.653 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:25:04.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:04.649264+0000) 2019-10-23T14:25:05.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:05.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:05.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:05.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:06.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:06.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:06.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:06.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:06.141 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:25:06.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:06.131696+0000) 2019-10-23T14:25:07.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:07.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:07.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:07.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:08.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:08.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:08.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:08.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:08.146 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:25:08.142+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:08.144041+0000) 2019-10-23T14:25:09.110 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:25:09.106+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:09.108251+0000) 2019-10-23T14:25:09.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:25:09.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:09.129770+0000) 2019-10-23T14:25:09.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:09.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:09.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:09.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:10.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:10.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:10.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:10.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:11.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:11.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:11.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:11.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:12.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:12.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:12.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:12.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:12.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:25:12.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:12.648823+0000) 2019-10-23T14:25:13.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:13.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:13.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:13.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:14.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:14.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:14.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:14.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:14.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:25:14.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:14.649369+0000) 2019-10-23T14:25:15.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:15.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:15.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:15.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:16.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:25:16.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:16.131793+0000) 2019-10-23T14:25:16.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:16.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:16.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:16.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:17.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:17.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:17.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:17.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:18.146 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:25:18.142+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:18.144143+0000) 2019-10-23T14:25:18.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:18.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:18.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:18.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:19.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:25:19.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:19.108296+0000) 2019-10-23T14:25:19.137 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:25:19.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:19.129860+0000) 2019-10-23T14:25:19.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:19.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:19.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:19.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:20.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:20.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:20.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:20.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:21.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:21.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:21.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:21.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:22.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:22.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:22.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:22.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:22.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:25:22.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:22.648922+0000) 2019-10-23T14:25:23.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:23.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:23.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:23.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:24.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:24.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:24.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:24.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:24.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:25:24.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:24.649478+0000) 2019-10-23T14:25:25.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:25.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:25.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:25.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:26.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:26.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:26.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:26.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:26.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:25:26.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:26.131887+0000) 2019-10-23T14:25:27.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:27.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:27.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:27.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:28.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:28.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:28.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:28.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:28.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:25:28.142+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:28.144245+0000) 2019-10-23T14:25:29.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:25:29.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:29.108392+0000) 2019-10-23T14:25:29.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:25:29.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:29.129957+0000) 2019-10-23T14:25:29.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:29.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:29.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:29.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:30.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:30.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:30.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:30.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:31.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:31.136+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:31.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:31.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:32.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:32.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:32.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:32.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:32.653 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:25:32.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:32.649016+0000) 2019-10-23T14:25:33.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:33.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:33.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:33.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:34.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:34.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:34.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:34.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:34.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:25:34.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:34.649584+0000) 2019-10-23T14:25:35.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:35.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:35.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:35.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:36.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:36.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:36.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:36.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:36.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:25:36.130+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:36.131982+0000) 2019-10-23T14:25:37.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:37.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:37.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:37.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:38.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:38.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:38.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:38.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:38.146 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:25:38.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:38.144297+0000) 2019-10-23T14:25:39.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:39.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:39.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:39.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:39.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:25:39.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:39.108488+0000) 2019-10-23T14:25:39.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:25:39.128+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:39.130055+0000) 2019-10-23T14:25:40.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:40.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:40.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:40.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:41.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:41.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:41.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:41.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:42.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:42.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:42.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:42.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:42.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:25:42.647+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:42.649113+0000) 2019-10-23T14:25:43.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:43.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:43.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:43.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:44.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:44.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:44.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:44.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:44.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:25:44.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:44.649690+0000) 2019-10-23T14:25:45.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:45.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:45.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:45.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:46.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:25:46.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:46.132076+0000) 2019-10-23T14:25:46.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:46.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:46.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:46.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:47.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:47.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:47.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:47.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:48.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:25:48.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:48.144392+0000) 2019-10-23T14:25:48.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:48.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:48.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:48.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:49.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:25:49.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:49.108580+0000) 2019-10-23T14:25:49.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:25:49.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:49.130151+0000) 2019-10-23T14:25:49.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:49.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:49.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:49.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:50.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:50.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:50.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:50.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:51.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:51.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:51.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:51.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:52.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:52.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:52.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:52.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:52.651 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:25:52.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:52.649215+0000) 2019-10-23T14:25:53.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:53.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:53.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:53.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:54.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:54.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:54.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:54.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:54.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:25:54.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:54.649800+0000) 2019-10-23T14:25:55.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:55.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:55.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:55.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:56.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:56.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:56.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:56.108+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:56.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:25:56.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:56.132169+0000) 2019-10-23T14:25:57.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:57.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:57.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:57.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:58.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:58.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:58.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:58.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:58.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:25:58.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:58.144489+0000) 2019-10-23T14:25:59.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:59.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:25:59.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:25:59.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:25:59.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:25:59.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:59.108671+0000) 2019-10-23T14:25:59.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:25:59.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:25:59.130245+0000) 2019-10-23T14:26:00.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:00.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:00.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:00.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:01.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:01.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:01.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:01.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:02.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:02.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:02.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:02.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:02.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:26:02.649+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:02.649311+0000) 2019-10-23T14:26:03.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:03.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:03.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:03.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:04.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:04.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:04.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:04.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:04.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:26:04.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:04.649908+0000) 2019-10-23T14:26:05.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:05.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:05.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:05.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:05.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:05.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:05.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:05.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:06.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:26:06.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:06.132266+0000) 2019-10-23T14:26:07.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:07.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:07.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:07.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:08.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:08.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:08.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:08.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:08.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:26:08.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:08.144594+0000) 2019-10-23T14:26:09.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:09.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:09.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:09.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:09.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:26:09.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:09.108762+0000) 2019-10-23T14:26:09.132 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:09.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:09.130339+0000) 2019-10-23T14:26:10.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:10.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:10.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:10.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:11.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:11.150+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:11.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:11.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:12.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:12.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:12.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:12.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:12.656 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:26:12.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:12.649405+0000) 2019-10-23T14:26:13.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:13.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:13.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:13.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:14.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:14.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:14.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:14.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:14.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:26:14.648+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:14.650014+0000) 2019-10-23T14:26:15.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:15.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:15.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:15.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:16.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:26:16.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:16.132362+0000) 2019-10-23T14:26:16.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:16.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:16.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:16.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:17.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:17.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:17.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:17.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:18.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:18.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:18.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:18.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:18.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:26:18.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:18.144686+0000) 2019-10-23T14:26:19.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:26:19.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:19.108856+0000) 2019-10-23T14:26:19.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:19.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:19.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:19.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:19.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:19.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:19.130434+0000) 2019-10-23T14:26:20.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:20.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:20.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:20.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:21.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:21.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:21.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:21.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:22.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:22.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:22.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:22.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:22.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:26:22.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:22.649501+0000) 2019-10-23T14:26:23.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:23.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:23.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:23.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:24.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:24.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:24.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:24.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:24.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:26:24.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:24.650129+0000) 2019-10-23T14:26:25.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:25.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:25.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:25.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:26.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:26.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:26.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:26.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:26.136 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:26:26.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:26.132459+0000) 2019-10-23T14:26:27.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:27.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:27.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:27.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:28.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:28.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:28.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:28.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:28.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:26:28.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:28.144781+0000) 2019-10-23T14:26:29.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:26:29.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:29.108949+0000) 2019-10-23T14:26:29.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:29.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:29.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:29.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:29.136 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:29.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:29.130529+0000) 2019-10-23T14:26:30.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:30.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:30.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:30.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:31.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:31.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:31.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:31.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:32.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:32.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:32.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:32.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:32.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:26:32.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:32.649596+0000) 2019-10-23T14:26:33.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:33.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:33.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:33.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:34.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:34.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:34.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:34.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:34.654 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:26:34.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:34.650238+0000) 2019-10-23T14:26:35.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:35.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:35.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:35.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:36.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:36.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:36.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:36.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:36.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:26:36.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:36.132554+0000) 2019-10-23T14:26:37.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:37.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:37.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:37.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:38.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:26:38.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:38.144874+0000) 2019-10-23T14:26:38.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:38.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:38.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:38.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:39.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:26:39.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:39.109042+0000) 2019-10-23T14:26:39.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:39.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:39.130623+0000) 2019-10-23T14:26:39.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:39.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:39.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:39.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:40.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:40.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:40.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:40.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:41.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:41.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:41.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:41.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:42.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:42.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:42.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:42.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:42.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:26:42.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:42.649695+0000) 2019-10-23T14:26:43.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:43.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:43.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:43.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:44.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:44.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:44.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:44.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:44.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:26:44.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:44.650342+0000) 2019-10-23T14:26:45.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:45.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:45.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:45.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:46.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:46.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:46.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:46.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:46.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:26:46.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:46.132652+0000) 2019-10-23T14:26:47.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:47.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:47.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:47.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:48.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:48.106+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:48.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:48.106+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:48.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:26:48.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:48.144966+0000) 2019-10-23T14:26:49.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:49.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:49.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:49.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:49.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:26:49.107+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:49.109128+0000) 2019-10-23T14:26:49.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:49.129+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:49.130707+0000) 2019-10-23T14:26:50.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:50.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:50.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:50.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:51.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:51.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:51.111 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:51.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:52.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:52.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:52.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:52.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:52.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:26:52.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:52.649794+0000) 2019-10-23T14:26:53.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:53.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:53.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:53.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:54.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:54.162+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:54.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:54.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:54.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:26:54.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:54.650451+0000) 2019-10-23T14:26:55.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:55.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:55.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:55.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:56.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:26:56.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:56.132750+0000) 2019-10-23T14:26:56.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:56.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:56.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:56.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:57.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:57.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:57.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:57.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:58.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:26:58.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:58.145061+0000) 2019-10-23T14:26:58.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:58.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:58.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:58.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:26:59.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:26:59.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:59.109223+0000) 2019-10-23T14:26:59.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:59.130+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:59.130797+0000) 2019-10-23T14:26:59.133 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:26:59.131+0000 7fa171eda700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:26:59.131450+0000) 2019-10-23T14:26:59.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:59.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:26:59.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:26:59.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:00.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:00.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:00.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:00.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:01.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:01.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:01.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:01.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:02.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:02.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:02.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:02.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:02.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:02.649+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:02.649885+0000) 2019-10-23T14:27:03.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:03.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:03.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:03.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:03.633 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:27:03.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:03.630983+0000) 2019-10-23T14:27:04.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:04.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:04.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:04.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:04.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:27:04.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:04.650558+0000) 2019-10-23T14:27:05.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:05.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:05.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:05.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:06.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:27:06.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:06.132846+0000) 2019-10-23T14:27:06.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:06.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:06.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:06.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:07.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:07.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:07.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:07.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:08.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:27:08.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:08.145156+0000) 2019-10-23T14:27:08.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:08.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:08.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:08.249+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:09.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:27:09.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:09.109298+0000) 2019-10-23T14:27:09.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:09.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:09.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:09.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:10.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:10.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:10.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:10.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:11.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:11.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:11.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:11.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:12.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:12.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:12.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:12.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:12.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:12.649+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:12.649973+0000) 2019-10-23T14:27:13.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:13.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:13.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:13.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:13.633 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:27:13.629+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:13.631078+0000) 2019-10-23T14:27:14.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:14.143+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:14.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:14.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:14.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:27:14.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:14.650665+0000) 2019-10-23T14:27:15.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:15.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:15.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:15.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:16.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:16.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:16.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:16.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:16.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:27:16.131+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:16.132946+0000) 2019-10-23T14:27:17.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:17.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:17.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:17.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:18.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:18.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:18.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:18.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:18.147 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:27:18.143+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:18.145253+0000) 2019-10-23T14:27:19.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:19.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:19.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:19.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:19.111 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:27:19.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:19.109390+0000) 2019-10-23T14:27:20.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:20.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:20.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:20.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:21.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:21.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:21.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:21.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:22.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:22.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:22.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:22.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:22.652 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:22.648+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:22.650066+0000) 2019-10-23T14:27:22.653 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:22.649+0000 7fc3e1e86700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:22.650755+0000) 2019-10-23T14:27:23.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:23.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:23.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:23.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:23.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:27:23.629+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:23.631173+0000) 2019-10-23T14:27:24.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:24.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:24.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:24.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:24.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:27:24.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:24.650771+0000) 2019-10-23T14:27:25.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:25.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:25.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:25.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:26.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:26.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:26.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:26.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:26.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:27:26.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:26.133044+0000) 2019-10-23T14:27:27.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:27.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:27.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:27.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:27.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:27.148+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:27.150241+0000) 2019-10-23T14:27:28.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:28.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:28.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:28.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:28.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:27:28.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:28.145355+0000) 2019-10-23T14:27:29.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:27:29.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:29.109486+0000) 2019-10-23T14:27:29.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:29.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:29.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:29.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:30.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:30.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:30.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:30.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:31.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:31.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:31.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:31.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:32.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:32.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:32.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:32.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:33.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:33.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:33.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:33.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:33.633 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:27:33.629+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:33.631269+0000) 2019-10-23T14:27:34.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:34.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:34.249 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:34.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:34.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:27:34.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:34.650879+0000) 2019-10-23T14:27:35.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:35.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:35.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:35.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:36.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:27:36.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:36.133141+0000) 2019-10-23T14:27:36.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:36.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:36.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:36.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:37.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:37.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:37.150342+0000) 2019-10-23T14:27:37.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:37.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:37.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:37.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:38.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:27:38.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:38.145451+0000) 2019-10-23T14:27:38.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:38.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:38.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:38.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:39.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:27:39.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:39.109580+0000) 2019-10-23T14:27:39.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:39.274+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:39.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:39.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:40.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:40.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:40.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:40.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:41.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:41.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:41.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:41.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:42.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:42.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:42.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:42.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:43.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:43.251+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:43.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:43.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:43.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:27:43.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:43.631374+0000) 2019-10-23T14:27:44.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:44.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:44.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:44.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:44.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:27:44.649+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:44.650985+0000) 2019-10-23T14:27:45.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:45.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:45.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:45.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:46.137 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:27:46.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:46.133238+0000) 2019-10-23T14:27:46.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:46.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:46.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:46.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:47.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:47.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:47.150442+0000) 2019-10-23T14:27:47.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:47.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:47.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:47.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:48.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:27:48.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:48.145544+0000) 2019-10-23T14:27:48.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:48.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:48.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:48.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:49.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:27:49.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:49.109668+0000) 2019-10-23T14:27:49.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:49.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:49.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:49.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:50.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:50.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:50.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:50.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:51.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:51.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:51.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:51.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:52.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:52.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:52.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:52.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:53.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:53.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:53.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:53.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:53.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:27:53.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:53.631469+0000) 2019-10-23T14:27:54.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:54.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:54.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:54.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:54.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:27:54.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:54.651096+0000) 2019-10-23T14:27:55.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:55.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:55.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:55.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:56.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:27:56.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:56.133335+0000) 2019-10-23T14:27:56.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:56.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:56.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:56.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:57.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:27:57.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:57.150540+0000) 2019-10-23T14:27:57.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:57.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:57.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:57.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:58.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:27:58.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:58.145636+0000) 2019-10-23T14:27:58.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:58.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:58.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:58.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:27:59.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:27:59.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:27:59.109764+0000) 2019-10-23T14:27:59.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:59.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:27:59.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:27:59.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:00.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:00.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:00.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:00.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:01.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:01.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:01.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:01.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:02.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:02.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:02.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:02.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:03.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:03.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:03.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:03.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:03.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:28:03.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:03.631565+0000) 2019-10-23T14:28:04.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:04.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:04.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:04.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:04.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:28:04.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:04.651202+0000) 2019-10-23T14:28:05.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:05.356+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:05.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:05.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:06.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:28:06.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:06.133429+0000) 2019-10-23T14:28:06.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:06.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:06.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:06.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:07.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:28:07.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:07.150640+0000) 2019-10-23T14:28:07.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:07.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:07.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:07.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:08.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:28:08.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:08.145732+0000) 2019-10-23T14:28:08.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:08.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:08.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:08.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:09.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:28:09.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:09.109862+0000) 2019-10-23T14:28:09.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:09.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:09.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:09.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:10.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:10.353+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:10.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:10.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:11.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:11.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:11.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:11.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:12.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:12.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:12.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:12.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:13.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:13.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:13.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:13.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:13.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:28:13.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:13.631662+0000) 2019-10-23T14:28:14.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:14.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:14.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:14.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:14.655 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:28:14.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:14.651310+0000) 2019-10-23T14:28:15.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:15.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:15.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:15.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:16.143 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:28:16.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:16.133522+0000) 2019-10-23T14:28:16.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:16.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:16.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:16.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:17.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:28:17.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:17.150742+0000) 2019-10-23T14:28:17.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:17.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:17.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:17.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:18.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:28:18.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:18.145825+0000) 2019-10-23T14:28:18.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:18.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:18.362 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:18.356+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:19.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:28:19.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:19.109952+0000) 2019-10-23T14:28:19.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:19.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:19.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:19.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:20.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:20.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:20.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:20.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:21.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:21.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:21.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:21.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:22.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:22.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:22.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:22.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:23.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:23.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:23.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:23.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:23.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:28:23.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:23.631761+0000) 2019-10-23T14:28:24.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:24.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:24.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:24.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:24.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:28:24.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:24.651418+0000) 2019-10-23T14:28:25.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:25.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:25.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:25.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:26.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:28:26.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:26.133618+0000) 2019-10-23T14:28:26.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:26.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:26.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:26.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:27.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:28:27.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:27.150837+0000) 2019-10-23T14:28:27.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:27.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:27.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:27.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:28.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:28:28.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:28.145918+0000) 2019-10-23T14:28:28.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:28.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:28.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:28.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:29.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:28:29.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:29.110047+0000) 2019-10-23T14:28:29.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:29.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:29.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:29.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:30.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:30.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:30.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:30.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:31.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:31.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:31.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:31.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:32.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:32.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:32.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:32.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:33.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:33.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:33.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:33.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:33.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:28:33.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:33.631859+0000) 2019-10-23T14:28:34.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:34.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:34.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:34.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:34.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:28:34.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:34.651526+0000) 2019-10-23T14:28:35.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:35.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:35.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:35.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:36.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:28:36.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:36.133714+0000) 2019-10-23T14:28:36.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:36.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:36.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:36.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:37.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:28:37.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:37.150936+0000) 2019-10-23T14:28:37.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:37.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:37.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:37.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:38.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:28:38.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:38.146011+0000) 2019-10-23T14:28:38.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:38.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:38.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:38.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:39.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:28:39.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:39.110140+0000) 2019-10-23T14:28:39.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:39.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:39.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:39.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:40.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:40.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:40.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:40.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:41.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:41.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:18:06.112672+0000 (oldest deadline 2019-10-23T14:18:26.112672+0000) 2019-10-23T14:28:41.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:41.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:42.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:42.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:43.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:43.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:43.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:28:43.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:43.631961+0000) 2019-10-23T14:28:44.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:44.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:44.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:28:44.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:44.651632+0000) 2019-10-23T14:28:45.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:45.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:46.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:28:46.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:46.133809+0000) 2019-10-23T14:28:46.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:46.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:47.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:28:47.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:47.151034+0000) 2019-10-23T14:28:47.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:47.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:48.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:28:48.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:48.146106+0000) 2019-10-23T14:28:48.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:48.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:49.112 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:28:49.108+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:49.110234+0000) 2019-10-23T14:28:49.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:49.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:50.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:50.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:51.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:51.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:52.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:52.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:53.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:53.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:53.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:28:53.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:53.632055+0000) 2019-10-23T14:28:54.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:54.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:54.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:28:54.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:54.651738+0000) 2019-10-23T14:28:55.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:55.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:56.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:28:56.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:56.133904+0000) 2019-10-23T14:28:56.532 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:56.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:57.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:28:57.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:57.151135+0000) 2019-10-23T14:28:57.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:57.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:58.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:28:58.144+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:58.146201+0000) 2019-10-23T14:28:58.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:58.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:28:59.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:28:59.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:28:59.110297+0000) 2019-10-23T14:28:59.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:28:59.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:00.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:00.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:01.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:01.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:02.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:02.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:03.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:03.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:03.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:29:03.630+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:03.632154+0000) 2019-10-23T14:29:04.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:04.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:04.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:29:04.650+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:04.651897+0000) 2019-10-23T14:29:05.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:05.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:05.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:05.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:06.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:06.132+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:06.134001+0000) 2019-10-23T14:29:06.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:06.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:06.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:06.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:07.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:29:07.149+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:07.151236+0000) 2019-10-23T14:29:07.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:07.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:07.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:07.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:08.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:29:08.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:08.146293+0000) 2019-10-23T14:29:08.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:08.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:08.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:08.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:09.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:29:09.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:09.110393+0000) 2019-10-23T14:29:09.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:09.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:09.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:09.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:10.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:10.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:10.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:10.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:11.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:11.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:11.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:11.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:12.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:12.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:12.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:12.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:13.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:13.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:13.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:13.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:13.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:29:13.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:13.632248+0000) 2019-10-23T14:29:14.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:14.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:14.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:14.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:14.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:29:14.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:14.652040+0000) 2019-10-23T14:29:15.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:15.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:15.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:15.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:16.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:16.133+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:16.134098+0000) 2019-10-23T14:29:16.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:16.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:16.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:16.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:17.153 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:29:17.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:17.151297+0000) 2019-10-23T14:29:17.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:17.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:17.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:17.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:18.148 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:29:18.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:18.146387+0000) 2019-10-23T14:29:18.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:18.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:18.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:18.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:19.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:29:19.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:19.110487+0000) 2019-10-23T14:29:19.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:19.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:19.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:19.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:20.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:20.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:20.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:20.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:21.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:21.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:21.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:21.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:22.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:22.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:22.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:22.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:23.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:23.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:23.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:23.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:23.634 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:29:23.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:23.632298+0000) 2019-10-23T14:29:24.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:24.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:24.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:24.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:24.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:29:24.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:24.652147+0000) 2019-10-23T14:29:25.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:25.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:25.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:25.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:26.138 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:26.133+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:26.134188+0000) 2019-10-23T14:29:26.139 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:26.133+0000 7f2d21959700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:26.134762+0000) 2019-10-23T14:29:26.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:26.298+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:26.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:26.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:27.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:29:27.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:27.151401+0000) 2019-10-23T14:29:27.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:27.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:27.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:27.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:28.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:29:28.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:28.146480+0000) 2019-10-23T14:29:28.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:28.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:28.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:28.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:29.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:29:29.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:29.110584+0000) 2019-10-23T14:29:29.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:29.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:29.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:29.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:30.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:30.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:30.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:30.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:30.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:30.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:30.634373+0000) 2019-10-23T14:29:31.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:31.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:31.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:31.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:32.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:32.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:32.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:32.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:33.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:33.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:33.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:33.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:33.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:29:33.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:33.632395+0000) 2019-10-23T14:29:34.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:34.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:34.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:34.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:34.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:29:34.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:34.652253+0000) 2019-10-23T14:29:35.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:35.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:35.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:35.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:36.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:36.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:36.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:36.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:37.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:29:37.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:37.151501+0000) 2019-10-23T14:29:37.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:37.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:37.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:37.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:38.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:29:38.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:38.146572+0000) 2019-10-23T14:29:38.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:38.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:38.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:38.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:39.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:29:39.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:39.110679+0000) 2019-10-23T14:29:39.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:39.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:39.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:39.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:40.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:40.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:40.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:40.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:40.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:40.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:40.634471+0000) 2019-10-23T14:29:41.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:41.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:41.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:41.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:42.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:42.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:42.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:42.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:43.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:43.470+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:43.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:43.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:43.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:29:43.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:43.632497+0000) 2019-10-23T14:29:44.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:44.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:44.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:44.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:44.656 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:29:44.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:44.652358+0000) 2019-10-23T14:29:45.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:45.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:45.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:45.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:46.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:46.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:46.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:46.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:47.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:29:47.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:47.151601+0000) 2019-10-23T14:29:47.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:47.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:47.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:47.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:48.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:29:48.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:48.146668+0000) 2019-10-23T14:29:48.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:48.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:48.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:48.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:49.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:29:49.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:49.110771+0000) 2019-10-23T14:29:49.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:49.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:49.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:49.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:50.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:50.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:50.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:50.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:50.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:29:50.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:50.634567+0000) 2019-10-23T14:29:51.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:51.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:51.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:51.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:52.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:52.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:52.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:52.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:53.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:53.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:53.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:53.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:53.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:29:53.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:53.632593+0000) 2019-10-23T14:29:54.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:54.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:54.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:54.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:54.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:29:54.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:54.652464+0000) 2019-10-23T14:29:55.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:55.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:55.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:55.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:56.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:56.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:56.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:56.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:57.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:29:57.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:57.151700+0000) 2019-10-23T14:29:57.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:57.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:57.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:57.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:58.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:29:58.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:58.146758+0000) 2019-10-23T14:29:58.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:58.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:58.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:58.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:29:59.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:29:59.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:29:59.110863+0000) 2019-10-23T14:29:59.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:59.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:29:59.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:29:59.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:00.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:00.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:00.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:00.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:00.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:30:00.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:00.634666+0000) 2019-10-23T14:30:01.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:01.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:01.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:01.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:02.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:02.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:02.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:02.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:03.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:03.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:03.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:03.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:03.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:30:03.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:03.632686+0000) 2019-10-23T14:30:04.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:04.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:04.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:04.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:04.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:30:04.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:04.652568+0000) 2019-10-23T14:30:05.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:05.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:05.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:05.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:06.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:06.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:06.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:06.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:07.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:30:07.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:07.151799+0000) 2019-10-23T14:30:07.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:07.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:07.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:07.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:08.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:30:08.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:08.146852+0000) 2019-10-23T14:30:08.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:08.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:08.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:08.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:09.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:30:09.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:09.110957+0000) 2019-10-23T14:30:09.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:09.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:09.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:09.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:10.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:10.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:10.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:10.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:10.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:30:10.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:10.634763+0000) 2019-10-23T14:30:11.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:11.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:11.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:11.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:12.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:12.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:12.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:12.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:13.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:13.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:13.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:13.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:13.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:30:13.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:13.632785+0000) 2019-10-23T14:30:14.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:14.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:14.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:14.529+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:14.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:30:14.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:14.652681+0000) 2019-10-23T14:30:15.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:15.517+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:15.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:15.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:16.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:16.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:16.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:16.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:17.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:30:17.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:17.151903+0000) 2019-10-23T14:30:17.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:17.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:17.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:17.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:18.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:30:18.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:18.146949+0000) 2019-10-23T14:30:18.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:18.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:18.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:18.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:19.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:30:19.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:19.111051+0000) 2019-10-23T14:30:19.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:19.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:19.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:19.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:20.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:20.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:20.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:20.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:20.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:30:20.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:20.634855+0000) 2019-10-23T14:30:21.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:21.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:21.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:21.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:22.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:22.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:22.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:22.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:23.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:23.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:23.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:23.357+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:23.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:30:23.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:23.632883+0000) 2019-10-23T14:30:24.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:24.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:24.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:24.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:24.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:30:24.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:24.652790+0000) 2019-10-23T14:30:25.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:25.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:25.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:25.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:26.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:26.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:26.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:26.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:27.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:30:27.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:27.152003+0000) 2019-10-23T14:30:27.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:27.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:27.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:27.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:28.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:30:28.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:28.147045+0000) 2019-10-23T14:30:28.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:28.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:28.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:28.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:29.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:30:29.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:29.111144+0000) 2019-10-23T14:30:29.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:29.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:29.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:29.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:30.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:30.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:30.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:30.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:30.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:30:30.633+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:30.634961+0000) 2019-10-23T14:30:31.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:31.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:31.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:31.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:32.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:32.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:32.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:32.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:33.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:33.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:33.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:33.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:33.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:30:33.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:33.632984+0000) 2019-10-23T14:30:34.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:34.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:34.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:34.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:34.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:30:34.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:34.652897+0000) 2019-10-23T14:30:35.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:35.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:35.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:35.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:36.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:36.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:36.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:36.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:37.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:30:37.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:37.152100+0000) 2019-10-23T14:30:37.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:37.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:37.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:37.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:38.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:30:38.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:38.147138+0000) 2019-10-23T14:30:38.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:38.488+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:38.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:38.488+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:39.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:30:39.109+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:39.111236+0000) 2019-10-23T14:30:39.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:39.493+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:39.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:39.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:40.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:40.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:40.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:40.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:40.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:30:40.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:40.635058+0000) 2019-10-23T14:30:41.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:41.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:41.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:41.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:42.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:42.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:42.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:42.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:43.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:43.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:43.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:43.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:43.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:30:43.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:43.633082+0000) 2019-10-23T14:30:44.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:44.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:44.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:44.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:44.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:30:44.651+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:44.653005+0000) 2019-10-23T14:30:45.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:45.415+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:45.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:45.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:46.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:46.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:46.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:46.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:47.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:30:47.150+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:47.152202+0000) 2019-10-23T14:30:47.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:47.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:47.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:47.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:48.149 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:30:48.145+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:48.147233+0000) 2019-10-23T14:30:48.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:48.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:48.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:48.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:49.113 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:30:49.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:49.111299+0000) 2019-10-23T14:30:49.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:49.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:49.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:49.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:50.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:50.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:50.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:50.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:50.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:30:50.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:50.635155+0000) 2019-10-23T14:30:51.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:51.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:51.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:51.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:52.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:52.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:52.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:52.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:53.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:53.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:53.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:53.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:53.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:30:53.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:53.633180+0000) 2019-10-23T14:30:54.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:54.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:54.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:54.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:54.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:30:54.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:54.653119+0000) 2019-10-23T14:30:55.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:55.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:55.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:55.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:56.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:56.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:56.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:56.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:57.154 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:30:57.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:57.152302+0000) 2019-10-23T14:30:57.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:57.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:57.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:57.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:58.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:30:58.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:58.147297+0000) 2019-10-23T14:30:58.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:58.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:58.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:58.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:30:59.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:30:59.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:30:59.111398+0000) 2019-10-23T14:30:59.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:59.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:30:59.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:30:59.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:00.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:00.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:00.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:00.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:00.639 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:31:00.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:00.635253+0000) 2019-10-23T14:31:01.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:01.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:01.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:01.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:02.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:02.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:02.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:02.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:03.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:03.474+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:03.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:03.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:03.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:31:03.631+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:03.633277+0000) 2019-10-23T14:31:04.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:04.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:04.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:04.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:04.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:31:04.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:04.653227+0000) 2019-10-23T14:31:05.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:05.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:05.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:05.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:06.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:06.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:06.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:06.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:07.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:31:07.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:07.152399+0000) 2019-10-23T14:31:07.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:07.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:07.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:07.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:08.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:31:08.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:08.147396+0000) 2019-10-23T14:31:08.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:08.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:08.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:08.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:09.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:31:09.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:09.111492+0000) 2019-10-23T14:31:09.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:09.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:09.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:09.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:10.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:10.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:10.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:10.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:10.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:31:10.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:10.635351+0000) 2019-10-23T14:31:11.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:11.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:11.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:11.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:12.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:12.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:12.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:12.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:13.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:13.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:13.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:13.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:13.635 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:31:13.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:13.633382+0000) 2019-10-23T14:31:14.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:14.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:14.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:14.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:14.657 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:31:14.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:14.653336+0000) 2019-10-23T14:31:15.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:15.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:15.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:15.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:16.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:16.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:16.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:16.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:17.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:31:17.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:17.152496+0000) 2019-10-23T14:31:17.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:17.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:17.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:17.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:18.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:31:18.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:18.147492+0000) 2019-10-23T14:31:18.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:18.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:18.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:18.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:19.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:31:19.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:19.111586+0000) 2019-10-23T14:31:19.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:19.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:19.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:19.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:20.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:20.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:20.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:20.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:20.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:31:20.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:20.635447+0000) 2019-10-23T14:31:21.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:21.379+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:21.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:21.379+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:22.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:22.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:22.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:22.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:23.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:23.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:23.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:23.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:23.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:31:23.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:23.633518+0000) 2019-10-23T14:31:24.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:24.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:24.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:24.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:24.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:31:24.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:24.653444+0000) 2019-10-23T14:31:25.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:25.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:25.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:25.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:26.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:26.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:26.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:26.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:27.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:31:27.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:27.152596+0000) 2019-10-23T14:31:27.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:27.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:27.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:27.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:28.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:31:28.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:28.147587+0000) 2019-10-23T14:31:28.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:28.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:28.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:28.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:29.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:31:29.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:29.111678+0000) 2019-10-23T14:31:29.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:29.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:29.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:29.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:30.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:30.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:30.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:30.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:30.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:31:30.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:30.635546+0000) 2019-10-23T14:31:31.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:31.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:31.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:31.507+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:32.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:32.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:32.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:32.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:33.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:33.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:33.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:33.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:33.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:31:33.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:33.633667+0000) 2019-10-23T14:31:34.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:34.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:34.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:34.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:34.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:31:34.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:34.653551+0000) 2019-10-23T14:31:35.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:35.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:35.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:35.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:36.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:36.553+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:36.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:36.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:37.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:31:37.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:37.152697+0000) 2019-10-23T14:31:37.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:37.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:37.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:37.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:38.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:31:38.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:38.147682+0000) 2019-10-23T14:31:38.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:38.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:38.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:38.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:39.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:31:39.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:39.111771+0000) 2019-10-23T14:31:39.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:39.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:39.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:39.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:40.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:40.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:40.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:40.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:40.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:31:40.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:40.635643+0000) 2019-10-23T14:31:41.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:41.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:41.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:41.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:42.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:42.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:42.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:42.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:43.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:43.495+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:43.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:43.495+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:43.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:31:43.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:43.633766+0000) 2019-10-23T14:31:44.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:44.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:44.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:44.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:44.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:31:44.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:44.653662+0000) 2019-10-23T14:31:45.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:45.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:45.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:45.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:46.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:46.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:46.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:46.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:47.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:31:47.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:47.152791+0000) 2019-10-23T14:31:47.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:47.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:47.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:47.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:48.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:31:48.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:48.147774+0000) 2019-10-23T14:31:48.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:48.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:48.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:48.524+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:49.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:31:49.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:49.111862+0000) 2019-10-23T14:31:49.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:49.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:49.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:49.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:50.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:50.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:50.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:50.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:50.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:31:50.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:50.635737+0000) 2019-10-23T14:31:51.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:51.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:51.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:51.546+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:52.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:52.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:52.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:52.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:53.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:53.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:53.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:53.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:53.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:31:53.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:53.633863+0000) 2019-10-23T14:31:54.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:54.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:54.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:54.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:54.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:31:54.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:54.653772+0000) 2019-10-23T14:31:55.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:55.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:55.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:55.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:56.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:56.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:56.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:56.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:57.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:31:57.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:57.152888+0000) 2019-10-23T14:31:57.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:57.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:57.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:57.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:58.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:31:58.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:58.147868+0000) 2019-10-23T14:31:58.518 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:58.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:58.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:58.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:31:59.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:31:59.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:31:59.111956+0000) 2019-10-23T14:31:59.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:59.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:31:59.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:31:59.536+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:00.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:00.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:00.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:00.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:00.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:32:00.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:00.635836+0000) 2019-10-23T14:32:01.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:01.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:01.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:01.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:02.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:02.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:02.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:02.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:03.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:03.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:03.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:03.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:03.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:32:03.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:03.633961+0000) 2019-10-23T14:32:04.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:04.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:04.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:04.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:04.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:32:04.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:04.653878+0000) 2019-10-23T14:32:05.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:05.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:05.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:05.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:06.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:06.536+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:06.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:06.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:07.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:32:07.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:07.152981+0000) 2019-10-23T14:32:07.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:07.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:07.505 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:07.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:08.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:32:08.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:08.147961+0000) 2019-10-23T14:32:08.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:08.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:08.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:08.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:09.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:32:09.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:09.112044+0000) 2019-10-23T14:32:09.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:09.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:09.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:09.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:10.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:10.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:10.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:10.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:10.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:32:10.634+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:10.635933+0000) 2019-10-23T14:32:11.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:11.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:11.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:11.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:12.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:12.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:12.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:12.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:13.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:13.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:13.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:13.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:13.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:32:13.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:13.634058+0000) 2019-10-23T14:32:14.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:14.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:14.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:14.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:14.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:32:14.652+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:14.653989+0000) 2019-10-23T14:32:15.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:15.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:15.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:15.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:16.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:16.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:16.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:16.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:17.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:32:17.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:17.153082+0000) 2019-10-23T14:32:17.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:17.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:17.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:17.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:18.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:32:18.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:18.148055+0000) 2019-10-23T14:32:18.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:18.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:18.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:18.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:19.114 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:32:19.110+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:19.112133+0000) 2019-10-23T14:32:19.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:19.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:19.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:19.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:20.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:20.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:20.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:20.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:20.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:32:20.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:20.636032+0000) 2019-10-23T14:32:21.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:21.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:21.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:21.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:22.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:22.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:22.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:22.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:23.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:23.490+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:23.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:23.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:23.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:32:23.632+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:23.634157+0000) 2019-10-23T14:32:24.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:24.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:24.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:24.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:24.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:32:24.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:24.654095+0000) 2019-10-23T14:32:25.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:25.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:25.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:25.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:26.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:26.538+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:26.544 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:26.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:27.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:32:27.151+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:27.153180+0000) 2019-10-23T14:32:27.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:27.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:27.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:27.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:28.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:32:28.146+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:28.148145+0000) 2019-10-23T14:32:28.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:28.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:28.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:28.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:29.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:32:29.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:29.112225+0000) 2019-10-23T14:32:29.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:29.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:29.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:29.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:30.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:30.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:30.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:30.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:30.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:32:30.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:30.636125+0000) 2019-10-23T14:32:31.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:31.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:31.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:31.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:32.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:32.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:32.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:32.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:33.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:33.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:33.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:33.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:33.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:32:33.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:33.634255+0000) 2019-10-23T14:32:34.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:34.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:34.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:34.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:34.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:32:34.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:34.654201+0000) 2019-10-23T14:32:35.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:35.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:35.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:35.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:36.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:36.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:36.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:36.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:37.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:32:37.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:37.153279+0000) 2019-10-23T14:32:37.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:37.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:37.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:37.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:38.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:32:38.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:38.148241+0000) 2019-10-23T14:32:38.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:38.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:38.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:38.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:39.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:32:39.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:39.112312+0000) 2019-10-23T14:32:39.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:39.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:39.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:39.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:40.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:40.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:40.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:40.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:40.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:32:40.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:40.636217+0000) 2019-10-23T14:32:41.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:41.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:41.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:41.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:42.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:42.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:42.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:42.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:43.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:43.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:43.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:43.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:43.636 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:32:43.634+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:43.634356+0000) 2019-10-23T14:32:44.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:44.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:44.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:44.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:44.658 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:32:44.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:44.654307+0000) 2019-10-23T14:32:45.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:45.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:45.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:45.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:46.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:46.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:46.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:46.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:47.155 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:32:47.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:47.153384+0000) 2019-10-23T14:32:47.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:47.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:47.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:47.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:48.150 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:32:48.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:48.148297+0000) 2019-10-23T14:32:48.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:48.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:48.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:48.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:49.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:32:49.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:49.112402+0000) 2019-10-23T14:32:49.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:49.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:49.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:49.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:50.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:50.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:50.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:50.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:50.640 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:32:50.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:50.636306+0000) 2019-10-23T14:32:51.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:51.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:51.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:51.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:52.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:52.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:52.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:52.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:53.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:53.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:53.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:53.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:53.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:32:53.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:53.634452+0000) 2019-10-23T14:32:54.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:54.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:54.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:54.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:54.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:32:54.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:54.654415+0000) 2019-10-23T14:32:55.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:55.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:55.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:55.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:56.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:56.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:56.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:56.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:57.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:32:57.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:57.153483+0000) 2019-10-23T14:32:57.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:57.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:57.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:57.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:58.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:32:58.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:58.148393+0000) 2019-10-23T14:32:58.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:58.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:58.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:58.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:32:59.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:32:59.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:32:59.112496+0000) 2019-10-23T14:32:59.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:59.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:32:59.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:32:59.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:00.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:00.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:00.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:00.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:00.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:33:00.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:00.636401+0000) 2019-10-23T14:33:01.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:01.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:01.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:01.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:02.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:02.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:02.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:02.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:03.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:03.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:03.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:03.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:03.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:03.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:03.634554+0000) 2019-10-23T14:33:04.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:04.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:04.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:04.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:04.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:33:04.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:04.654520+0000) 2019-10-23T14:33:05.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:05.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:05.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:05.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:06.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:06.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:06.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:06.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:07.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:33:07.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:07.153583+0000) 2019-10-23T14:33:07.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:07.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:07.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:07.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:08.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:33:08.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:08.148488+0000) 2019-10-23T14:33:08.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:08.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:08.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:08.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:09.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:33:09.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:09.112584+0000) 2019-10-23T14:33:09.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:09.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:09.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:09.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:10.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:10.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:10.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:10.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:10.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:33:10.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:10.636499+0000) 2019-10-23T14:33:11.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:11.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:11.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:11.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:12.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:12.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:12.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:12.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:13.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:13.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:13.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:13.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:13.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:13.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:13.634650+0000) 2019-10-23T14:33:14.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:14.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:14.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:14.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:14.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:33:14.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:14.654631+0000) 2019-10-23T14:33:15.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:15.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:15.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:15.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:16.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:16.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:16.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:16.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:17.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:33:17.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:17.153685+0000) 2019-10-23T14:33:17.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:17.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:17.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:17.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:18.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:33:18.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:18.148581+0000) 2019-10-23T14:33:18.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:18.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:18.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:18.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:19.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:33:19.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:19.112678+0000) 2019-10-23T14:33:19.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:19.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:19.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:19.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:20.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:20.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:20.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:20.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:20.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:33:20.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:20.636595+0000) 2019-10-23T14:33:21.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:21.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:21.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:21.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:22.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:22.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:22.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:22.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:23.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:23.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:23.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:23.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:23.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:23.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:23.634792+0000) 2019-10-23T14:33:24.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:24.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:24.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:24.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:24.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:33:24.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:24.654736+0000) 2019-10-23T14:33:25.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:25.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:25.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:25.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:26.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:26.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:26.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:26.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:27.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:33:27.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:27.153786+0000) 2019-10-23T14:33:27.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:27.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:27.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:27.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:28.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:33:28.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:28.148678+0000) 2019-10-23T14:33:28.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:28.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:28.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:28.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:29.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:33:29.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:29.112772+0000) 2019-10-23T14:33:29.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:29.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:29.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:29.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:30.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:30.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:30.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:30.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:30.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:33:30.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:30.636692+0000) 2019-10-23T14:33:31.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:31.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:31.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:31.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:32.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:32.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:32.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:32.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:33.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:33.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:33.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:33.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:33.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:33.633+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:33.634934+0000) 2019-10-23T14:33:34.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:34.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:34.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:34.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:34.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:33:34.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:34.654840+0000) 2019-10-23T14:33:35.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:35.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:35.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:35.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:36.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:36.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:36.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:36.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:37.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:33:37.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:37.153885+0000) 2019-10-23T14:33:37.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:37.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:37.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:37.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:38.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:33:38.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:38.148774+0000) 2019-10-23T14:33:38.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:38.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:38.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:38.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:39.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:33:39.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:39.112869+0000) 2019-10-23T14:33:39.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:39.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:39.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:39.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:40.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:40.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:40.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:40.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:40.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:33:40.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:40.636788+0000) 2019-10-23T14:33:41.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:41.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:41.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:41.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:42.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:42.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:42.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:42.472+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:43.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:43.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:43.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:43.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:43.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:43.634+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:43.635026+0000) 2019-10-23T14:33:44.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:44.534+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:44.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:44.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:44.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:33:44.653+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:44.654950+0000) 2019-10-23T14:33:45.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:45.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:45.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:45.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:46.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:46.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:46.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:46.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:47.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:33:47.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:47.153980+0000) 2019-10-23T14:33:47.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:47.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:47.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:47.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:48.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:33:48.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:48.148868+0000) 2019-10-23T14:33:48.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:48.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:48.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:48.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:49.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:33:49.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:49.112965+0000) 2019-10-23T14:33:49.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:49.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:49.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:49.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:50.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:50.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:50.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:50.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:50.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:33:50.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:50.636885+0000) 2019-10-23T14:33:51.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:51.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:51.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:51.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:52.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:52.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:52.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:52.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:53.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:53.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:53.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:53.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:53.637 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:53.634+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:53.635120+0000) 2019-10-23T14:33:53.638 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:53.635+0000 7fa170ed8700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:53.635761+0000) 2019-10-23T14:33:54.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:54.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:54.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:54.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:54.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:33:54.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:54.655058+0000) 2019-10-23T14:33:55.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:55.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:55.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:55.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:56.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:56.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:56.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:56.519+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:57.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:33:57.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:57.154078+0000) 2019-10-23T14:33:57.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:57.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:57.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:57.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:58.137 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:33:58.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:58.135298+0000) 2019-10-23T14:33:58.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:33:58.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:58.148963+0000) 2019-10-23T14:33:58.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:58.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:58.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:58.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:33:59.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:33:59.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:33:59.113056+0000) 2019-10-23T14:33:59.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:59.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:33:59.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:33:59.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:00.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:00.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:00.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:00.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:00.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:34:00.635+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:00.636981+0000) 2019-10-23T14:34:01.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:01.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:01.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:01.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:02.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:02.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:02.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:02.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:03.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:03.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:03.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:03.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:04.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:04.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:04.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:04.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:04.659 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:34:04.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:04.655166+0000) 2019-10-23T14:34:05.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:05.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:05.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:05.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:06.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:06.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:06.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:06.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:07.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:34:07.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:07.154175+0000) 2019-10-23T14:34:07.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:07.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:07.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:07.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:08.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:34:08.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:08.135394+0000) 2019-10-23T14:34:08.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:34:08.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:08.149060+0000) 2019-10-23T14:34:08.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:08.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:08.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:08.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:09.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:34:09.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:09.113155+0000) 2019-10-23T14:34:09.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:09.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:09.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:09.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:10.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:10.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:10.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:10.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:10.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:34:10.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:10.637078+0000) 2019-10-23T14:34:11.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:11.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:11.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:11.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:12.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:12.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:12.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:12.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:13.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:13.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:13.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:13.444+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:14.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:14.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:14.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:14.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:14.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:34:14.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:14.655277+0000) 2019-10-23T14:34:15.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:15.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:15.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:15.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:16.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:16.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:16.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:16.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:17.156 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:34:17.152+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:17.154274+0000) 2019-10-23T14:34:17.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:17.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:17.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:17.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:18.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:34:18.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:18.135489+0000) 2019-10-23T14:34:18.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:34:18.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:18.149158+0000) 2019-10-23T14:34:18.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:18.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:18.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:18.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:19.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:34:19.111+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:19.113253+0000) 2019-10-23T14:34:19.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:19.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:19.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:19.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:20.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:20.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:20.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:20.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:20.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:34:20.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:20.637168+0000) 2019-10-23T14:34:21.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:21.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:21.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:21.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:22.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:22.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:22.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:22.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:23.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:23.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:23.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:23.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:24.363 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:24.357+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:24.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:24.358+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:24.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:34:24.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:24.655388+0000) 2019-10-23T14:34:25.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:25.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:25.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:25.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:26.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:26.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:26.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:26.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:27.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:34:27.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:27.154382+0000) 2019-10-23T14:34:27.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:27.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:27.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:27.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:28.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:34:28.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:28.135585+0000) 2019-10-23T14:34:28.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:34:28.147+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:28.149252+0000) 2019-10-23T14:34:28.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:28.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:28.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:28.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:29.115 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:34:29.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:29.113355+0000) 2019-10-23T14:34:29.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:29.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:29.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:29.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:30.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:30.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:30.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:30.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:30.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:34:30.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:30.637258+0000) 2019-10-23T14:34:31.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:31.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:31.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:31.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:32.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:32.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:32.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:32.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:33.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:33.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:33.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:33.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:34.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:34.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:34.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:34.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:34.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:34:34.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:34.655491+0000) 2019-10-23T14:34:35.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:35.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:35.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:35.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:36.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:36.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:36.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:36.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:37.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:34:37.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:37.154484+0000) 2019-10-23T14:34:37.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:37.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:37.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:37.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:38.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:34:38.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:38.135675+0000) 2019-10-23T14:34:38.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:34:38.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:38.149297+0000) 2019-10-23T14:34:38.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:38.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:38.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:38.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:39.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:34:39.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:39.113451+0000) 2019-10-23T14:34:39.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:39.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:39.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:39.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:40.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:40.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:40.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:40.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:40.641 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:34:40.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:40.637350+0000) 2019-10-23T14:34:41.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:41.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:41.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:41.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:42.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:42.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:42.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:42.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:43.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:43.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:43.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:43.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:44.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:44.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:44.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:44.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:44.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:34:44.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:44.655598+0000) 2019-10-23T14:34:45.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:45.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:45.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:45.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:46.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:46.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:46.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:46.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:47.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:47.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:47.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:47.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:47.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:34:47.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:47.154586+0000) 2019-10-23T14:34:48.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:34:48.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:48.135774+0000) 2019-10-23T14:34:48.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:34:48.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:48.149394+0000) 2019-10-23T14:34:48.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:48.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:48.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:48.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:49.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:34:49.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:49.113544+0000) 2019-10-23T14:34:49.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:49.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:49.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:49.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:50.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:50.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:50.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:50.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:50.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:34:50.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:50.637440+0000) 2019-10-23T14:34:51.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:51.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:51.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:51.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:52.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:52.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:52.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:52.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:53.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:53.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:53.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:53.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:54.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:54.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:54.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:54.290+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:54.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:34:54.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:54.655705+0000) 2019-10-23T14:34:55.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:55.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:55.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:55.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:56.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:56.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:56.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:56.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:57.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:34:57.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:57.154685+0000) 2019-10-23T14:34:57.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:57.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:57.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:57.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:58.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:34:58.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:58.135869+0000) 2019-10-23T14:34:58.151 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:34:58.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:58.149491+0000) 2019-10-23T14:34:58.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:58.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:58.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:58.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:34:59.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:34:59.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:34:59.113635+0000) 2019-10-23T14:34:59.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:59.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:34:59.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:34:59.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:00.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:00.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:00.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:00.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:00.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:35:00.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:00.637531+0000) 2019-10-23T14:35:01.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:01.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:01.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:01.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:02.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:02.377+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:02.383 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:02.377+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:03.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:03.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:03.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:03.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:04.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:04.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:04.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:04.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:04.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:35:04.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:04.655814+0000) 2019-10-23T14:35:05.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:05.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:05.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:05.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:06.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:06.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:06.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:06.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:07.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:35:07.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:07.154778+0000) 2019-10-23T14:35:07.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:07.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:07.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:07.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:08.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:35:08.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:08.135962+0000) 2019-10-23T14:35:08.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:35:08.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:08.149587+0000) 2019-10-23T14:35:08.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:08.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:08.403 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:08.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:09.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:35:09.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:09.113732+0000) 2019-10-23T14:35:09.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:09.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:09.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:09.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:10.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:10.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:10.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:10.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:10.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:35:10.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:10.637624+0000) 2019-10-23T14:35:11.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:11.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:11.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:11.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:12.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:12.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:12.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:12.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:13.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:13.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:13.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:13.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:14.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:14.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:14.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:14.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:14.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:35:14.654+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:14.655925+0000) 2019-10-23T14:35:15.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:15.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:15.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:15.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:16.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:16.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:16.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:16.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:17.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:35:17.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:17.154876+0000) 2019-10-23T14:35:17.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:17.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:17.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:17.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:18.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:35:18.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:18.136101+0000) 2019-10-23T14:35:18.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:35:18.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:18.149721+0000) 2019-10-23T14:35:18.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:18.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:18.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:18.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:19.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:35:19.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:19.113835+0000) 2019-10-23T14:35:19.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:19.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:19.367 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:19.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:20.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:20.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:20.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:20.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:20.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:35:20.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:20.637720+0000) 2019-10-23T14:35:21.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:21.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:21.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:21.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:22.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:22.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:22.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:22.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:23.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:23.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:23.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:23.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:24.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:24.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:24.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:24.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:24.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:35:24.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:24.656039+0000) 2019-10-23T14:35:25.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:25.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:25.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:25.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:26.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:26.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:26.358 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:26.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:27.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:35:27.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:27.154974+0000) 2019-10-23T14:35:27.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:27.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:27.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:27.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:28.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:35:28.134+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:28.136248+0000) 2019-10-23T14:35:28.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:35:28.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:28.149864+0000) 2019-10-23T14:35:28.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:28.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:28.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:28.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:29.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:35:29.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:29.113929+0000) 2019-10-23T14:35:29.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:29.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:29.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:29.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:30.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:30.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:30.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:30.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:30.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:35:30.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:30.637818+0000) 2019-10-23T14:35:31.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:31.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:31.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:31.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:32.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:32.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:32.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:32.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:33.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:33.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:33.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:33.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:34.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:34.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:34.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:34.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:34.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:35:34.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:34.656144+0000) 2019-10-23T14:35:35.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:35.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:35.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:35.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:36.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:36.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:36.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:36.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:37.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:35:37.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:37.155075+0000) 2019-10-23T14:35:37.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:37.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:37.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:37.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:38.138 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:35:38.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:38.136301+0000) 2019-10-23T14:35:38.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:35:38.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:38.149957+0000) 2019-10-23T14:35:38.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:38.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:38.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:38.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:39.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:35:39.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:39.114019+0000) 2019-10-23T14:35:39.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:39.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:39.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:39.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:40.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:40.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:40.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:40.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:40.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:35:40.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:40.637912+0000) 2019-10-23T14:35:41.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:41.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:41.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:41.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:42.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:42.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:42.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:42.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:43.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:43.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:43.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:43.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:44.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:44.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:44.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:44.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:44.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:35:44.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:44.656255+0000) 2019-10-23T14:35:45.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:45.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:45.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:45.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:46.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:46.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:46.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:46.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:47.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:35:47.153+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:47.155173+0000) 2019-10-23T14:35:47.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:47.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:47.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:47.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:48.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:35:48.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:48.136400+0000) 2019-10-23T14:35:48.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:35:48.148+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:48.150052+0000) 2019-10-23T14:35:48.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:48.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:48.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:48.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:49.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:35:49.112+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:49.114108+0000) 2019-10-23T14:35:49.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:49.290+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:49.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:49.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:50.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:50.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:50.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:50.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:50.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:35:50.636+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:50.638005+0000) 2019-10-23T14:35:51.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:51.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:51.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:51.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:52.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:52.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:52.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:52.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:53.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:53.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:53.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:53.340+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:54.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:54.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:54.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:54.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:54.660 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:35:54.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:54.656364+0000) 2019-10-23T14:35:55.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:55.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:55.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:55.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:56.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:56.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:56.294 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:56.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:57.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:35:57.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:57.155265+0000) 2019-10-23T14:35:57.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:57.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:57.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:57.298+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:58.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:35:58.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:58.136500+0000) 2019-10-23T14:35:58.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:35:58.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:58.150145+0000) 2019-10-23T14:35:58.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:58.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:58.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:58.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:35:59.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:35:59.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:35:59.114200+0000) 2019-10-23T14:35:59.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:59.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:35:59.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:35:59.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:00.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:00.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:00.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:00.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:00.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:36:00.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:00.638102+0000) 2019-10-23T14:36:01.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:01.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:01.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:01.163+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:02.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:02.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:02.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:02.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:03.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:03.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:03.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:03.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:04.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:04.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:04.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:04.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:04.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:36:04.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:04.656474+0000) 2019-10-23T14:36:05.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:05.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:05.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:05.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:06.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:06.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:06.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:06.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:07.157 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:36:07.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:07.155366+0000) 2019-10-23T14:36:07.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:07.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:07.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:07.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:08.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:36:08.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:08.136599+0000) 2019-10-23T14:36:08.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:36:08.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:08.150244+0000) 2019-10-23T14:36:08.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:08.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:08.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:08.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:09.116 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:36:09.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:09.114293+0000) 2019-10-23T14:36:09.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:09.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:09.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:09.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:10.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:10.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:10.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:10.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:10.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:36:10.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:10.638194+0000) 2019-10-23T14:36:11.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:11.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:11.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:11.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:12.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:12.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:12.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:12.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:13.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:13.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:13.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:13.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:14.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:14.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:14.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:14.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:14.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:36:14.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:14.656585+0000) 2019-10-23T14:36:15.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:15.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:15.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:15.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:16.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:16.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:16.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:16.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:17.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:17.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:17.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:17.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:17.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:36:17.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:17.155468+0000) 2019-10-23T14:36:18.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:18.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:18.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:18.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:18.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:36:18.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:18.136694+0000) 2019-10-23T14:36:18.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:36:18.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:18.150343+0000) 2019-10-23T14:36:19.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:19.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:19.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:19.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:19.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:36:19.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:19.114391+0000) 2019-10-23T14:36:20.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:20.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:20.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:20.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:20.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:36:20.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:20.638285+0000) 2019-10-23T14:36:21.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:21.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:21.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:21.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:22.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:22.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:22.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:22.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:23.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:22.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:23.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:22.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:24.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:24.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:24.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:24.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:24.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:36:24.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:24.656695+0000) 2019-10-23T14:36:24.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:24.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:24.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:24.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:26.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:25.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:26.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:25.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:26.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:26.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:26.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:26.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:27.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:36:27.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:27.155569+0000) 2019-10-23T14:36:27.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:27.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:27.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:27.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:28.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:36:28.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:28.136780+0000) 2019-10-23T14:36:28.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:36:28.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:28.150437+0000) 2019-10-23T14:36:28.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:28.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:28.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:28.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:29.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:36:29.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:29.114486+0000) 2019-10-23T14:36:30.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:30.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:30.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:30.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:30.642 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:36:30.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:30.638378+0000) 2019-10-23T14:36:30.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:30.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:30.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:30.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:31.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:31.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:31.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:31.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:32.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:32.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:32.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:32.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:33.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:33.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:33.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:33.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:34.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:36:34.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:34.656802+0000) 2019-10-23T14:36:34.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:34.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:34.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:34.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:35.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:35.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:35.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:35.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:36.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:36.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:36.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:36.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:37.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:36:37.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:37.155663+0000) 2019-10-23T14:36:37.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:37.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:37.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:37.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:38.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:36:38.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:38.136874+0000) 2019-10-23T14:36:38.152 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:36:38.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:38.150533+0000) 2019-10-23T14:36:38.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:38.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:38.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:38.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:39.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:36:39.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:39.114580+0000) 2019-10-23T14:36:39.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:39.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:39.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:39.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:40.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:36:40.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:40.638475+0000) 2019-10-23T14:36:40.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:40.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:40.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:40.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:41.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:41.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:41.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:41.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:42.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:42.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:42.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:42.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:43.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:43.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:43.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:43.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:44.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:36:44.655+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:44.656912+0000) 2019-10-23T14:36:44.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:44.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:44.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:44.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:45.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:45.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:45.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:45.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:46.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:46.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:46.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:46.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:47.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:36:47.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:47.155761+0000) 2019-10-23T14:36:47.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:47.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:47.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:47.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:48.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:36:48.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:48.136969+0000) 2019-10-23T14:36:48.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:36:48.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:48.150626+0000) 2019-10-23T14:36:48.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:48.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:48.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:48.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:49.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:36:49.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:49.114673+0000) 2019-10-23T14:36:49.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:49.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:49.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:49.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:50.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:36:50.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:50.638567+0000) 2019-10-23T14:36:50.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:50.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:50.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:50.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:51.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:51.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:51.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:51.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:52.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:52.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:52.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:52.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:53.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:53.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:53.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:53.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:54.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:36:54.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:54.657021+0000) 2019-10-23T14:36:54.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:54.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:54.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:54.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:55.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:55.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:55.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:55.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:56.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:56.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:56.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:56.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:57.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:36:57.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:57.155859+0000) 2019-10-23T14:36:57.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:57.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:57.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:57.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:58.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:36:58.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:58.137066+0000) 2019-10-23T14:36:58.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:36:58.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:58.150724+0000) 2019-10-23T14:36:58.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:58.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:58.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:58.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:36:59.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:36:59.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:36:59.114768+0000) 2019-10-23T14:36:59.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:59.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:36:59.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:36:59.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:00.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:37:00.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:00.638663+0000) 2019-10-23T14:37:00.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:00.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:00.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:00.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:01.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:01.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:01.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:01.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:02.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:02.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:02.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:02.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:03.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:03.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:03.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:03.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:04.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:37:04.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:04.657134+0000) 2019-10-23T14:37:04.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:04.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:04.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:04.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:05.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:05.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:05.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:05.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:06.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:06.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:06.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:06.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:07.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:37:07.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:07.155958+0000) 2019-10-23T14:37:07.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:07.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:07.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:07.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:08.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:37:08.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:08.137161+0000) 2019-10-23T14:37:08.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:37:08.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:08.150822+0000) 2019-10-23T14:37:08.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:08.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:08.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:08.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:09.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:37:09.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:09.114862+0000) 2019-10-23T14:37:09.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:09.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:09.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:09.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:10.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:37:10.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:10.638758+0000) 2019-10-23T14:37:10.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:10.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:10.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:10.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:11.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:11.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:11.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:11.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:12.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:12.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:12.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:12.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:13.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:13.726+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:13.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:13.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:14.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:37:14.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:14.657240+0000) 2019-10-23T14:37:14.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:14.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:14.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:14.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:15.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:15.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:15.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:15.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:16.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:16.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:16.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:16.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:17.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:37:17.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:17.156059+0000) 2019-10-23T14:37:17.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:17.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:17.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:17.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:18.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:37:18.135+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:18.137254+0000) 2019-10-23T14:37:18.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:37:18.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:18.150918+0000) 2019-10-23T14:37:18.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:18.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:18.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:18.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:19.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:37:19.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:19.114953+0000) 2019-10-23T14:37:19.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:19.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:19.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:19.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:20.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:37:20.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:20.638854+0000) 2019-10-23T14:37:20.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:20.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:20.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:20.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:21.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:21.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:21.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:21.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:22.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:22.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:22.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:22.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:23.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:23.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:23.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:23.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:24.661 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:37:24.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:24.657346+0000) 2019-10-23T14:37:24.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:24.695+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:24.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:24.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:25.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:25.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:25.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:25.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:26.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:26.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:26.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:26.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:27.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:37:27.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:27.156157+0000) 2019-10-23T14:37:27.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:27.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:27.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:27.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:28.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:37:28.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:28.137347+0000) 2019-10-23T14:37:28.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:37:28.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:28.151013+0000) 2019-10-23T14:37:28.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:28.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:28.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:28.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:29.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:37:29.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:29.115042+0000) 2019-10-23T14:37:29.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:29.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:29.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:29.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:30.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:30.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:30.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:30.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:30.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:37:30.637+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:30.638950+0000) 2019-10-23T14:37:31.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:31.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:31.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:31.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:32.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:32.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:32.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:32.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:33.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:33.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:33.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:33.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:34.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:37:34.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:34.657453+0000) 2019-10-23T14:37:34.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:34.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:34.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:34.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:35.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:35.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:35.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:35.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:36.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:36.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:36.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:36.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:37.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:37:37.154+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:37.156254+0000) 2019-10-23T14:37:37.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:37.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:37.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:37.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:38.139 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:37:38.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:38.137445+0000) 2019-10-23T14:37:38.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:37:38.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:38.151108+0000) 2019-10-23T14:37:38.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:38.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:38.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:38.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:39.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:37:39.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:39.115134+0000) 2019-10-23T14:37:39.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:39.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:39.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:39.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:40.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:40.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:40.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:40.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:40.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:37:40.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:40.639048+0000) 2019-10-23T14:37:41.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:41.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:41.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:41.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:42.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:42.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:42.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:42.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:43.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:43.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:43.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:43.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:44.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:44.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:44.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:44.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:44.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:37:44.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:44.657565+0000) 2019-10-23T14:37:45.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:45.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:45.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:45.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:46.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:46.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:46.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:46.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:47.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:37:47.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:47.156354+0000) 2019-10-23T14:37:47.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:47.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:47.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:47.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:48.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:37:48.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:48.137541+0000) 2019-10-23T14:37:48.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:37:48.149+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:48.151200+0000) 2019-10-23T14:37:48.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:48.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:48.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:48.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:49.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:37:49.113+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:49.115226+0000) 2019-10-23T14:37:49.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:49.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:49.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:49.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:50.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:37:50.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:50.639144+0000) 2019-10-23T14:37:50.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:50.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:50.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:50.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:51.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:51.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:51.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:51.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:52.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:52.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:52.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:52.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:53.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:53.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:53.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:53.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:54.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:37:54.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:54.657672+0000) 2019-10-23T14:37:54.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:54.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:54.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:54.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:55.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:55.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:55.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:55.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:56.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:56.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:56.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:56.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:57.158 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:37:57.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:57.156452+0000) 2019-10-23T14:37:57.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:57.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:57.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:57.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:58.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:37:58.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:58.137636+0000) 2019-10-23T14:37:58.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:37:58.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:58.151296+0000) 2019-10-23T14:37:58.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:58.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:58.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:58.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:37:59.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:37:59.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:37:59.115319+0000) 2019-10-23T14:37:59.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:59.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:37:59.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:37:59.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:00.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:38:00.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:00.639242+0000) 2019-10-23T14:38:00.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:00.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:00.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:00.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:01.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:01.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:01.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:01.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:02.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:02.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:02.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:02.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:03.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:03.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:03.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:03.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:04.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:38:04.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:04.657778+0000) 2019-10-23T14:38:04.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:04.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:04.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:04.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:05.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:05.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:05.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:05.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:06.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:06.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:06.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:06.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:07.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:38:07.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:07.156552+0000) 2019-10-23T14:38:07.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:07.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:07.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:07.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:08.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:38:08.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:08.137728+0000) 2019-10-23T14:38:08.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:38:08.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:08.151390+0000) 2019-10-23T14:38:08.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:08.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:08.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:08.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:09.117 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:38:09.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:09.115413+0000) 2019-10-23T14:38:09.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:09.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:09.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:09.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:10.643 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:38:10.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:10.639340+0000) 2019-10-23T14:38:10.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:10.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:10.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:10.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:11.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:11.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:11.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:11.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:12.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:12.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:12.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:12.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:13.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:13.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:13.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:13.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:14.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:14.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:14.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:14.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:14.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:38:14.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:14.657888+0000) 2019-10-23T14:38:15.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:15.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:15.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:15.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:16.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:16.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:16.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:16.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:17.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:38:17.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:17.156648+0000) 2019-10-23T14:38:17.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:17.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:17.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:17.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:18.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:38:18.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:18.137822+0000) 2019-10-23T14:38:18.153 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:38:18.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:18.151481+0000) 2019-10-23T14:38:18.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:18.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:18.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:18.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:19.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:38:19.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:19.115508+0000) 2019-10-23T14:38:19.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:19.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:19.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:19.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:20.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:20.472+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:20.478 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:20.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:20.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:38:20.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:20.639436+0000) 2019-10-23T14:38:21.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:21.519+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:21.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:21.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:22.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:22.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:22.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:22.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:23.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:23.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:23.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:23.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:24.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:24.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:24.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:24.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:24.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:38:24.656+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:24.657998+0000) 2019-10-23T14:38:25.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:25.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:25.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:25.490+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:26.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:26.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:26.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:26.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:27.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:38:27.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:27.156746+0000) 2019-10-23T14:38:27.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:27.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:27.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:27.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:28.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:38:28.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:28.137916+0000) 2019-10-23T14:38:28.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:38:28.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:28.151575+0000) 2019-10-23T14:38:28.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:28.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:28.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:28.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:29.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:38:29.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:29.115600+0000) 2019-10-23T14:38:29.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:29.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:29.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:29.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:30.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:30.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:30.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:30.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:30.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:38:30.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:30.639528+0000) 2019-10-23T14:38:31.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:31.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:31.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:31.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:32.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:32.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:32.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:32.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:33.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:33.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:33.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:33.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:34.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:34.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:34.343 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:34.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:34.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:38:34.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:34.658111+0000) 2019-10-23T14:38:35.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:35.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:35.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:35.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:36.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:36.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:36.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:36.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:37.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:38:37.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:37.156840+0000) 2019-10-23T14:38:37.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:37.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:37.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:37.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:38.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:38:38.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:38.138011+0000) 2019-10-23T14:38:38.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:38:38.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:38.151671+0000) 2019-10-23T14:38:38.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:38.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:38.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:38.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:39.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:38:39.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:39.115696+0000) 2019-10-23T14:38:39.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:39.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:39.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:39.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:40.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:40.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:40.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:40.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:40.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:38:40.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:40.639645+0000) 2019-10-23T14:38:41.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:41.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:41.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:41.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:42.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:42.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:42.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:42.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:43.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:43.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:43.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:43.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:44.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:44.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:44.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:44.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:44.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:38:44.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:44.658215+0000) 2019-10-23T14:38:45.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:45.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:45.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:45.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:46.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:46.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:46.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:46.501+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:47.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:38:47.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:47.156934+0000) 2019-10-23T14:38:47.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:47.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:47.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:47.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:48.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:38:48.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:48.138105+0000) 2019-10-23T14:38:48.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:38:48.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:48.151767+0000) 2019-10-23T14:38:48.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:48.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:48.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:48.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:49.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:38:49.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:49.115792+0000) 2019-10-23T14:38:49.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:49.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:49.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:49.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:50.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:50.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:50.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:50.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:50.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:38:50.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:50.639740+0000) 2019-10-23T14:38:51.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:51.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:51.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:51.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:52.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:52.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:52.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:52.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:53.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:53.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:53.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:53.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:54.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:54.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:54.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:54.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:54.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:38:54.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:54.658322+0000) 2019-10-23T14:38:55.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:55.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:55.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:55.385+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:56.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:56.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:56.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:56.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:57.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:38:57.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:57.157029+0000) 2019-10-23T14:38:57.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:57.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:57.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:57.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:58.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:38:58.136+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:58.138197+0000) 2019-10-23T14:38:58.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:38:58.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:58.151861+0000) 2019-10-23T14:38:58.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:58.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:58.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:58.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:38:59.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:38:59.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:38:59.115887+0000) 2019-10-23T14:38:59.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:59.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:38:59.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:38:59.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:00.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:00.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:00.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:00.513+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:00.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:39:00.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:00.639836+0000) 2019-10-23T14:39:01.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:01.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:01.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:01.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:02.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:02.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:02.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:02.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:03.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:03.508+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:03.514 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:03.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:04.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:04.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:04.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:04.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:04.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:39:04.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:04.658428+0000) 2019-10-23T14:39:05.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:05.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:05.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:05.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:06.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:06.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:06.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:06.483+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:07.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:39:07.155+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:07.157121+0000) 2019-10-23T14:39:07.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:07.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:07.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:07.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:08.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:39:08.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:08.138296+0000) 2019-10-23T14:39:08.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:39:08.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:08.151956+0000) 2019-10-23T14:39:08.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:08.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:08.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:08.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:09.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:39:09.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:09.115982+0000) 2019-10-23T14:39:09.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:09.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:09.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:09.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:10.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:10.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:10.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:10.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:10.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:39:10.638+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:10.639953+0000) 2019-10-23T14:39:11.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:11.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:11.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:11.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:12.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:12.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:12.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:12.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:13.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:13.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:13.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:13.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:14.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:14.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:14.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:14.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:14.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:39:14.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:14.658538+0000) 2019-10-23T14:39:15.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:15.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:15.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:15.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:16.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:16.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:16.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:16.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:17.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:39:17.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:17.157219+0000) 2019-10-23T14:39:17.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:17.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:17.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:17.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:18.140 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:39:18.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:18.138390+0000) 2019-10-23T14:39:18.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:39:18.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:18.152046+0000) 2019-10-23T14:39:18.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:18.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:18.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:18.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:19.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:39:19.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:19.116076+0000) 2019-10-23T14:39:19.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:19.627+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:19.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:19.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:20.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:39:20.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:20.640052+0000) 2019-10-23T14:39:20.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:20.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:28:44.537981+0000 (oldest deadline 2019-10-23T14:29:04.537981+0000) 2019-10-23T14:39:20.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:20.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:21.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:21.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:22.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:22.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:23.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:23.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:24.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:24.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:24.662 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:39:24.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:24.658642+0000) 2019-10-23T14:39:25.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:25.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:26.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:26.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:27.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:39:27.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:27.157299+0000) 2019-10-23T14:39:27.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:27.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:28.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:39:28.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:28.138486+0000) 2019-10-23T14:39:28.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:39:28.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:28.152140+0000) 2019-10-23T14:39:28.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:28.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:29.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:39:29.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:29.116164+0000) 2019-10-23T14:39:29.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:29.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:30.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:30.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:30.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:39:30.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:30.640148+0000) 2019-10-23T14:39:31.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:31.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:32.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:32.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:33.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:33.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:34.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:39:34.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:34.658747+0000) 2019-10-23T14:39:34.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:34.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:35.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:35.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:36.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:36.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:37.159 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:39:37.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:37.157396+0000) 2019-10-23T14:39:37.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:37.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:38.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:39:38.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:38.138580+0000) 2019-10-23T14:39:38.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:39:38.150+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:38.152232+0000) 2019-10-23T14:39:38.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:38.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:39.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:39:39.114+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:39.116259+0000) 2019-10-23T14:39:39.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:39.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:40.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:39:40.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:40.640245+0000) 2019-10-23T14:39:40.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:40.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:41.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:41.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:42.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:42.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:43.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:43.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:43.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:43.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:44.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:44.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:44.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:44.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:44.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:39:44.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:44.658857+0000) 2019-10-23T14:39:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:45.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:45.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:45.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:46.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:46.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:46.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:46.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:47.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:39:47.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:47.157492+0000) 2019-10-23T14:39:47.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:47.668+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:47.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:47.668+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:48.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:39:48.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:48.138676+0000) 2019-10-23T14:39:48.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:39:48.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:48.152329+0000) 2019-10-23T14:39:48.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:48.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:48.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:48.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:49.118 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:39:49.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:49.116357+0000) 2019-10-23T14:39:49.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:49.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:49.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:49.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:50.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:39:50.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:50.640336+0000) 2019-10-23T14:39:50.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:50.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:50.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:50.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:51.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:51.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:51.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:51.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:52.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:52.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:52.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:52.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:53.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:53.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:53.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:53.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:54.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:54.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:54.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:54.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:54.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:39:54.657+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:54.658966+0000) 2019-10-23T14:39:55.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:55.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:55.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:55.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:56.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:56.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:56.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:56.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:57.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:39:57.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:57.157592+0000) 2019-10-23T14:39:57.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:57.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:57.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:57.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:58.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:39:58.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:58.138774+0000) 2019-10-23T14:39:58.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:39:58.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:58.152421+0000) 2019-10-23T14:39:58.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:58.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:58.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:58.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:39:59.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:39:59.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:39:59.116448+0000) 2019-10-23T14:39:59.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:59.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:39:59.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:39:59.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:00.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:40:00.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:00.640429+0000) 2019-10-23T14:40:00.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:00.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:00.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:00.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:01.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:01.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:01.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:01.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:02.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:02.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:02.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:02.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:03.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:03.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:03.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:03.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:04.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:40:04.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:04.659072+0000) 2019-10-23T14:40:04.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:04.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:04.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:04.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:05.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:05.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:05.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:05.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:06.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:06.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:06.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:06.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:07.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:40:07.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:07.157694+0000) 2019-10-23T14:40:07.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:07.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:07.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:07.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:08.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:40:08.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:08.138871+0000) 2019-10-23T14:40:08.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:40:08.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:08.152513+0000) 2019-10-23T14:40:08.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:08.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:08.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:08.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:09.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:40:09.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:09.116537+0000) 2019-10-23T14:40:09.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:09.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:09.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:09.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:10.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:10.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:10.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:10.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:10.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:40:10.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:10.640522+0000) 2019-10-23T14:40:11.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:11.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:11.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:11.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:12.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:12.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:12.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:12.574+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:13.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:13.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:13.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:13.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:14.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:14.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:14.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:14.569+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:14.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:40:14.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:14.659180+0000) 2019-10-23T14:40:15.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:15.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:15.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:15.526+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:16.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:16.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:16.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:16.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:17.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:40:17.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:17.157790+0000) 2019-10-23T14:40:17.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:17.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:17.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:17.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:18.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:40:18.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:18.138967+0000) 2019-10-23T14:40:18.154 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:40:18.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:18.152612+0000) 2019-10-23T14:40:18.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:18.540+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:18.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:18.540+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:19.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:40:19.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:19.116635+0000) 2019-10-23T14:40:19.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:19.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:19.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:19.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:20.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:20.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:20.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:20.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:20.644 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:40:20.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:20.640616+0000) 2019-10-23T14:40:21.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:21.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:21.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:21.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:22.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:22.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:22.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:22.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:23.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:23.544+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:23.550 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:23.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:24.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:24.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:24.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:24.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:24.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:40:24.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:24.659287+0000) 2019-10-23T14:40:25.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:25.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:25.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:25.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:26.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:26.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:26.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:26.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:27.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:40:27.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:27.157883+0000) 2019-10-23T14:40:27.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:27.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:27.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:27.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:28.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:40:28.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:28.139062+0000) 2019-10-23T14:40:28.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:40:28.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:28.152709+0000) 2019-10-23T14:40:28.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:28.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:28.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:28.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:29.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:40:29.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:29.116725+0000) 2019-10-23T14:40:29.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:29.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:29.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:29.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:30.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:30.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:30.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:30.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:30.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:40:30.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:30.640707+0000) 2019-10-23T14:40:31.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:31.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:31.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:31.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:32.494 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:32.489+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:32.495 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:32.489+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:33.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:33.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:33.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:33.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:34.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:34.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:34.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:34.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:34.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:40:34.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:34.659392+0000) 2019-10-23T14:40:35.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:35.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:35.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:35.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:36.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:36.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:36.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:36.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:37.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:40:37.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:37.157975+0000) 2019-10-23T14:40:37.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:37.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:37.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:37.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:38.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:40:38.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:38.139158+0000) 2019-10-23T14:40:38.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:40:38.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:38.152800+0000) 2019-10-23T14:40:38.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:38.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:38.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:38.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:39.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:40:39.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:39.116818+0000) 2019-10-23T14:40:39.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:39.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:39.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:39.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:40.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:40.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:40.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:40.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:40.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:40:40.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:40.640799+0000) 2019-10-23T14:40:41.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:41.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:41.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:41.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:42.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:42.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:42.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:42.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:43.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:43.364+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:43.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:43.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:44.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:44.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:44.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:44.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:44.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:40:44.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:44.659498+0000) 2019-10-23T14:40:45.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:45.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:45.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:45.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:46.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:46.387+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:46.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:46.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:47.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:40:47.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:47.158071+0000) 2019-10-23T14:40:47.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:47.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:47.392 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:47.387+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:48.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:40:48.137+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:48.139249+0000) 2019-10-23T14:40:48.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:40:48.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:48.152893+0000) 2019-10-23T14:40:48.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:48.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:48.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:48.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:49.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:40:49.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:49.116911+0000) 2019-10-23T14:40:49.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:49.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:49.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:49.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:50.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:50.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:50.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:50.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:50.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:40:50.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:50.640893+0000) 2019-10-23T14:40:51.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:51.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:51.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:51.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:52.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:52.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:52.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:52.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:53.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:53.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:53.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:53.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:54.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:54.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:54.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:54.449+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:54.663 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:40:54.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:54.659608+0000) 2019-10-23T14:40:55.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:55.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:55.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:55.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:56.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:56.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:56.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:56.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:57.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:40:57.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:57.158170+0000) 2019-10-23T14:40:57.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:57.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:57.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:57.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:58.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:40:58.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:58.139297+0000) 2019-10-23T14:40:58.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:40:58.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:58.152983+0000) 2019-10-23T14:40:58.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:58.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:58.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:58.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:40:59.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:40:59.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:40:59.117005+0000) 2019-10-23T14:40:59.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:59.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:40:59.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:40:59.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:00.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:00.440+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:00.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:00.440+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:00.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:41:00.639+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:00.640986+0000) 2019-10-23T14:41:01.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:01.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:01.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:01.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:02.452 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:02.447+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:02.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:02.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:03.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:03.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:03.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:03.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:04.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:04.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:04.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:04.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:04.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:41:04.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:04.659714+0000) 2019-10-23T14:41:05.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:05.512+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:05.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:05.512+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:06.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:06.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:06.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:06.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:07.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:41:07.156+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:07.158263+0000) 2019-10-23T14:41:07.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:07.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:07.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:07.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:08.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:41:08.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:08.139390+0000) 2019-10-23T14:41:08.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:41:08.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:08.153075+0000) 2019-10-23T14:41:08.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:08.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:08.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:08.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:09.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:41:09.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:09.117097+0000) 2019-10-23T14:41:09.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:09.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:09.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:09.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:10.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:10.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:10.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:10.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:10.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:41:10.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:10.641077+0000) 2019-10-23T14:41:11.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:11.515+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:11.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:11.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:12.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:12.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:12.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:12.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:13.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:13.483+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:13.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:13.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:14.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:14.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:14.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:14.478+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:14.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:41:14.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:14.659823+0000) 2019-10-23T14:41:15.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:15.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:15.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:15.521+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:16.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:16.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:16.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:16.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:17.160 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:41:17.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:17.158363+0000) 2019-10-23T14:41:17.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:17.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:17.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:17.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:18.141 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:41:18.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:18.139481+0000) 2019-10-23T14:41:18.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:41:18.151+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:18.153168+0000) 2019-10-23T14:41:18.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:18.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:18.541 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:18.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:19.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:41:19.115+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:19.117188+0000) 2019-10-23T14:41:19.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:19.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:19.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:19.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:20.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:20.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:20.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:20.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:20.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:41:20.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:20.641173+0000) 2019-10-23T14:41:21.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:21.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:21.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:21.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:22.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:22.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:22.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:22.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:23.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:23.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:23.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:23.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:24.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:24.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:24.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:24.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:24.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:41:24.658+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:24.659932+0000) 2019-10-23T14:41:25.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:25.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:25.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:25.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:26.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:26.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:26.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:26.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:27.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:41:27.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:27.158461+0000) 2019-10-23T14:41:27.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:27.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:27.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:27.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:28.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:41:28.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:28.139574+0000) 2019-10-23T14:41:28.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:41:28.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:28.153262+0000) 2019-10-23T14:41:28.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:28.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:28.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:28.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:29.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:41:29.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:29.117280+0000) 2019-10-23T14:41:29.411 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:29.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:29.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:29.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:30.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:30.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:30.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:30.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:30.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:41:30.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:30.641261+0000) 2019-10-23T14:41:31.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:31.464+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:31.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:31.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:32.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:32.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:32.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:32.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:33.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:33.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:33.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:33.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:34.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:34.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:34.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:34.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:34.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:41:34.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:34.660044+0000) 2019-10-23T14:41:35.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:35.439+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:35.445 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:35.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:36.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:36.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:36.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:36.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:37.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:41:37.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:37.158560+0000) 2019-10-23T14:41:37.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:37.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:37.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:37.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:38.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:41:38.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:38.139672+0000) 2019-10-23T14:41:38.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:41:38.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:38.153358+0000) 2019-10-23T14:41:38.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:38.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:38.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:38.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:39.119 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:41:39.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:39.117379+0000) 2019-10-23T14:41:39.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:39.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:39.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:39.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:40.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:40.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:40.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:40.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:40.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:41:40.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:40.641350+0000) 2019-10-23T14:41:41.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:41.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:41.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:41.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:42.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:42.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:42.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:42.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:43.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:43.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:43.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:43.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:44.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:44.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:44.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:44.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:44.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:41:44.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:44.660154+0000) 2019-10-23T14:41:45.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:45.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:45.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:45.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:46.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:46.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:46.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:46.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:47.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:41:47.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:47.158656+0000) 2019-10-23T14:41:47.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:47.419+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:47.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:47.419+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:48.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:41:48.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:48.139762+0000) 2019-10-23T14:41:48.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:41:48.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:48.153450+0000) 2019-10-23T14:41:48.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:48.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:48.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:48.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:49.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:41:49.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:49.117475+0000) 2019-10-23T14:41:49.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:49.374+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:49.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:49.374+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:50.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:50.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:50.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:50.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:50.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:41:50.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:50.641444+0000) 2019-10-23T14:41:51.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:51.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:51.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:51.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:52.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:52.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:52.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:52.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:53.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:53.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:53.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:53.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:54.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:54.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:54.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:54.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:54.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:41:54.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:54.660261+0000) 2019-10-23T14:41:55.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:55.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:55.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:55.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:56.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:56.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:56.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:56.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:57.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:41:57.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:57.158760+0000) 2019-10-23T14:41:57.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:57.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:57.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:57.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:58.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:41:58.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:58.139855+0000) 2019-10-23T14:41:58.155 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:41:58.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:58.153543+0000) 2019-10-23T14:41:58.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:58.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:58.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:58.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:41:59.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:41:59.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:41:59.117569+0000) 2019-10-23T14:41:59.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:59.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:41:59.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:41:59.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:00.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:00.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:00.449 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:00.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:00.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:42:00.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:00.641541+0000) 2019-10-23T14:42:01.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:01.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:01.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:01.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:02.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:02.432+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:02.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:02.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:03.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:03.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:03.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:03.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:04.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:04.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:04.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:04.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:04.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:42:04.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:04.660368+0000) 2019-10-23T14:42:05.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:05.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:05.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:05.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:06.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:06.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:06.517 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:06.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:07.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:42:07.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:07.158857+0000) 2019-10-23T14:42:07.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:07.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:07.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:07.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:08.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:42:08.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:08.139950+0000) 2019-10-23T14:42:08.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:42:08.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:08.153637+0000) 2019-10-23T14:42:08.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:08.535+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:08.540 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:08.535+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:09.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:42:09.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:09.117665+0000) 2019-10-23T14:42:09.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:09.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:09.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:09.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:10.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:10.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:10.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:10.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:10.645 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:42:10.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:10.641631+0000) 2019-10-23T14:42:11.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:11.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:11.643 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:11.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:12.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:12.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:12.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:12.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:13.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:13.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:13.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:13.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:14.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:14.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:14.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:14.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:14.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:42:14.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:14.660478+0000) 2019-10-23T14:42:15.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:15.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:15.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:15.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:16.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:16.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:16.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:16.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:17.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:42:17.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:17.158954+0000) 2019-10-23T14:42:17.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:17.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:17.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:17.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:18.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:42:18.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:18.140048+0000) 2019-10-23T14:42:18.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:42:18.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:18.153730+0000) 2019-10-23T14:42:18.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:18.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:18.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:18.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:19.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:42:19.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:19.117760+0000) 2019-10-23T14:42:19.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:19.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:19.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:19.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:20.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:42:20.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:20.641727+0000) 2019-10-23T14:42:20.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:20.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:20.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:20.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:21.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:21.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:21.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:21.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:22.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:22.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:22.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:22.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:23.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:23.641+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:23.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:23.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:24.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:24.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:24.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:24.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:24.664 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:42:24.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:24.660585+0000) 2019-10-23T14:42:25.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:25.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:25.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:25.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:26.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:26.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:26.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:26.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:27.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:42:27.157+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:27.159051+0000) 2019-10-23T14:42:27.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:27.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:27.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:27.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:28.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:42:28.138+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:28.140144+0000) 2019-10-23T14:42:28.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:42:28.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:28.153825+0000) 2019-10-23T14:42:28.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:28.569+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:28.575 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:28.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:29.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:42:29.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:29.117852+0000) 2019-10-23T14:42:29.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:29.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:29.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:29.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:30.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:30.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:30.528 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:30.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:30.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:42:30.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:30.641821+0000) 2019-10-23T14:42:31.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:31.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:31.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:31.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:32.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:32.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:32.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:32.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:33.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:33.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:33.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:33.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:34.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:34.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:34.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:34.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:34.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:42:34.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:34.660694+0000) 2019-10-23T14:42:35.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:35.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:35.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:35.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:36.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:36.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:36.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:36.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:37.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:42:37.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:37.159145+0000) 2019-10-23T14:42:37.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:37.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:37.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:37.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:38.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:42:38.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:38.140237+0000) 2019-10-23T14:42:38.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:42:38.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:38.153917+0000) 2019-10-23T14:42:38.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:38.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:38.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:38.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:39.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:42:39.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:39.117946+0000) 2019-10-23T14:42:39.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:39.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:39.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:39.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:40.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:40.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:40.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:40.595+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:40.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:42:40.640+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:40.641919+0000) 2019-10-23T14:42:41.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:41.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:41.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:41.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:42.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:42.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:42.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:42.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:43.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:43.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:43.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:43.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:44.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:44.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:44.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:44.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:44.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:42:44.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:44.660805+0000) 2019-10-23T14:42:45.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:45.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:45.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:45.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:46.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:46.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:46.600 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:46.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:47.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:42:47.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:47.159237+0000) 2019-10-23T14:42:47.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:47.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:47.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:47.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:48.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:42:48.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:48.140329+0000) 2019-10-23T14:42:48.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:42:48.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:48.154010+0000) 2019-10-23T14:42:48.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:48.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:48.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:48.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:49.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:42:49.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:49.118034+0000) 2019-10-23T14:42:49.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:49.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:49.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:49.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:50.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:50.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:50.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:50.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:50.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:42:50.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:50.642018+0000) 2019-10-23T14:42:51.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:51.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:51.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:51.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:52.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:52.548+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:52.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:52.548+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:53.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:53.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:53.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:53.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:54.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:54.558+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:54.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:54.558+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:54.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:42:54.659+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:54.660912+0000) 2019-10-23T14:42:55.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:55.566+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:55.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:55.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:56.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:56.543+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:56.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:56.544+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:57.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:42:57.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:57.159299+0000) 2019-10-23T14:42:57.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:57.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:57.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:57.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:58.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:42:58.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:58.140420+0000) 2019-10-23T14:42:58.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:42:58.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:58.154107+0000) 2019-10-23T14:42:58.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:58.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:58.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:58.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:42:59.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:42:59.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:42:59.118125+0000) 2019-10-23T14:42:59.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:59.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:42:59.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:42:59.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:00.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:00.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:00.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:00.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:00.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:43:00.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:00.642116+0000) 2019-10-23T14:43:01.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:01.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:01.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:02.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:02.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:02.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:02.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:03.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:03.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:03.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:03.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:04.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:04.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:04.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:04.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:04.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:43:04.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:04.661021+0000) 2019-10-23T14:43:05.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:05.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:05.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:05.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:06.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:06.599+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:06.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:06.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:07.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:43:07.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:07.159403+0000) 2019-10-23T14:43:07.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:07.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:07.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:07.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:08.142 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:43:08.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:08.140512+0000) 2019-10-23T14:43:08.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:43:08.152+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:08.154198+0000) 2019-10-23T14:43:08.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:08.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:08.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:08.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:09.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:43:09.116+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:09.118220+0000) 2019-10-23T14:43:09.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:09.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:09.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:09.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:10.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:10.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:10.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:10.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:10.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:43:10.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:10.642215+0000) 2019-10-23T14:43:11.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:11.505+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:11.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:11.505+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:12.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:12.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:12.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:12.459+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:13.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:13.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:13.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:13.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:14.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:14.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:14.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:14.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:14.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:43:14.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:14.661135+0000) 2019-10-23T14:43:15.463 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:15.458+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:15.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:15.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:16.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:16.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:16.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:16.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:17.161 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:43:17.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:17.159497+0000) 2019-10-23T14:43:17.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:17.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:17.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:17.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:18.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:43:18.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:18.140602+0000) 2019-10-23T14:43:18.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:43:18.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:18.154297+0000) 2019-10-23T14:43:18.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:18.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:18.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:18.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:19.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:43:19.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:19.118295+0000) 2019-10-23T14:43:19.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:19.516+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:19.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:19.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:20.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:20.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:20.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:20.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:20.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:43:20.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:20.642312+0000) 2019-10-23T14:43:21.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:21.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:21.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:21.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:22.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:22.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:22.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:22.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:23.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:23.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:23.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:23.552+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:24.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:24.551+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:24.557 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:24.551+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:24.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:43:24.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:24.661243+0000) 2019-10-23T14:43:25.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:25.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:25.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:25.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:26.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:26.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:26.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:26.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:27.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:43:27.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:27.159591+0000) 2019-10-23T14:43:27.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:27.523+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:27.534 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:27.523+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:28.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:43:28.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:28.140695+0000) 2019-10-23T14:43:28.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:43:28.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:28.154391+0000) 2019-10-23T14:43:28.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:28.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:28.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:28.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:29.120 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:43:29.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:29.118387+0000) 2019-10-23T14:43:29.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:29.532+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:29.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:29.532+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:30.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:30.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:30.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:30.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:30.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:43:30.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:30.642411+0000) 2019-10-23T14:43:31.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:31.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:31.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:31.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:32.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:32.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:32.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:32.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:33.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:33.513+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:33.519 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:33.514+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:34.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:34.545+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:34.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:34.545+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:34.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:43:34.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:34.661351+0000) 2019-10-23T14:43:35.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:35.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:35.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:35.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:36.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:36.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:36.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:36.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:37.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:43:37.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:37.159690+0000) 2019-10-23T14:43:37.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:37.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:37.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:37.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:38.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:43:38.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:38.140791+0000) 2019-10-23T14:43:38.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:43:38.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:38.154486+0000) 2019-10-23T14:43:38.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:38.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:38.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:38.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:39.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:43:39.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:39.118480+0000) 2019-10-23T14:43:39.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:39.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:39.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:39.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:40.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:40.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:40.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:40.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:40.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:43:40.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:40.642510+0000) 2019-10-23T14:43:41.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:41.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:41.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:41.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:42.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:42.537+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:42.543 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:42.537+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:43.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:43.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:43.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:43.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:44.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:44.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:44.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:44.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:44.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:43:44.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:44.661460+0000) 2019-10-23T14:43:45.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:45.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:45.581 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:45.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:46.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:46.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:46.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:46.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:47.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:43:47.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:47.159787+0000) 2019-10-23T14:43:47.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:47.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:47.556 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:47.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:48.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:43:48.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:48.140886+0000) 2019-10-23T14:43:48.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:43:48.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:48.154582+0000) 2019-10-23T14:43:48.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:48.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:48.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:48.559+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:49.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:43:49.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:49.118571+0000) 2019-10-23T14:43:49.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:49.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:49.577 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:49.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:50.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:50.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:50.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:50.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:50.646 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:43:50.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:50.642608+0000) 2019-10-23T14:43:51.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:51.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:51.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:51.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:52.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:52.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:52.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:52.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:53.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:53.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:53.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:53.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:54.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:54.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:54.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:54.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:54.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:43:54.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:54.661569+0000) 2019-10-23T14:43:55.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:55.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:55.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:55.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:56.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:56.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:56.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:56.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:57.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:43:57.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:57.159886+0000) 2019-10-23T14:43:57.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:57.614+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:57.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:57.614+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:58.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:43:58.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:58.140979+0000) 2019-10-23T14:43:58.156 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:43:58.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:58.154678+0000) 2019-10-23T14:43:58.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:58.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:58.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:58.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:43:59.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:43:59.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:43:59.118665+0000) 2019-10-23T14:43:59.538 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:59.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:43:59.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:43:59.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:00.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:00.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:00.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:00.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:00.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:44:00.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:00.642704+0000) 2019-10-23T14:44:01.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:01.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:01.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:01.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:02.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:02.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:02.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:02.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:03.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:03.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:03.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:03.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:04.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:04.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:04.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:04.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:04.665 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:44:04.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:04.661675+0000) 2019-10-23T14:44:05.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:05.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:05.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:05.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:06.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:06.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:06.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:06.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:07.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:44:07.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:07.159983+0000) 2019-10-23T14:44:07.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:07.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:07.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:07.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:08.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:44:08.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:08.141072+0000) 2019-10-23T14:44:08.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:44:08.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:08.154771+0000) 2019-10-23T14:44:08.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:08.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:08.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:08.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:09.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:44:09.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:09.118759+0000) 2019-10-23T14:44:09.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:09.589+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:09.595 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:09.589+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:10.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:10.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:10.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:10.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:10.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:44:10.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:10.642798+0000) 2019-10-23T14:44:11.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:11.596+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:11.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:11.596+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:12.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:12.592+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:12.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:12.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:13.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:13.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:13.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:13.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:14.559 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:14.554+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:14.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:14.554+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:14.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:44:14.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:14.661785+0000) 2019-10-23T14:44:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:15.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:15.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:15.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:16.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:16.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:16.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:16.577+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:17.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:44:17.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:17.160080+0000) 2019-10-23T14:44:17.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:17.531+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:17.537 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:17.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:18.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:44:18.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:18.141165+0000) 2019-10-23T14:44:18.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:44:18.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:18.154861+0000) 2019-10-23T14:44:18.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:18.573+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:18.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:18.573+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:19.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:44:19.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:19.118860+0000) 2019-10-23T14:44:19.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:19.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:19.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:19.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:20.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:20.585+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:20.590 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:20.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:20.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:44:20.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:20.642892+0000) 2019-10-23T14:44:21.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:21.572+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:21.579 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:21.572+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:22.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:22.574+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:22.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:22.575+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:23.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:23.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:23.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:23.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:24.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:24.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:24.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:24.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:24.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:44:24.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:24.661895+0000) 2019-10-23T14:44:25.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:25.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:25.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:25.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:26.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:26.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:26.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:26.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:27.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:44:27.158+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:27.160182+0000) 2019-10-23T14:44:27.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:27.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:27.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:27.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:28.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:44:28.139+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:28.141256+0000) 2019-10-23T14:44:28.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:44:28.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:28.154951+0000) 2019-10-23T14:44:28.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:28.571+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:28.576 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:28.571+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:29.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:44:29.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:29.118953+0000) 2019-10-23T14:44:29.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:29.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:29.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:29.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:30.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:30.613+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:30.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:30.613+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:30.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:44:30.641+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:30.642992+0000) 2019-10-23T14:44:31.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:31.594+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:31.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:31.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:32.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:32.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:32.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:32.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:33.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:33.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:33.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:33.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:34.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:34.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:34.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:34.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:34.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:44:34.660+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:34.662004+0000) 2019-10-23T14:44:35.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:35.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:35.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:35.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:36.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:36.528+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:36.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:36.528+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:37.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:44:37.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:37.160280+0000) 2019-10-23T14:44:37.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:37.499+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:37.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:37.499+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:38.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:44:38.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:38.141350+0000) 2019-10-23T14:44:38.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:44:38.153+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:38.155039+0000) 2019-10-23T14:44:38.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:38.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:38.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:38.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:39.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:44:39.117+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:39.119050+0000) 2019-10-23T14:44:39.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:39.500+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:39.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:39.500+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:40.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:40.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:40.504 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:40.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:40.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:44:40.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:40.643091+0000) 2019-10-23T14:44:41.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:41.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:41.547 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:41.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:42.511 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:42.506+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:42.512 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:42.506+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:43.531 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:43.526+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:43.533 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:43.527+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:44.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:44.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:44.554 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:44.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:44.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:44:44.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:44.662117+0000) 2019-10-23T14:44:45.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:45.520+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:45.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:45.520+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:46.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:46.562+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:46.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:46.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:47.162 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:44:47.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:47.160378+0000) 2019-10-23T14:44:47.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:47.533+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:47.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:47.533+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:48.143 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:44:48.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:48.141443+0000) 2019-10-23T14:44:48.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:44:48.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:48.155137+0000) 2019-10-23T14:44:48.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:48.541+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:48.546 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:48.541+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:49.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:44:49.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:49.119160+0000) 2019-10-23T14:44:49.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:49.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:49.536 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:49.530+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:50.565 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:50.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:50.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:50.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:50.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:44:50.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:50.643185+0000) 2019-10-23T14:44:51.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:51.590+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:51.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:51.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:52.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:52.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:52.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:52.624+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:53.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:53.609+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:53.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:53.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:54.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:54.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:54.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:54.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:54.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:44:54.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:54.662227+0000) 2019-10-23T14:44:55.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:55.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:55.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:55.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:56.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:56.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:56.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:56.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:57.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:44:57.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:57.160475+0000) 2019-10-23T14:44:57.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:57.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:57.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:57.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:58.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:44:58.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:58.141541+0000) 2019-10-23T14:44:58.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:44:58.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:58.155233+0000) 2019-10-23T14:44:58.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:58.651+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:58.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:58.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:44:59.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:44:59.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:44:59.119255+0000) 2019-10-23T14:44:59.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:59.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:44:59.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:44:59.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:00.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:45:00.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:00.643282+0000) 2019-10-23T14:45:00.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:00.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:00.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:00.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:01.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:01.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:01.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:01.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:02.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:02.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:02.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:02.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:03.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:03.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:03.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:03.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:04.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:45:04.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:04.662337+0000) 2019-10-23T14:45:04.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:04.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:04.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:04.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:05.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:05.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:05.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:05.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:06.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:06.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:06.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:06.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:07.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:45:07.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:07.160575+0000) 2019-10-23T14:45:07.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:07.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:07.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:07.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:08.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:45:08.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:08.141632+0000) 2019-10-23T14:45:08.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:45:08.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:08.155328+0000) 2019-10-23T14:45:08.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:08.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:08.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:08.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:09.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:45:09.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:09.119353+0000) 2019-10-23T14:45:09.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:09.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:09.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:09.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:10.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:45:10.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:10.643378+0000) 2019-10-23T14:45:10.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:10.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:10.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:10.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:11.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:11.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:11.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:11.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:12.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:12.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:12.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:12.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:13.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:13.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:13.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:13.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:14.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:45:14.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:14.662445+0000) 2019-10-23T14:45:14.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:14.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:14.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:14.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:15.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:15.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:15.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:15.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:16.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:16.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:16.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:16.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:17.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:45:17.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:17.160668+0000) 2019-10-23T14:45:17.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:17.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:17.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:17.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:18.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:45:18.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:18.141723+0000) 2019-10-23T14:45:18.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:45:18.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:18.155422+0000) 2019-10-23T14:45:18.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:18.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:18.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:18.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:19.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:45:19.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:19.119449+0000) 2019-10-23T14:45:19.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:19.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:19.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:19.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:20.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:45:20.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:20.643475+0000) 2019-10-23T14:45:20.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:20.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:20.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:20.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:21.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:21.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:21.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:21.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:22.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:22.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:22.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:22.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:23.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:23.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:23.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:23.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:24.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:45:24.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:24.662554+0000) 2019-10-23T14:45:24.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:24.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:24.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:24.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:25.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:25.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:25.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:25.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:26.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:26.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:26.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:26.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:27.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:45:27.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:27.160763+0000) 2019-10-23T14:45:27.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:27.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:27.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:27.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:28.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:45:28.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:28.141818+0000) 2019-10-23T14:45:28.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:45:28.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:28.155519+0000) 2019-10-23T14:45:28.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:28.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:28.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:28.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:29.121 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:45:29.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:29.119540+0000) 2019-10-23T14:45:29.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:29.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:29.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:29.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:30.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:45:30.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:30.643574+0000) 2019-10-23T14:45:30.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:30.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:30.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:30.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:31.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:31.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:31.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:31.775+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:32.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:32.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:32.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:32.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:33.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:33.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:33.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:33.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:34.666 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:45:34.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:34.662660+0000) 2019-10-23T14:45:34.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:34.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:34.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:34.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:35.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:35.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:35.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:35.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:36.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:36.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:36.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:36.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:37.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:45:37.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:37.160857+0000) 2019-10-23T14:45:37.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:37.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:37.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:37.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:38.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:45:38.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:38.141911+0000) 2019-10-23T14:45:38.157 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:45:38.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:38.155608+0000) 2019-10-23T14:45:38.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:38.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:38.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:38.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:39.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:45:39.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:39.119636+0000) 2019-10-23T14:45:39.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:39.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:39.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:39.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:40.647 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:45:40.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:40.643673+0000) 2019-10-23T14:45:40.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:40.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:40.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:40.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:41.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:41.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:41.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:41.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:42.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:42.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:42.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:42.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:43.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:43.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:43.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:43.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:44.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:45:44.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:44.662769+0000) 2019-10-23T14:45:44.677 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:44.672+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:44.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:44.672+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:45.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:45.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:45.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:45.654+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:46.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:46.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:46.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:46.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:47.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:45:47.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:47.160953+0000) 2019-10-23T14:45:47.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:47.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:47.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:47.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:48.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:45:48.140+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:48.142007+0000) 2019-10-23T14:45:48.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:45:48.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:48.155702+0000) 2019-10-23T14:45:48.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:48.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:48.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:48.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:49.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:45:49.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:49.119729+0000) 2019-10-23T14:45:49.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:49.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:49.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:49.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:50.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:45:50.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:50.643770+0000) 2019-10-23T14:45:50.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:50.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:50.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:50.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:51.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:51.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:51.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:51.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:52.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:52.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:52.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:52.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:53.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:53.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:53.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:53.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:54.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:45:54.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:54.662880+0000) 2019-10-23T14:45:54.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:54.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:54.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:54.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:55.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:55.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:55.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:55.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:56.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:56.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:56.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:56.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:57.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:45:57.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:57.161052+0000) 2019-10-23T14:45:57.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:57.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:57.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:57.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:58.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:45:58.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:58.142097+0000) 2019-10-23T14:45:58.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:45:58.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:58.155799+0000) 2019-10-23T14:45:58.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:58.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:58.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:58.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:45:59.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:45:59.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:45:59.119821+0000) 2019-10-23T14:45:59.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:59.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:45:59.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:45:59.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:00.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:00.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:00.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:00.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:00.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:46:00.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:00.643867+0000) 2019-10-23T14:46:01.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:01.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:01.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:01.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:02.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:02.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:02.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:02.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:03.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:03.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:03.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:03.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:04.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:04.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:04.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:04.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:04.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:46:04.661+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:04.662987+0000) 2019-10-23T14:46:05.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:05.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:05.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:05.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:06.651 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:06.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:06.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:06.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:07.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:46:07.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:07.161147+0000) 2019-10-23T14:46:07.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:07.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:07.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:07.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:08.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:46:08.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:08.142187+0000) 2019-10-23T14:46:08.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:46:08.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:08.155893+0000) 2019-10-23T14:46:08.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:08.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:08.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:08.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:09.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:46:09.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:09.119916+0000) 2019-10-23T14:46:09.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:09.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:09.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:09.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:10.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:46:10.642+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:10.643966+0000) 2019-10-23T14:46:10.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:10.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:10.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:10.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:11.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:11.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:11.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:11.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:12.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:12.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:12.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:12.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:13.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:13.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:13.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:13.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:14.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:46:14.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:14.663098+0000) 2019-10-23T14:46:14.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:14.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:14.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:14.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:15.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:15.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:15.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:15.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:16.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:16.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:16.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:16.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:17.172 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:46:17.159+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:17.161242+0000) 2019-10-23T14:46:17.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:17.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:17.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:17.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:18.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:46:18.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:18.142281+0000) 2019-10-23T14:46:18.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:46:18.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:18.155989+0000) 2019-10-23T14:46:18.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:18.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:18.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:18.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:19.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:46:19.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:19.120008+0000) 2019-10-23T14:46:19.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:19.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:19.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:19.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:20.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:46:20.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:20.644065+0000) 2019-10-23T14:46:20.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:20.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:20.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:20.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:21.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:21.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:21.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:21.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:22.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:22.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:22.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:22.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:23.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:23.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:23.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:23.674+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:24.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:46:24.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:24.663207+0000) 2019-10-23T14:46:24.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:24.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:24.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:24.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:25.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:25.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:25.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:25.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:26.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:26.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:26.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:26.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:27.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:46:27.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:27.161337+0000) 2019-10-23T14:46:27.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:27.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:27.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:27.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:28.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:46:28.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:28.142378+0000) 2019-10-23T14:46:28.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:46:28.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:28.156079+0000) 2019-10-23T14:46:28.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:28.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:28.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:28.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:29.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:46:29.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:29.120102+0000) 2019-10-23T14:46:29.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:29.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:29.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:29.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:30.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:46:30.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:30.644166+0000) 2019-10-23T14:46:30.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:30.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:30.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:30.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:31.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:31.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:31.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:31.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:32.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:32.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:32.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:32.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:33.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:33.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:33.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:33.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:34.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:46:34.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:34.663316+0000) 2019-10-23T14:46:34.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:34.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:34.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:34.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:35.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:35.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:35.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:35.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:36.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:36.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:36.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:36.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:37.163 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:46:37.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:37.161433+0000) 2019-10-23T14:46:37.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:37.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:37.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:37.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:38.144 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:46:38.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:38.142471+0000) 2019-10-23T14:46:38.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:46:38.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:38.156175+0000) 2019-10-23T14:46:38.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:38.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:38.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:38.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:39.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:46:39.118+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:39.120201+0000) 2019-10-23T14:46:39.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:39.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:39.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:39.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:40.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:46:40.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:40.644268+0000) 2019-10-23T14:46:40.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:40.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:40.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:40.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:41.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:41.647+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:41.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:41.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:42.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:42.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:42.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:42.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:43.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:43.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:43.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:43.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:44.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:44.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:44.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:44.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:44.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:46:44.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:44.663423+0000) 2019-10-23T14:46:45.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:45.591+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:45.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:45.591+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:46.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:46.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:46.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:46.555+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:47.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:46:47.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:47.161528+0000) 2019-10-23T14:46:47.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:47.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:47.569 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:47.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:48.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:46:48.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:48.142565+0000) 2019-10-23T14:46:48.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:46:48.154+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:48.156267+0000) 2019-10-23T14:46:48.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:48.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:48.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:48.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:49.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:46:49.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:49.120297+0000) 2019-10-23T14:46:49.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:49.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:49.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:49.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:50.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:50.617+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:50.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:50.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:50.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:46:50.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:50.644369+0000) 2019-10-23T14:46:51.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:51.657+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:51.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:51.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:52.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:52.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:52.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:52.706+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:53.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:53.712+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:53.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:53.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:54.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:46:54.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:54.663534+0000) 2019-10-23T14:46:54.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:54.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:54.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:54.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:55.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:55.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:55.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:55.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:56.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:56.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:56.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:56.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:57.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:46:57.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:57.161628+0000) 2019-10-23T14:46:57.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:57.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:57.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:57.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:58.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:46:58.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:58.142661+0000) 2019-10-23T14:46:58.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:46:58.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:58.156361+0000) 2019-10-23T14:46:58.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:58.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:58.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:58.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:46:59.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:46:59.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:46:59.120389+0000) 2019-10-23T14:46:59.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:59.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:46:59.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:46:59.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:00.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:47:00.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:00.644469+0000) 2019-10-23T14:47:00.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:00.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:00.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:00.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:01.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:01.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:01.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:01.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:02.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:02.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:02.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:02.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:03.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:03.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:03.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:03.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:04.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:04.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:04.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:04.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:04.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:47:04.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:04.663644+0000) 2019-10-23T14:47:05.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:05.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:05.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:05.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:06.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:06.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:06.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:06.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:07.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:47:07.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:07.161725+0000) 2019-10-23T14:47:07.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:07.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:07.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:07.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:08.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:47:08.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:08.142757+0000) 2019-10-23T14:47:08.158 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:47:08.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:08.156466+0000) 2019-10-23T14:47:08.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:08.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:08.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:08.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:09.122 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:47:09.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:09.120486+0000) 2019-10-23T14:47:09.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:09.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:09.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:09.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:10.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:10.602+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:10.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:10.602+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:10.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:47:10.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:10.644568+0000) 2019-10-23T14:47:11.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:11.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:11.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:11.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:12.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:12.616+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:12.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:12.617+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:13.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:13.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:13.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:13.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:14.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:14.632+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:14.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:14.632+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:14.667 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:47:14.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:14.663752+0000) 2019-10-23T14:47:15.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:15.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:15.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:15.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:16.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:16.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:16.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:16.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:17.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:47:17.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:17.161823+0000) 2019-10-23T14:47:17.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:17.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:17.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:17.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:18.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:47:18.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:18.142849+0000) 2019-10-23T14:47:18.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:47:18.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:18.156558+0000) 2019-10-23T14:47:18.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:18.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:18.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:18.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:19.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:47:19.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:19.120587+0000) 2019-10-23T14:47:19.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:19.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:19.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:19.633+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:20.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:20.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:20.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:20.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:20.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:47:20.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:20.644667+0000) 2019-10-23T14:47:21.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:21.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:21.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:21.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:22.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:22.557+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:22.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:22.557+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:23.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:23.514+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:23.520 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:23.515+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:24.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:24.469+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:24.475 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:24.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:24.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:47:24.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:24.663862+0000) 2019-10-23T14:47:25.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:25.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:25.524 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:25.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:26.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:26.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:26.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:26.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:27.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:47:27.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:27.161921+0000) 2019-10-23T14:47:27.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:27.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:27.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:27.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:28.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:47:28.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:28.142944+0000) 2019-10-23T14:47:28.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:47:28.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:28.156652+0000) 2019-10-23T14:47:28.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:28.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:28.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:28.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:29.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:47:29.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:29.120675+0000) 2019-10-23T14:47:29.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:29.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:29.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:29.496+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:30.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:30.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:30.479 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:30.474+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:30.648 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:47:30.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:30.644767+0000) 2019-10-23T14:47:31.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:31.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:31.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:31.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:32.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:32.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:32.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:32.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:33.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:33.441+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:33.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:33.441+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:34.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:34.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:34.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:34.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:34.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:47:34.662+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:34.663973+0000) 2019-10-23T14:47:35.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:35.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:35.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:35.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:36.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:36.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:36.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:36.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:37.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:47:37.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:37.162018+0000) 2019-10-23T14:47:37.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:37.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:37.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:37.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:38.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:47:38.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:38.143043+0000) 2019-10-23T14:47:38.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:47:38.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:38.156743+0000) 2019-10-23T14:47:38.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:38.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:38.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:38.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:39.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:47:39.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:39.120771+0000) 2019-10-23T14:47:39.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:39.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:39.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:39.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:40.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:40.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:40.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:40.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:40.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:47:40.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:40.644867+0000) 2019-10-23T14:47:41.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:41.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:41.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:41.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:42.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:42.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:42.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:42.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:43.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:43.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:43.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:43.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:44.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:44.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:44.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:44.352+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:44.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:47:44.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:44.664081+0000) 2019-10-23T14:47:45.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:45.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:45.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:45.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:46.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:46.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:46.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:46.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:47.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:47:47.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:47.162115+0000) 2019-10-23T14:47:47.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:47.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:47.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:47.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:48.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:47:48.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:48.143131+0000) 2019-10-23T14:47:48.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:47:48.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:48.156839+0000) 2019-10-23T14:47:48.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:48.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:48.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:48.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:49.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:47:49.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:49.120868+0000) 2019-10-23T14:47:49.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:49.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:49.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:49.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:50.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:50.271+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:50.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:50.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:50.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:47:50.643+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:50.644964+0000) 2019-10-23T14:47:51.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:51.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:51.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:51.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:52.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:52.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:52.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:52.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:53.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:53.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:53.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:53.276+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:54.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:54.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:54.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:54.309+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:54.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:47:54.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:54.664190+0000) 2019-10-23T14:47:55.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:55.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:55.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:55.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:56.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:56.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:56.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:56.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:57.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:47:57.160+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:57.162209+0000) 2019-10-23T14:47:57.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:57.263+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:57.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:57.264+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:58.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:47:58.141+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:58.143226+0000) 2019-10-23T14:47:58.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:47:58.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:58.156932+0000) 2019-10-23T14:47:58.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:58.256+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:58.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:58.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:47:59.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:47:59.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:47:59.120962+0000) 2019-10-23T14:47:59.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:59.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:47:59.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:47:59.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:00.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:00.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:00.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:00.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:00.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:48:00.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:00.645063+0000) 2019-10-23T14:48:01.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:01.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:01.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:01.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:02.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:02.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:02.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:02.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:03.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:03.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:03.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:03.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:04.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:04.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:04.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:04.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:04.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:48:04.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:04.664295+0000) 2019-10-23T14:48:05.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:05.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:05.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:05.333+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:06.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:06.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:06.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:06.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:07.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:48:07.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:07.162300+0000) 2019-10-23T14:48:07.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:07.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:07.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:07.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:08.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:48:08.143+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:08.143298+0000) 2019-10-23T14:48:08.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:48:08.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:08.157022+0000) 2019-10-23T14:48:08.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:08.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:08.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:08.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:09.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:48:09.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:09.121060+0000) 2019-10-23T14:48:09.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:09.288+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:09.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:09.288+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:10.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:10.254+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:10.259 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:10.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:10.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:48:10.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:10.645162+0000) 2019-10-23T14:48:11.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:11.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:11.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:11.256+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:12.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:12.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:12.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:12.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:13.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:13.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:13.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:13.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:14.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:14.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:14.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:14.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:14.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:48:14.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:14.664398+0000) 2019-10-23T14:48:15.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:15.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:15.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:15.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:16.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:16.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:16.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:16.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:17.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:48:17.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:17.162401+0000) 2019-10-23T14:48:17.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:17.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:17.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:17.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:18.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:48:18.143+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:18.143396+0000) 2019-10-23T14:48:18.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:18.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:18.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:18.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:18.161 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:48:18.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:18.157121+0000) 2019-10-23T14:48:19.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:48:19.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:19.121155+0000) 2019-10-23T14:48:19.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:19.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:19.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:19.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:20.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:20.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:20.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:20.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:20.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:48:20.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:20.645260+0000) 2019-10-23T14:48:21.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:21.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:21.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:21.170+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:22.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:22.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:22.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:22.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:23.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:23.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:23.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:23.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:24.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:24.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:24.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:24.149+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:24.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:48:24.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:24.664505+0000) 2019-10-23T14:48:25.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:25.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:25.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:25.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:26.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:26.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:26.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:26.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:27.164 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:48:27.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:27.162503+0000) 2019-10-23T14:48:27.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:27.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:27.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:27.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:28.145 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:48:28.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:28.143492+0000) 2019-10-23T14:48:28.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:48:28.155+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:28.157216+0000) 2019-10-23T14:48:28.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:28.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:28.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:28.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:29.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:48:29.119+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:29.121247+0000) 2019-10-23T14:48:29.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:29.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:29.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:29.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:30.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:30.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:30.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:30.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:30.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:48:30.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:30.645359+0000) 2019-10-23T14:48:31.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:31.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:31.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:31.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:32.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:32.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:32.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:32.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:33.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:33.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:33.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:33.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:34.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:34.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:34.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:34.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:34.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:48:34.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:34.664613+0000) 2019-10-23T14:48:35.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:35.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:35.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:35.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:36.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:36.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:36.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:36.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:37.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:37.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:37.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:37.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:37.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:48:37.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:37.162601+0000) 2019-10-23T14:48:38.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:38.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:38.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:38.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:38.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:48:38.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:38.143580+0000) 2019-10-23T14:48:38.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:48:38.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:38.157304+0000) 2019-10-23T14:48:39.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:39.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:39.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:39.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:39.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:48:39.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:39.121341+0000) 2019-10-23T14:48:40.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:40.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:40.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:40.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:40.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:48:40.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:40.645456+0000) 2019-10-23T14:48:41.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:41.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:41.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:41.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:41.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:41.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:41.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:41.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:42.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:42.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:42.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:42.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:44.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:44.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:44.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:44.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:44.668 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:48:44.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:44.664722+0000) 2019-10-23T14:48:45.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:45.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:45.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:45.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:46.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:46.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:46.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:46.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:46.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:46.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:46.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:46.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:47.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:48:47.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:47.162699+0000) 2019-10-23T14:48:48.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:48.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:48.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:48.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:48.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:48:48.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:48.143675+0000) 2019-10-23T14:48:48.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:48:48.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:48.157398+0000) 2019-10-23T14:48:49.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:49.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:49.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:49.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:49.123 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:48:49.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:49.121440+0000) 2019-10-23T14:48:50.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:50.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:50.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:50.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:50.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:48:50.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:50.645551+0000) 2019-10-23T14:48:51.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:50.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:51.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:50.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:51.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:51.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:51.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:51.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:53.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:53.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:53.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:53.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:53.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:53.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:53.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:53.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:54.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:48:54.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:54.664831+0000) 2019-10-23T14:48:54.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:54.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:54.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:54.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:55.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:55.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:55.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:55.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:56.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:56.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:56.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:56.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:57.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:48:57.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:57.162796+0000) 2019-10-23T14:48:57.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:57.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:57.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:57.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:58.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:48:58.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:58.143768+0000) 2019-10-23T14:48:58.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:48:58.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:58.157493+0000) 2019-10-23T14:48:58.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:58.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:58.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:58.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:48:59.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:48:59.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:48:59.121530+0000) 2019-10-23T14:48:59.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:59.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:48:59.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:48:59.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:00.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:49:00.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:00.645650+0000) 2019-10-23T14:49:00.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:00.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:00.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:00.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:01.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:01.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:01.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:01.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:02.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:02.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:02.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:02.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:03.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:03.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:03.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:03.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:04.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:49:04.663+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:04.664940+0000) 2019-10-23T14:49:04.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:04.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:04.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:04.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:05.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:05.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:05.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:05.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:06.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:06.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:06.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:06.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:07.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:49:07.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:07.162888+0000) 2019-10-23T14:49:07.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:07.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:07.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:07.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:08.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:49:08.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:08.143863+0000) 2019-10-23T14:49:08.159 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:49:08.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:08.157587+0000) 2019-10-23T14:49:08.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:08.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:08.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:08.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:09.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:49:09.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:09.121622+0000) 2019-10-23T14:49:09.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:09.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:09.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:09.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:10.649 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:49:10.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:10.645749+0000) 2019-10-23T14:49:10.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:10.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:10.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:10.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:11.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:11.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:11.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:11.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:12.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:12.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:12.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:12.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:13.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:13.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:13.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:13.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:14.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:49:14.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:14.665056+0000) 2019-10-23T14:49:14.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:14.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:14.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:14.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:15.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:15.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:15.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:15.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:16.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:16.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:16.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:16.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:17.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:49:17.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:17.162986+0000) 2019-10-23T14:49:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:17.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:17.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:17.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:18.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:49:18.143+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:18.143955+0000) 2019-10-23T14:49:18.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:49:18.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:18.157684+0000) 2019-10-23T14:49:18.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:18.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:18.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:18.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:19.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:49:19.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:19.121717+0000) 2019-10-23T14:49:19.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:19.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:19.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:19.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:20.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:49:20.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:20.645841+0000) 2019-10-23T14:49:20.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:20.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:20.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:20.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:21.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:21.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:21.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:21.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:22.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:22.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:22.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:22.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:23.645+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:23.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:23.645+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:24.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:49:24.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:24.665164+0000) 2019-10-23T14:49:24.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:24.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:24.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:24.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:25.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:25.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:25.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:25.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:26.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:26.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:26.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:26.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:27.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:49:27.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:27.163085+0000) 2019-10-23T14:49:27.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:27.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:27.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:27.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:28.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:49:28.143+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:28.144051+0000) 2019-10-23T14:49:28.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:49:28.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:28.157779+0000) 2019-10-23T14:49:28.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:28.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:28.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:28.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:29.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:49:29.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:29.121810+0000) 2019-10-23T14:49:29.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:29.673+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:29.678 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:29.673+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:30.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:49:30.644+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:30.645931+0000) 2019-10-23T14:49:30.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:30.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:30.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:30.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:31.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:31.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:31.676 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:31.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:32.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:32.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:32.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:32.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:33.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:33.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:33.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:33.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:34.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:34.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:34.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:34.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:34.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:49:34.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:34.665272+0000) 2019-10-23T14:49:35.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:35.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:35.616 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:35.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:36.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:36.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:36.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:36.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:37.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:49:37.161+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:37.163184+0000) 2019-10-23T14:49:37.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:37.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:37.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:37.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:38.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:49:38.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:38.144145+0000) 2019-10-23T14:49:38.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:49:38.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:38.157873+0000) 2019-10-23T14:49:38.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:38.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:38.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:38.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:39.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:49:39.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:39.121903+0000) 2019-10-23T14:49:39.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:39.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:39.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:39.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:40.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:40.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:40.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:40.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:40.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:49:40.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:40.646028+0000) 2019-10-23T14:49:41.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:41.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:41.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:41.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:42.561 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:42.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:42.562 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:42.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:43.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:43.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:43.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:43.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:44.593 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:44.588+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:44.594 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:44.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:44.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:49:44.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:44.665378+0000) 2019-10-23T14:49:45.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:45.577+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:45.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:45.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:46.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:46.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:46.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:46.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:47.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:49:47.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:47.163282+0000) 2019-10-23T14:49:47.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:47.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:47.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:47.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:48.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:49:48.142+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:48.144238+0000) 2019-10-23T14:49:48.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:49:48.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:48.157970+0000) 2019-10-23T14:49:48.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:48.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:48.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:48.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:49.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:49:49.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:49.121994+0000) 2019-10-23T14:49:49.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:49.611+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:49.618 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:49.611+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:50.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:50.580+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:50.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:50.580+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:50.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:49:50.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:50.646127+0000) 2019-10-23T14:49:51.598 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:51.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:51.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:51.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:52.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:52.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:52.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:52.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:53.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:53.510+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:39:22.865370+0000 (oldest deadline 2019-10-23T14:39:42.865370+0000) 2019-10-23T14:49:53.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:53.510+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:54.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:54.469+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:54.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:49:54.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:54.665484+0000) 2019-10-23T14:49:55.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:55.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:56.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:56.431+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:57.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:49:57.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:57.163391+0000) 2019-10-23T14:49:57.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:57.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:58.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:49:58.143+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:58.144331+0000) 2019-10-23T14:49:58.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:49:58.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:58.158059+0000) 2019-10-23T14:49:58.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:58.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:49:59.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:49:59.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:49:59.122083+0000) 2019-10-23T14:49:59.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:49:59.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:00.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:00.470+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:00.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:50:00.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:00.646228+0000) 2019-10-23T14:50:01.499 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:01.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:02.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:02.493+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:03.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:03.463+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:04.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:04.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:04.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:50:04.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:04.665592+0000) 2019-10-23T14:50:05.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:05.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:06.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:06.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:07.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:50:07.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:07.163489+0000) 2019-10-23T14:50:07.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:07.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:08.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:08.143+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:08.144425+0000) 2019-10-23T14:50:08.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:50:08.156+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:08.158147+0000) 2019-10-23T14:50:08.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:08.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:09.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:50:09.120+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:09.122175+0000) 2019-10-23T14:50:09.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:09.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:10.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:10.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:10.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:50:10.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:10.646325+0000) 2019-10-23T14:50:11.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:11.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:12.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:12.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:13.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:13.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:14.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:14.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:14.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:14.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:14.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:50:14.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:14.665697+0000) 2019-10-23T14:50:15.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:15.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:15.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:15.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:16.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:16.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:16.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:16.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:17.165 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:50:17.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:17.163588+0000) 2019-10-23T14:50:17.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:17.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:17.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:17.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:18.146 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:18.144+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:18.144514+0000) 2019-10-23T14:50:18.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:50:18.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:18.158239+0000) 2019-10-23T14:50:18.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:18.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:18.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:18.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:19.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:50:19.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:19.122266+0000) 2019-10-23T14:50:19.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:19.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:19.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:19.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:20.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:20.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:20.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:20.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:20.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:50:20.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:20.646417+0000) 2019-10-23T14:50:21.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:21.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:21.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:21.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:22.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:22.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:22.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:22.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:23.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:23.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:23.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:23.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:24.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:24.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:24.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:24.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:24.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:50:24.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:24.665804+0000) 2019-10-23T14:50:25.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:25.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:25.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:25.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:26.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:26.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:26.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:26.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 180 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:27.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:50:27.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:27.163687+0000) 2019-10-23T14:50:27.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:27.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:27.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:27.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:28.147 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:28.144+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:28.144606+0000) 2019-10-23T14:50:28.147 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:28.145+0000 7fa171eda700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:28.145350+0000) 2019-10-23T14:50:28.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:50:28.158+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:28.158330+0000) 2019-10-23T14:50:28.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:28.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:28.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:28.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:29.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:50:29.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:29.122363+0000) 2019-10-23T14:50:29.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:29.385+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:29.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:29.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:30.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:30.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:30.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:30.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:30.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:50:30.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:30.646515+0000) 2019-10-23T14:50:31.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:31.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:31.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:31.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:32.422 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:32.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:32.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:32.417+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:32.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:32.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:32.644804+0000) 2019-10-23T14:50:33.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:33.431+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:33.437 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:33.432+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:34.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:34.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:34.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:34.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:34.669 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:50:34.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:34.665915+0000) 2019-10-23T14:50:35.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:35.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:35.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:35.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:36.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:36.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:36.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:36.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:37.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:50:37.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:37.163783+0000) 2019-10-23T14:50:37.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:37.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:37.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:37.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:38.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:50:38.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:38.158423+0000) 2019-10-23T14:50:38.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:38.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:38.433 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:38.428+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:39.124 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:50:39.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:39.122457+0000) 2019-10-23T14:50:39.435 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:39.430+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:39.436 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:39.430+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:40.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:40.394+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:40.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:40.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:40.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:50:40.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:40.646609+0000) 2019-10-23T14:50:41.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:41.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:41.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:41.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:42.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:42.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:42.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:42.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:42.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:42.643+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:42.644901+0000) 2019-10-23T14:50:43.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:43.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:43.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:43.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:44.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:44.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:44.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:44.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:44.670 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:50:44.664+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:44.666018+0000) 2019-10-23T14:50:45.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:45.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:45.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:45.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:46.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:46.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:46.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:46.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:47.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:50:47.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:47.163880+0000) 2019-10-23T14:50:47.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:47.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:47.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:47.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:48.160 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:50:48.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:48.158518+0000) 2019-10-23T14:50:48.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:48.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:48.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:48.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:49.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:50:49.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:49.122553+0000) 2019-10-23T14:50:49.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:49.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:49.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:49.342+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:50.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:50.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:50.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:50.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:50.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:50:50.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:50.646703+0000) 2019-10-23T14:50:51.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:51.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:51.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:51.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:52.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:52.305+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:52.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:52.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:52.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:50:52.643+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:52.644995+0000) 2019-10-23T14:50:53.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:53.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:53.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:53.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:54.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:54.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:54.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:54.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:54.670 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:50:54.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:54.666126+0000) 2019-10-23T14:50:55.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:55.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:55.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:55.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:56.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:56.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:56.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:56.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:57.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:50:57.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:57.163981+0000) 2019-10-23T14:50:57.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:57.304+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:57.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:57.305+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:58.161 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:50:58.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:58.158607+0000) 2019-10-23T14:50:58.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:58.295+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:58.300 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:58.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:50:59.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:50:59.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:50:59.122645+0000) 2019-10-23T14:50:59.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:59.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:50:59.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:50:59.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:00.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:00.316+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:00.321 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:00.316+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:00.650 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:51:00.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:00.646798+0000) 2019-10-23T14:51:01.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:01.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:01.366 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:01.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:02.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:02.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:02.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:02.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:02.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:51:02.643+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:02.645092+0000) 2019-10-23T14:51:03.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:03.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:03.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:03.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:04.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:04.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:04.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:04.439+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:04.670 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:51:04.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:04.666233+0000) 2019-10-23T14:51:05.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:05.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:05.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:05.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:06.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:06.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:06.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:06.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:07.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:51:07.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:07.164081+0000) 2019-10-23T14:51:07.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:07.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:07.444 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:07.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:08.161 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:08.157+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:08.158698+0000) 2019-10-23T14:51:08.161 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:08.158+0000 7f9e30a8f700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:08.159315+0000) 2019-10-23T14:51:08.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:08.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:08.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:08.402+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:09.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:51:09.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:09.122744+0000) 2019-10-23T14:51:09.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:09.428+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:09.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:09.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:10.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:10.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:10.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:10.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:10.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:51:10.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:10.646890+0000) 2019-10-23T14:51:11.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:11.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:11.361 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:11.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:12.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:12.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:12.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:12.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:12.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:51:12.643+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:12.645186+0000) 2019-10-23T14:51:12.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:12.657+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:12.658890+0000) 2019-10-23T14:51:13.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:13.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:13.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:13.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:14.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:14.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:14.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:14.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:14.670 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:51:14.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:14.666334+0000) 2019-10-23T14:51:15.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:15.417+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:15.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:15.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:16.379 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:16.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:16.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:16.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:17.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:51:17.162+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:17.164181+0000) 2019-10-23T14:51:17.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:17.362+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:17.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:17.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:18.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:18.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:18.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:18.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:19.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:51:19.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:19.122838+0000) 2019-10-23T14:51:19.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:19.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:19.305 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:19.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:20.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:20.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:20.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:20.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:20.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:51:20.645+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:20.646987+0000) 2019-10-23T14:51:21.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:21.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:21.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:21.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:22.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:22.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:22.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:22.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:22.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:51:22.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:22.645281+0000) 2019-10-23T14:51:22.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:22.657+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:22.658986+0000) 2019-10-23T14:51:23.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:23.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:23.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:23.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:24.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:24.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:24.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:24.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:24.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:51:24.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:24.666437+0000) 2019-10-23T14:51:25.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:25.327+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:25.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:25.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:26.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:26.340+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:26.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:26.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:27.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:51:27.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:27.164293+0000) 2019-10-23T14:51:27.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:27.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:27.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:27.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:28.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:28.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:28.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:28.252+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:29.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:51:29.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:29.122936+0000) 2019-10-23T14:51:29.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:29.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:29.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:29.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:30.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:30.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:30.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:30.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:30.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:51:30.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:30.647079+0000) 2019-10-23T14:51:31.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:31.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:31.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:31.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:32.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:32.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:32.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:32.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:32.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:51:32.645+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:32.645379+0000) 2019-10-23T14:51:32.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:32.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:32.659078+0000) 2019-10-23T14:51:33.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:33.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:33.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:33.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:34.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:34.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:34.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:34.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:34.670 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:51:34.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:34.666545+0000) 2019-10-23T14:51:35.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:35.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:35.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:35.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:36.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:36.339+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:36.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:36.339+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:37.166 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:51:37.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:37.164391+0000) 2019-10-23T14:51:37.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:37.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:37.369 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:37.364+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:38.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:38.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:38.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:38.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:39.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:51:39.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:39.123029+0000) 2019-10-23T14:51:39.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:39.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:39.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:39.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:40.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:40.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:40.327 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:40.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:40.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:51:40.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:40.647170+0000) 2019-10-23T14:51:41.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:41.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:41.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:41.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:42.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:42.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:42.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:42.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:42.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:51:42.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:42.645479+0000) 2019-10-23T14:51:42.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:42.657+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:42.659168+0000) 2019-10-23T14:51:43.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:43.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:43.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:43.323+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:44.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:44.358+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:44.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:44.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:44.670 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:51:44.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:44.666721+0000) 2019-10-23T14:51:45.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:45.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:45.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:45.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:46.381 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:46.376+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:46.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:46.376+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:47.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:51:47.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:47.164488+0000) 2019-10-23T14:51:47.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:47.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:47.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:47.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:48.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:48.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:48.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:48.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:49.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:51:49.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:49.123125+0000) 2019-10-23T14:51:49.423 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:49.418+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:49.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:49.418+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:50.459 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:50.454+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:50.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:50.454+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:50.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:51:50.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:50.647269+0000) 2019-10-23T14:51:51.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:51.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:51.485 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:51.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:52.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:52.496+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:52.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:52.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:52.647 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:51:52.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:52.645575+0000) 2019-10-23T14:51:52.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:51:52.657+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:52.659263+0000) 2019-10-23T14:51:53.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:53.507+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:53.513 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:53.508+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:54.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:54.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:54.501 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:54.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:54.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:51:54.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:54.666859+0000) 2019-10-23T14:51:55.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:55.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:55.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:55.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:56.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:56.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:56.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:56.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:57.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:51:57.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:57.164588+0000) 2019-10-23T14:51:57.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:57.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:57.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:57.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:58.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:58.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:58.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:58.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:51:59.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:51:59.121+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:51:59.123220+0000) 2019-10-23T14:51:59.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:59.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:51:59.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:51:59.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:00.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:00.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:00.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:00.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:00.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:52:00.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:00.647370+0000) 2019-10-23T14:52:01.509 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:01.504+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:01.510 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:01.504+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:02.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:02.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:02.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:02.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:02.648 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:02.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:02.645673+0000) 2019-10-23T14:52:02.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:52:02.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:02.659362+0000) 2019-10-23T14:52:03.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:03.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:03.500 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:03.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:04.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:04.491+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:04.497 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:04.491+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:04.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:52:04.665+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:04.666969+0000) 2019-10-23T14:52:05.456 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:05.451+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:05.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:05.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:06.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:06.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:06.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:06.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:07.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:52:07.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:07.164683+0000) 2019-10-23T14:52:07.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:07.466+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:07.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:07.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:08.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:08.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:08.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:08.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:09.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:52:09.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:09.123314+0000) 2019-10-23T14:52:09.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:09.403+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:09.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:09.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:10.374 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:10.369+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:10.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:10.369+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:10.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:52:10.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:10.647434+0000) 2019-10-23T14:52:11.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:11.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:11.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:11.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:12.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:12.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:12.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:12.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:12.648 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:12.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:12.645770+0000) 2019-10-23T14:52:12.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:52:12.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:12.659460+0000) 2019-10-23T14:52:13.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:13.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:13.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:13.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:14.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:14.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:14.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:14.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:14.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:52:14.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:14.667075+0000) 2019-10-23T14:52:15.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:15.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:15.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:15.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:16.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:16.331+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:16.336 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:16.331+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:17.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:52:17.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:17.164783+0000) 2019-10-23T14:52:17.384 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:17.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:17.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:17.381+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:18.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:18.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:18.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:18.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:19.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:52:19.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:19.123410+0000) 2019-10-23T14:52:19.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:19.333+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:19.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:19.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:20.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:20.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:20.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:20.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:20.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:52:20.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:20.647533+0000) 2019-10-23T14:52:21.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:21.320+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:21.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:21.320+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:22.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:22.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:22.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:22.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:22.648 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:22.644+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:22.645864+0000) 2019-10-23T14:52:22.648 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:22.645+0000 7fa171eda700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:22.646479+0000) 2019-10-23T14:52:22.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:52:22.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:22.659571+0000) 2019-10-23T14:52:23.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:23.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:23.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:23.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:24.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:24.309+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:24.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:24.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:24.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:52:24.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:24.667182+0000) 2019-10-23T14:52:25.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:25.311+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:25.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:25.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:26.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:26.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:26.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:26.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:27.148 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:27.144+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:27.146049+0000) 2019-10-23T14:52:27.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:52:27.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:27.164878+0000) 2019-10-23T14:52:27.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:27.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:27.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:27.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:28.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:28.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:28.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:28.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:29.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:52:29.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:29.123505+0000) 2019-10-23T14:52:29.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:29.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:29.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:29.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:30.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:30.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:30.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:30.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:30.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:52:30.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:30.647627+0000) 2019-10-23T14:52:31.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:31.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:31.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:31.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:32.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:32.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:32.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:32.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:32.661 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:52:32.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:32.659665+0000) 2019-10-23T14:52:33.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:33.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:33.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:33.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:34.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:34.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:34.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:34.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:34.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:52:34.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:34.667291+0000) 2019-10-23T14:52:35.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:35.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:35.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:35.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:36.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:36.164+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:36.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:36.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:37.148 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:37.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:37.146147+0000) 2019-10-23T14:52:37.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:52:37.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:37.164977+0000) 2019-10-23T14:52:37.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:37.188+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:37.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:37.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:38.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:38.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:38.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:38.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:39.125 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:52:39.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:39.123597+0000) 2019-10-23T14:52:39.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:39.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:39.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:39.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:40.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:40.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:40.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:40.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:40.653 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:52:40.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:40.647724+0000) 2019-10-23T14:52:41.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:41.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:41.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:41.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:42.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:42.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:42.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:42.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:42.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:52:42.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:42.659759+0000) 2019-10-23T14:52:43.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:43.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:43.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:43.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:44.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:44.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:44.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:44.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:44.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:52:44.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:44.667395+0000) 2019-10-23T14:52:45.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:45.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:45.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:45.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:46.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:46.247+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:46.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:46.247+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:47.148 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:47.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:47.146248+0000) 2019-10-23T14:52:47.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:52:47.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:47.165073+0000) 2019-10-23T14:52:47.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:47.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:47.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:47.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:48.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:48.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:48.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:48.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:49.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:52:49.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:49.123691+0000) 2019-10-23T14:52:49.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:49.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:49.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:49.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:50.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:50.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:50.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:50.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:50.653 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:52:50.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:50.647821+0000) 2019-10-23T14:52:51.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:51.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:51.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:51.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:52.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:52.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:52.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:52.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:52.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:52:52.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:52.659856+0000) 2019-10-23T14:52:53.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:53.286+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:53.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:53.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:54.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:54.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:54.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:54.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:54.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:52:54.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:54.667501+0000) 2019-10-23T14:52:55.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:55.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:55.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:55.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:56.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:56.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:56.344 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:56.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:57.148 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:52:57.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:57.146347+0000) 2019-10-23T14:52:57.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:52:57.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:57.165167+0000) 2019-10-23T14:52:57.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:57.323+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:57.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:57.324+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:58.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:58.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:58.353 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:58.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:52:59.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:52:59.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:52:59.123785+0000) 2019-10-23T14:52:59.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:59.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:52:59.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:52:59.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:00.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:00.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:00.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:00.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:00.651 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:53:00.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:00.647912+0000) 2019-10-23T14:53:01.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:01.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:01.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:01.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:02.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:02.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:02.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:02.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:02.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:53:02.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:02.659949+0000) 2019-10-23T14:53:03.389 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:03.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:03.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:03.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:04.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:04.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:04.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:04.365+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:04.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:53:04.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:04.667610+0000) 2019-10-23T14:53:05.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:05.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:05.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:05.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:06.337 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:06.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:06.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:06.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:07.148 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:53:07.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:07.146444+0000) 2019-10-23T14:53:07.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:53:07.163+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:07.165261+0000) 2019-10-23T14:53:07.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:07.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:07.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:07.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:08.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:08.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:08.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:08.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:09.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:53:09.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:09.123879+0000) 2019-10-23T14:53:09.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:09.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:09.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:09.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:10.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:10.268+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:10.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:10.268+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:10.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:53:10.646+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:10.648007+0000) 2019-10-23T14:53:11.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:11.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:11.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:11.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:12.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:12.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:12.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:12.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:12.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:53:12.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:12.660047+0000) 2019-10-23T14:53:13.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:13.345+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:13.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:13.345+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:14.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:14.329+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:14.335 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:14.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:14.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:53:14.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:14.667711+0000) 2019-10-23T14:53:15.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:15.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:15.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:15.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:16.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:16.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:16.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:16.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:17.148 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:53:17.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:17.146545+0000) 2019-10-23T14:53:17.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:53:17.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:17.165359+0000) 2019-10-23T14:53:17.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:17.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:17.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:17.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:18.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:18.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:18.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:18.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:19.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:53:19.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:19.123974+0000) 2019-10-23T14:53:19.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:19.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:19.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:19.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:20.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:20.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:20.290 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:20.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:20.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:53:20.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:20.648059+0000) 2019-10-23T14:53:21.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:21.262+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:21.268 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:21.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:22.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:22.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:22.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:22.296+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:22.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:53:22.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:22.660144+0000) 2019-10-23T14:53:23.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:23.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:23.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:23.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:24.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:24.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:24.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:24.260+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:24.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:53:24.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:24.667818+0000) 2019-10-23T14:53:25.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:25.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:25.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:25.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:26.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:26.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:26.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:26.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:27.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:53:27.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:27.146638+0000) 2019-10-23T14:53:27.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:53:27.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:27.165456+0000) 2019-10-23T14:53:27.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:27.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:27.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:27.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:28.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:28.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:28.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:28.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:29.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:53:29.122+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:29.124072+0000) 2019-10-23T14:53:29.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:29.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:29.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:29.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:30.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:30.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:30.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:30.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:30.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:53:30.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:30.648155+0000) 2019-10-23T14:53:31.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:31.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:31.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:31.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:32.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:32.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:32.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:32.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:32.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:53:32.658+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:32.660235+0000) 2019-10-23T14:53:33.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:33.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:33.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:33.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:34.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:34.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:34.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:34.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:34.671 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:53:34.666+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:34.667927+0000) 2019-10-23T14:53:35.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:35.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:35.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:35.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:36.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:36.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:36.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:36.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:37.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:53:37.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:37.146739+0000) 2019-10-23T14:53:37.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:53:37.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:37.165555+0000) 2019-10-23T14:53:37.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:37.255+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:37.260 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:37.255+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:38.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:38.214+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:38.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:38.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:39.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:53:39.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:39.124167+0000) 2019-10-23T14:53:39.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:39.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:39.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:39.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:40.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:40.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:40.276 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:40.271+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:40.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:53:40.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:40.648252+0000) 2019-10-23T14:53:41.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:41.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:41.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:41.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:42.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:42.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:42.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:42.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:42.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:53:42.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:42.660330+0000) 2019-10-23T14:53:43.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:43.231+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:43.236 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:43.231+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:44.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:44.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:44.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:44.211+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:44.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:53:44.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:44.668037+0000) 2019-10-23T14:53:45.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:45.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:45.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:45.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:46.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:46.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:46.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:46.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:47.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:53:47.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:47.146837+0000) 2019-10-23T14:53:47.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:53:47.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:47.165647+0000) 2019-10-23T14:53:47.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:47.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:47.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:47.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:48.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:48.282+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:48.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:48.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:49.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:53:49.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:49.124258+0000) 2019-10-23T14:53:49.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:49.277+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:49.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:49.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:50.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:50.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:50.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:50.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:50.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:53:50.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:50.648349+0000) 2019-10-23T14:53:51.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:51.332+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:51.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:51.332+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:52.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:52.284+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:52.289 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:52.284+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:52.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:53:52.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:52.660427+0000) 2019-10-23T14:53:53.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:53.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:53.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:53.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:54.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:54.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:54.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:54.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:54.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:53:54.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:54.668146+0000) 2019-10-23T14:53:55.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:55.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:55.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:55.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:56.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:56.221+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:56.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:56.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:57.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:53:57.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:57.146936+0000) 2019-10-23T14:53:57.167 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:53:57.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:57.165742+0000) 2019-10-23T14:53:57.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:57.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:57.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:57.209+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:58.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:58.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:58.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:58.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:53:59.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:53:59.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:53:59.124355+0000) 2019-10-23T14:53:59.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:59.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:53:59.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:53:59.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:00.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:00.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:00.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:00.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:00.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:00.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:00.648446+0000) 2019-10-23T14:54:01.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:01.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:01.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:01.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:02.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:02.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:02.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:02.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:02.662 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:54:02.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:02.660524+0000) 2019-10-23T14:54:03.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:03.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:03.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:03.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:04.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:04.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:04.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:04.143+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:04.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:54:04.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:04.668248+0000) 2019-10-23T14:54:05.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:05.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:05.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:05.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:06.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:06.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:06.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:06.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:07.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:07.120+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:07.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:07.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:07.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:54:07.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:07.147033+0000) 2019-10-23T14:54:07.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:54:07.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:07.165836+0000) 2019-10-23T14:54:08.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:08.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:08.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:08.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:09.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:09.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:09.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:09.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:09.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:54:09.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:09.124453+0000) 2019-10-23T14:54:10.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:10.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:10.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:10.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:10.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:10.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:10.648539+0000) 2019-10-23T14:54:11.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:11.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:11.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:11.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:12.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:12.127+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:12.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:12.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:12.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:54:12.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:12.660615+0000) 2019-10-23T14:54:13.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:13.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:13.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:13.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:14.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:14.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:14.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:14.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:14.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:54:14.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:14.668355+0000) 2019-10-23T14:54:15.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:15.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:15.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:15.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:16.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:16.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:16.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:16.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:17.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:54:17.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:17.147128+0000) 2019-10-23T14:54:17.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:54:17.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:17.165931+0000) 2019-10-23T14:54:17.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:17.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:17.254 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:17.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:18.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:18.207+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:18.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:18.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:19.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:54:19.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:19.124546+0000) 2019-10-23T14:54:19.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:19.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:19.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:19.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:20.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:20.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:20.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:20.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:20.652 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:20.647+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:20.648634+0000) 2019-10-23T14:54:20.653 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:20.648+0000 7f2d2295b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:20.649252+0000) 2019-10-23T14:54:21.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:21.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:21.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:21.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:22.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:22.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:22.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:22.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:22.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:54:22.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:22.660713+0000) 2019-10-23T14:54:23.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:23.233+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:23.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:23.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:24.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:24.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:24.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:24.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:24.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:54:24.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:24.668466+0000) 2019-10-23T14:54:25.152 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:25.147+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:25.148815+0000) 2019-10-23T14:54:25.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:25.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:25.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:25.245+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:26.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:26.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:26.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:26.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:27.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:54:27.145+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:27.147223+0000) 2019-10-23T14:54:27.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:54:27.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:27.166023+0000) 2019-10-23T14:54:27.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:27.292+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:27.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:27.292+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:28.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:28.319+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:28.324 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:28.319+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:29.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:54:29.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:29.124642+0000) 2019-10-23T14:54:29.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:29.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:29.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:29.317+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:30.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:30.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:30.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:30.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:31.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:31.241+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:31.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:31.241+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:32.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:32.285+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:32.291 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:32.286+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:32.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:54:32.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:32.660809+0000) 2019-10-23T14:54:33.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:33.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:33.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:33.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:34.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:34.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:34.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:34.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:34.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:54:34.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:34.668571+0000) 2019-10-23T14:54:35.152 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:35.147+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:35.148908+0000) 2019-10-23T14:54:35.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:35.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:35.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:35.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:36.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:36.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:36.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:36.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:37.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:54:37.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:37.147324+0000) 2019-10-23T14:54:37.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:54:37.164+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:37.166115+0000) 2019-10-23T14:54:37.245 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:37.240+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:37.246 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:37.240+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:38.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:38.242+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:38.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:38.242+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:39.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:54:39.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:39.124735+0000) 2019-10-23T14:54:39.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:39.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:39.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:39.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:40.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:40.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:40.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:40.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:41.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:41.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:41.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:41.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:42.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:42.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:42.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:42.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:42.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:54:42.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:42.660907+0000) 2019-10-23T14:54:43.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:43.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:43.238 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:43.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:44.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:44.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:44.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:44.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:44.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:54:44.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:44.668677+0000) 2019-10-23T14:54:45.152 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:45.147+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:45.149002+0000) 2019-10-23T14:54:45.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:45.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:45.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:45.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:46.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:46.179+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:46.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:46.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:47.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:54:47.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:47.147425+0000) 2019-10-23T14:54:47.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:54:47.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:47.166211+0000) 2019-10-23T14:54:47.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:47.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:47.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:47.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:48.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:48.153+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:48.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:48.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:49.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:49.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:49.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:49.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:49.126 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:54:49.124+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:49.124825+0000) 2019-10-23T14:54:50.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:50.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:50.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:50.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:51.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:51.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:51.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:51.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:52.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:52.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:52.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:52.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:52.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:54:52.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:52.661006+0000) 2019-10-23T14:54:53.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:53.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:53.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:53.165+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:54.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:54.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:54.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:54.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:54.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:54:54.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:54.668786+0000) 2019-10-23T14:54:55.153 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:54:55.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:55.149099+0000) 2019-10-23T14:54:55.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:55.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:55.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:55.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:56.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:56.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:56.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:56.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:57.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:54:57.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:57.147528+0000) 2019-10-23T14:54:57.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:54:57.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:57.166307+0000) 2019-10-23T14:54:57.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:57.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:57.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:57.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:58.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:58.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:58.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:58.160+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:54:59.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:54:59.124+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:54:59.124920+0000) 2019-10-23T14:54:59.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:59.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:54:59.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:54:59.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:00.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:00.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:00.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:00.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:01.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:01.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:01.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:01.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:02.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:02.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:02.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:02.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:02.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:55:02.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:02.661104+0000) 2019-10-23T14:55:03.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:03.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:03.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:03.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:04.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:04.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:04.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:04.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:04.672 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:55:04.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:04.668896+0000) 2019-10-23T14:55:05.154 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:55:05.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:05.149197+0000) 2019-10-23T14:55:05.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:05.224+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:05.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:05.224+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:06.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:06.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:06.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:06.205+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:07.149 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:55:07.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:07.147627+0000) 2019-10-23T14:55:07.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:55:07.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:07.166401+0000) 2019-10-23T14:55:07.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:07.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:07.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:07.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:08.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:08.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:08.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:08.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:09.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:09.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:09.125014+0000) 2019-10-23T14:55:09.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:09.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:09.184 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:09.179+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:10.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:10.196+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:10.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:10.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:11.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:11.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:11.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:11.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:12.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:12.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:12.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:12.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:12.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:55:12.659+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:12.661202+0000) 2019-10-23T14:55:13.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:13.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:13.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:13.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:14.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:14.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:14.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:14.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:14.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:55:14.667+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:14.669000+0000) 2019-10-23T14:55:15.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:15.135+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:15.140 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:15.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:15.153 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:55:15.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:15.149290+0000) 2019-10-23T14:55:16.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:16.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:16.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:16.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:17.165 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:55:17.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:17.147728+0000) 2019-10-23T14:55:17.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:55:17.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:17.166497+0000) 2019-10-23T14:55:17.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:17.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:17.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:17.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:18.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:18.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:18.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:18.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:19.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:19.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:19.125106+0000) 2019-10-23T14:55:19.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:19.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:19.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:19.217+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:20.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:20.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:20.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:20.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:21.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:21.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:21.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:21.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:22.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:22.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:22.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:22.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:22.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:55:22.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:22.661297+0000) 2019-10-23T14:55:23.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:23.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:23.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:23.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:24.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:24.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:24.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:24.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:24.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:55:24.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:24.669109+0000) 2019-10-23T14:55:25.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:25.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:25.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:25.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:25.153 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:55:25.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:25.149383+0000) 2019-10-23T14:55:26.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:26.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:26.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:26.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:27.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:27.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:27.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:27.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:27.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:55:27.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:27.147824+0000) 2019-10-23T14:55:27.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:55:27.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:27.166594+0000) 2019-10-23T14:55:28.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:28.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:28.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:28.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:29.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:29.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:29.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:29.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:29.127 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:29.123+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:29.125197+0000) 2019-10-23T14:55:29.128 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:29.124+0000 7f0f5fa57700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:29.125814+0000) 2019-10-23T14:55:30.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:30.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:30.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:30.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:31.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:31.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:31.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:31.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:32.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:32.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:32.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:32.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:32.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:55:32.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:32.661392+0000) 2019-10-23T14:55:33.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:33.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:33.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:33.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:33.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:33.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:33.625374+0000) 2019-10-23T14:55:34.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:34.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:34.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:34.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:34.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:55:34.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:34.669219+0000) 2019-10-23T14:55:35.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:35.116+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:35.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:35.116+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:35.153 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:55:35.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:35.149481+0000) 2019-10-23T14:55:36.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:36.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:36.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:36.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:37.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:55:37.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:37.147922+0000) 2019-10-23T14:55:37.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:37.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:37.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:37.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:37.168 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:55:37.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:37.166689+0000) 2019-10-23T14:55:38.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:38.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:38.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:38.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:39.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:39.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:39.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:39.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:40.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:40.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:40.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:40.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:41.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:41.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:41.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:41.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:42.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:42.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:42.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:42.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:42.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:55:42.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:42.661487+0000) 2019-10-23T14:55:43.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:43.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:43.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:43.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:43.627 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:43.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:43.625471+0000) 2019-10-23T14:55:44.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:44.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:44.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:44.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:44.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:55:44.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:44.669327+0000) 2019-10-23T14:55:45.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:45.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:45.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:45.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:45.155 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:55:45.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:45.149575+0000) 2019-10-23T14:55:45.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:45.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:45.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:45.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:46.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:46.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:46.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:46.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:47.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:55:47.146+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:47.148019+0000) 2019-10-23T14:55:47.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:55:47.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:47.166785+0000) 2019-10-23T14:55:47.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:47.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:47.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:47.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:48.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:48.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:48.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:48.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:50.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:50.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:50.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:50.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:51.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:51.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:51.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:51.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:52.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:52.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:52.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:52.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:52.663 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:55:52.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:52.661584+0000) 2019-10-23T14:55:53.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:53.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:53.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:53.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:53.627 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:55:53.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:53.625566+0000) 2019-10-23T14:55:54.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:54.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:54.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:54.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:54.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:55:54.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:54.669433+0000) 2019-10-23T14:55:55.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:55.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:55.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:55.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:55.153 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:55:55.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:55.149671+0000) 2019-10-23T14:55:56.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:56.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:56.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:56.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:57.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:57.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:57.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:57.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:57.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:55:57.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:57.148121+0000) 2019-10-23T14:55:57.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:55:57.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:55:57.166880+0000) 2019-10-23T14:55:58.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:58.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:58.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:58.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:55:59.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:59.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:55:59.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:55:59.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:00.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:00.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:00.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:00.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:00.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:00.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:00.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:00.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:01.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:01.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:01.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:01.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:02.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:56:02.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:02.661680+0000) 2019-10-23T14:56:02.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:02.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:02.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:02.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:03.627 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:56:03.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:03.625657+0000) 2019-10-23T14:56:03.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:03.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:03.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:03.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:04.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:56:04.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:04.669542+0000) 2019-10-23T14:56:04.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:04.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:04.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:04.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:05.153 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:05.148+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:05.149763+0000) 2019-10-23T14:56:05.154 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:05.149+0000 7f2d2295b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:05.150348+0000) 2019-10-23T14:56:05.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:05.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:05.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:05.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:06.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:06.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:06.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:06.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:07.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:56:07.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:07.148215+0000) 2019-10-23T14:56:07.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:56:07.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:07.166977+0000) 2019-10-23T14:56:07.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:07.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:07.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:07.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:08.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:08.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:08.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:08.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:09.653 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:09.648+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:09.649947+0000) 2019-10-23T14:56:09.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:09.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:09.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:09.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:10.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:10.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:10.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:10.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:12.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:12.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:12.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:12.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:56:12.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:12.661773+0000) 2019-10-23T14:56:13.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:13.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:13.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:13.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:13.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:56:13.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:13.625747+0000) 2019-10-23T14:56:13.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:13.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:13.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:13.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:14.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:56:14.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:14.669647+0000) 2019-10-23T14:56:14.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:14.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:14.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:14.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:15.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:15.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:15.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:15.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:16.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:16.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:16.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:16.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:17.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:56:17.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:17.148299+0000) 2019-10-23T14:56:17.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:56:17.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:17.167077+0000) 2019-10-23T14:56:17.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:17.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:17.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:17.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:18.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:18.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:18.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:18.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:19.653 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:19.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:19.650042+0000) 2019-10-23T14:56:20.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:20.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:20.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:20.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:21.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:21.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:21.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:21.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:22.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:22.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:22.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:22.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:22.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:56:22.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:22.661871+0000) 2019-10-23T14:56:23.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:23.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:23.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:23.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:23.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:56:23.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:23.625839+0000) 2019-10-23T14:56:24.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:24.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:24.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:24.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:24.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:56:24.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:24.669754+0000) 2019-10-23T14:56:25.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:25.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:25.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:25.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:26.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:26.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:26.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:26.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:27.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:27.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:27.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:27.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:27.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:56:27.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:27.148397+0000) 2019-10-23T14:56:27.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:56:27.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:27.167166+0000) 2019-10-23T14:56:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:28.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:28.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:29.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:29.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:29.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:29.124+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:29.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:29.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:29.650136+0000) 2019-10-23T14:56:30.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:30.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:30.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:30.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:31.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:31.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:31.147 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:31.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:32.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:32.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:32.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:32.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:32.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:56:32.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:32.661968+0000) 2019-10-23T14:56:33.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:33.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:33.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:33.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:33.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:56:33.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:33.625930+0000) 2019-10-23T14:56:34.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:34.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:34.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:34.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:34.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:56:34.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:34.669867+0000) 2019-10-23T14:56:35.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:35.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:35.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:35.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:36.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:36.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:36.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:36.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:37.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:56:37.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:37.148494+0000) 2019-10-23T14:56:37.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:56:37.165+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:37.167259+0000) 2019-10-23T14:56:37.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:37.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:37.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:37.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:38.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:38.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:38.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:38.214+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:39.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:39.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:39.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:39.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:39.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:39.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:39.650235+0000) 2019-10-23T14:56:40.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:40.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:40.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:40.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:41.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:41.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:41.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:41.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:42.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:42.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:42.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:42.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:42.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:56:42.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:42.662064+0000) 2019-10-23T14:56:43.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:43.168+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:43.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:43.168+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:43.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:56:43.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:43.626025+0000) 2019-10-23T14:56:44.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:44.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:44.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:44.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:44.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:56:44.668+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:44.669969+0000) 2019-10-23T14:56:45.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:45.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:45.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:45.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:46.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:46.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:46.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:46.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:47.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:56:47.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:47.148588+0000) 2019-10-23T14:56:47.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:56:47.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:47.167358+0000) 2019-10-23T14:56:47.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:47.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:47.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:47.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:48.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:48.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:48.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:48.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:49.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:49.170+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:49.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:49.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:49.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:49.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:49.650333+0000) 2019-10-23T14:56:50.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:50.217+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:50.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:50.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:51.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:51.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:51.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:51.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:52.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:52.182+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:52.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:52.183+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:52.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:56:52.660+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:52.662162+0000) 2019-10-23T14:56:53.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:53.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:53.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:53.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:53.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:56:53.624+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:53.626121+0000) 2019-10-23T14:56:54.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:54.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:54.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:54.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:54.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:56:54.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:54.670073+0000) 2019-10-23T14:56:55.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:55.205+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:55.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:55.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:56.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:56.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:56.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:56.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:57.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:56:57.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:57.148685+0000) 2019-10-23T14:56:57.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:56:57.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:57.167455+0000) 2019-10-23T14:56:57.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:57.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:57.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:57.232+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:58.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:58.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:58.228 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:58.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:59.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:59.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:56:59.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:56:59.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:56:59.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:56:59.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:56:59.650431+0000) 2019-10-23T14:57:00.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:00.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:00.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:00.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:01.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:01.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:01.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:01.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:02.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:02.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:02.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:02.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:02.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:57:02.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:02.662259+0000) 2019-10-23T14:57:03.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:03.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:03.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:03.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:03.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:57:03.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:03.626215+0000) 2019-10-23T14:57:04.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:04.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:04.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:04.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:04.673 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:57:04.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:04.670180+0000) 2019-10-23T14:57:05.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:05.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:05.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:05.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:06.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:06.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:06.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:06.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:07.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:07.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:07.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:07.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:07.150 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:57:07.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:07.148778+0000) 2019-10-23T14:57:07.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:57:07.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:07.167550+0000) 2019-10-23T14:57:08.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:08.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:08.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:08.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:09.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:09.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:09.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:09.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:09.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:57:09.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:09.650527+0000) 2019-10-23T14:57:10.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:10.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:10.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:10.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:11.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:11.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:11.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:11.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:12.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:12.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:12.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:12.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:12.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:57:12.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:12.662362+0000) 2019-10-23T14:57:13.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:13.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:13.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:13.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:13.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:57:13.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:13.626297+0000) 2019-10-23T14:57:14.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:14.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:14.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:14.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:14.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:57:14.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:14.670289+0000) 2019-10-23T14:57:15.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:15.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:15.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:15.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:16.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:16.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:16.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:16.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:16.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:16.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:16.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:16.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:17.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:57:17.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:17.148877+0000) 2019-10-23T14:57:17.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:57:17.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:17.167644+0000) 2019-10-23T14:57:18.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:18.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:18.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:18.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:19.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:19.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:19.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:19.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:19.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:57:19.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:19.650623+0000) 2019-10-23T14:57:20.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:20.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:20.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:20.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:21.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:21.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:21.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:21.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:22.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:22.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:22.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:22.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:22.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:57:22.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:22.662471+0000) 2019-10-23T14:57:23.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:23.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:23.187 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:23.182+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:23.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:57:23.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:23.626390+0000) 2019-10-23T14:57:24.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:24.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:24.215 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:24.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:24.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:57:24.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:24.670398+0000) 2019-10-23T14:57:25.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:25.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:25.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:25.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:26.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:26.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:26.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:26.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:27.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:57:27.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:27.148975+0000) 2019-10-23T14:57:27.169 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:57:27.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:27.167739+0000) 2019-10-23T14:57:27.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:27.301+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:27.306 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:27.301+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:28.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:28.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:28.315 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:28.311+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:29.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:29.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:29.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:29.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:29.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:57:29.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:29.650720+0000) 2019-10-23T14:57:30.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:30.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:30.397 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:30.392+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:31.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:31.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:31.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:31.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:32.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:32.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:32.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:32.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:32.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:57:32.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:32.662568+0000) 2019-10-23T14:57:33.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:33.453+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:33.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:33.453+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:33.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:57:33.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:33.626483+0000) 2019-10-23T14:57:34.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:34.477+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:34.488 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:34.477+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:34.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:57:34.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:34.670504+0000) 2019-10-23T14:57:35.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:35.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:35.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:35.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:36.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:36.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:36.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:36.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:37.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:57:37.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:37.149075+0000) 2019-10-23T14:57:37.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:57:37.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:37.167841+0000) 2019-10-23T14:57:37.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:37.581+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:37.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:37.582+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:38.548 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:38.542+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:38.549 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:38.542+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:39.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:39.586+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:39.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:39.586+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:39.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:57:39.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:39.650818+0000) 2019-10-23T14:57:40.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:40.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:40.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:40.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:41.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:41.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:41.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:41.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:42.664 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:57:42.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:42.662667+0000) 2019-10-23T14:57:42.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:42.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:42.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:42.665+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:43.628 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:57:43.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:43.626577+0000) 2019-10-23T14:57:43.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:43.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:43.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:43.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:44.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:44.626+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:44.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:44.626+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:44.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:57:44.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:44.670610+0000) 2019-10-23T14:57:45.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:45.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:45.672 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:45.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:46.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:46.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:46.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:46.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:47.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:57:47.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:47.149175+0000) 2019-10-23T14:57:47.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:57:47.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:47.167939+0000) 2019-10-23T14:57:47.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:47.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:47.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:47.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:48.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:48.619+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:48.624 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:48.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:49.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:49.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:49.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:49.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:49.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:57:49.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:49.650917+0000) 2019-10-23T14:57:50.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:50.612+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:50.617 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:50.612+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:51.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:51.579+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:51.584 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:51.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:52.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:52.546+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:52.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:52.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:52.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:57:52.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:52.662768+0000) 2019-10-23T14:57:53.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:53.497+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:53.502 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:53.497+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:53.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:57:53.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:53.626674+0000) 2019-10-23T14:57:54.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:54.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:54.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:54.457+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:54.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:57:54.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:54.670720+0000) 2019-10-23T14:57:55.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:55.498+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:55.503 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:55.498+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:56.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:56.468+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:56.474 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:56.468+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:57.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:57:57.147+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:57.149275+0000) 2019-10-23T14:57:57.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:57:57.166+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:57.168036+0000) 2019-10-23T14:57:57.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:57.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:57.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:57.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:58.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:58.471+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:58.476 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:58.471+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:59.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:59.509+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:57:59.521 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:57:59.509+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:57:59.654 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:57:59.649+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:57:59.651012+0000) 2019-10-23T14:58:00.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:00.522+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:00.527 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:00.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:01.507 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:01.502+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:01.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:01.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:02.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:02.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:02.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:02.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:02.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:58:02.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:02.662868+0000) 2019-10-23T14:58:03.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:03.423+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:03.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:03.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:03.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:58:03.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:03.626763+0000) 2019-10-23T14:58:04.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:04.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:04.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:04.422+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:04.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:58:04.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:04.670828+0000) 2019-10-23T14:58:05.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:05.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:05.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:05.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:06.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:06.392+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:06.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:06.393+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:07.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:58:07.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:07.149378+0000) 2019-10-23T14:58:07.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:58:07.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:07.168140+0000) 2019-10-23T14:58:07.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:07.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:07.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:07.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:08.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:08.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:08.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:08.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:09.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:09.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:09.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:09.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:09.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:58:09.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:09.651115+0000) 2019-10-23T14:58:10.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:10.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:10.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:10.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:11.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:11.402+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:11.408 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:11.403+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:12.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:12.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:12.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:12.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:12.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:58:12.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:12.662969+0000) 2019-10-23T14:58:13.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:13.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:13.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:13.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:13.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:58:13.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:13.626857+0000) 2019-10-23T14:58:14.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:14.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:14.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:14.389+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:14.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:58:14.669+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:14.670936+0000) 2019-10-23T14:58:15.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:15.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:15.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:15.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:16.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:16.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:16.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:16.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:17.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:58:17.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:17.149494+0000) 2019-10-23T14:58:17.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:58:17.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:17.168247+0000) 2019-10-23T14:58:17.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:17.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:17.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:17.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:18.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:18.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:18.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:18.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:19.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:19.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:19.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:19.425+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:19.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:58:19.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:19.651210+0000) 2019-10-23T14:58:20.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:20.382+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:20.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:20.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:21.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:21.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:21.385 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:21.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:22.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:22.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:22.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:22.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:22.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:58:22.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:22.663066+0000) 2019-10-23T14:58:23.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:23.388+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:23.393 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:23.388+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:23.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:58:23.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:23.626950+0000) 2019-10-23T14:58:24.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:24.375+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:24.380 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:24.375+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:24.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:58:24.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:24.671048+0000) 2019-10-23T14:58:25.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:25.355+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:25.360 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:25.355+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:26.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:26.405+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:26.410 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:26.405+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:27.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:58:27.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:27.149594+0000) 2019-10-23T14:58:27.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:58:27.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:27.168299+0000) 2019-10-23T14:58:27.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:27.365+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:27.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:27.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:28.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:28.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:28.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:28.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:29.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:29.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:29.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:29.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:29.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:58:29.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:29.651307+0000) 2019-10-23T14:58:30.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:30.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:30.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:30.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:31.405 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:31.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:31.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:31.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:32.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:32.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:32.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:32.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:32.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:58:32.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:32.663164+0000) 2019-10-23T14:58:33.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:33.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:33.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:33.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:33.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:58:33.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:33.627045+0000) 2019-10-23T14:58:34.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:34.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:34.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:34.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:34.674 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:58:34.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:34.671154+0000) 2019-10-23T14:58:35.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:35.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:35.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:35.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:36.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:36.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:36.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:36.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:37.151 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:58:37.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:37.149693+0000) 2019-10-23T14:58:37.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:58:37.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:37.168397+0000) 2019-10-23T14:58:37.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:37.267+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:37.272 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:37.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:38.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:38.244+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:38.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:38.244+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:39.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:39.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:39.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:39.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:39.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:58:39.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:39.651410+0000) 2019-10-23T14:58:40.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:40.250+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:40.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:40.251+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:41.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:41.269+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:41.273 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:41.269+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:42.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:42.258+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:42.263 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:42.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:42.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:58:42.661+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:42.663261+0000) 2019-10-23T14:58:43.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:43.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:43.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:43.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:43.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:58:43.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:43.627142+0000) 2019-10-23T14:58:44.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:44.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:44.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:44.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:44.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:58:44.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:44.671260+0000) 2019-10-23T14:58:45.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:45.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:45.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:45.235+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:46.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:46.219+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:46.224 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:46.219+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:47.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:58:47.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:47.149789+0000) 2019-10-23T14:58:47.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:58:47.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:47.168493+0000) 2019-10-23T14:58:47.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:47.252+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:47.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:47.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:48.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:48.234+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:48.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:48.234+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:49.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:49.259+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:49.264 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:49.259+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:49.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:58:49.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:49.651509+0000) 2019-10-23T14:58:50.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:50.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:50.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:50.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:51.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:51.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:51.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:51.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:52.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:52.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:52.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:52.294+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:52.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:58:52.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:52.663359+0000) 2019-10-23T14:58:53.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:53.303+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:53.308 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:53.303+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:53.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:58:53.625+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:53.627231+0000) 2019-10-23T14:58:54.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:54.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:54.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:54.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:54.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:58:54.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:54.671369+0000) 2019-10-23T14:58:55.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:55.314+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:55.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:55.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:56.338 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:56.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:56.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:56.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:57.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:58:57.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:57.149889+0000) 2019-10-23T14:58:57.170 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:58:57.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:57.168586+0000) 2019-10-23T14:58:57.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:57.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:57.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:57.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:58.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:58.390+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:58.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:58.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:59.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:59.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:58:59.351 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:58:59.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:58:59.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:58:59.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:58:59.651609+0000) 2019-10-23T14:59:00.398 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:00.393+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:00.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:00.394+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:01.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:01.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:01.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:01.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:02.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:02.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:02.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:02.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:02.665 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:59:02.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:02.663494+0000) 2019-10-23T14:59:03.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:03.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:03.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:03.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:03.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:59:03.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:03.627298+0000) 2019-10-23T14:59:04.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:04.347+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:04.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:04.347+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:04.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:59:04.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:04.671474+0000) 2019-10-23T14:59:05.345 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:05.341+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:05.346 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:05.341+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:06.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:06.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:06.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:06.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:07.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:59:07.148+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:07.150027+0000) 2019-10-23T14:59:07.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:59:07.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:07.168712+0000) 2019-10-23T14:59:07.355 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:07.350+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:07.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:07.350+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:08.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:08.354+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:08.359 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:08.354+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:09.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:09.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:09.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:09.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:09.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:59:09.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:09.651754+0000) 2019-10-23T14:59:10.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:10.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:10.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:10.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:11.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:11.337+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:11.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:11.337+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:12.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:12.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:12.323 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:12.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:12.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:59:12.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:12.663672+0000) 2019-10-23T14:59:13.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:13.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:13.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:13.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:13.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:59:13.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:13.627393+0000) 2019-10-23T14:59:14.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:14.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:14.402 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:14.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:14.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:59:14.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:14.671649+0000) 2019-10-23T14:59:15.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:15.404+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:15.409 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:15.404+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:16.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:16.361+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:16.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:16.361+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:17.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:59:17.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:17.150163+0000) 2019-10-23T14:59:17.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:59:17.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:17.168840+0000) 2019-10-23T14:59:17.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:17.372+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:17.377 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:17.372+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:18.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:18.371+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:18.376 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:18.371+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:19.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:19.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:19.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:19.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:19.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:59:19.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:19.651912+0000) 2019-10-23T14:59:20.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:20.457+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:20.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:20.458+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:21.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:21.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:21.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:21.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:22.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:22.406+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:22.412 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:22.406+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:22.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:59:22.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:22.663822+0000) 2019-10-23T14:59:23.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:23.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:23.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:23.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:23.629 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:59:23.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:23.627490+0000) 2019-10-23T14:59:24.438 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:24.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:24.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:24.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:24.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:59:24.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:24.671777+0000) 2019-10-23T14:59:25.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:25.481+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:25.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:25.481+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:26.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:26.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:26.467 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:26.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:27.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:59:27.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:27.150314+0000) 2019-10-23T14:59:27.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:59:27.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:27.168961+0000) 2019-10-23T14:59:27.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:27.503+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:27.508 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:27.503+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:28.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:28.484+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:28.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:28.484+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:29.457 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:29.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:29.458 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:29.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:29.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:59:29.650+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:29.652011+0000) 2019-10-23T14:59:30.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:30.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:30.473 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:30.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:31.492 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:31.486+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:31.493 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:31.486+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:32.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:32.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:32.442 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:32.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:32.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:59:32.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:32.663959+0000) 2019-10-23T14:59:33.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:33.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:33.480 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:33.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:33.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:59:33.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:33.627625+0000) 2019-10-23T14:59:34.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:34.475+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:34.481 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:34.475+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:34.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:59:34.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:34.671880+0000) 2019-10-23T14:59:35.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:35.443+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:35.448 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:35.443+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:36.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:36.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:36.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:36.446+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:37.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:59:37.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:37.150482+0000) 2019-10-23T14:59:37.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:59:37.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:37.169103+0000) 2019-10-23T14:59:37.468 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:37.463+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:37.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:37.464+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:38.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:38.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:38.487 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:38.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:39.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:39.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:39.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:39.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:39.655 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:59:39.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:39.652110+0000) 2019-10-23T14:59:40.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:40.456+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:40.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:40.456+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:41.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:41.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:41.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:41.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:42.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:42.455+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:42.460 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:42.455+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:42.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:59:42.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:42.664136+0000) 2019-10-23T14:59:43.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:43.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:43.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:43.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:43.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:59:43.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:43.627814+0000) 2019-10-23T14:59:44.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:44.460+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:44.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:44.461+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:44.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:59:44.670+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:44.671991+0000) 2019-10-23T14:59:45.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:45.438+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:45.443 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:45.438+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:46.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:46.433+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:46.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:46.433+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:47.152 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:59:47.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:47.150609+0000) 2019-10-23T14:59:47.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:59:47.167+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:47.169203+0000) 2019-10-23T14:59:47.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:47.436+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:47.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:47.436+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:48.454 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:48.449+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:48.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:48.450+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:49.424 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:49.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:49.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:49.420+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:49.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:59:49.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:49.652211+0000) 2019-10-23T14:59:50.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:50.448+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:50.453 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:50.448+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:51.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:51.429+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:51.434 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:51.429+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:52.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:52.399+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:52.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:52.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:52.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T14:59:52.662+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:52.664277+0000) 2019-10-23T14:59:53.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:53.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:53.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:53.410+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:53.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T14:59:53.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:53.627953+0000) 2019-10-23T14:59:54.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:54.425+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:54.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:54.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:54.675 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T14:59:54.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:54.672100+0000) 2019-10-23T14:59:55.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:55.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:55.447 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:55.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:56.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:56.409+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:56.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:56.409+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:57.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T14:59:57.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:57.150738+0000) 2019-10-23T14:59:57.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T14:59:57.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:57.169309+0000) 2019-10-23T14:59:57.406 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:57.401+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:57.407 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:57.401+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:58.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:58.411+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:58.416 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:58.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:59.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:59.363+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T14:59:59.368 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T14:59:59.363+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T14:59:59.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T14:59:59.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T13:59:59.652306+0000) 2019-10-23T15:00:00.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:00.370+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:00.375 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:00.370+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:01.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:01.334+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:01.339 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:01.334+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:02.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:02.359+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:02.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:02.359+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:02.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:00:02.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:02.664374+0000) 2019-10-23T15:00:03.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:03.408+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:03.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:03.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:03.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:00:03.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:03.628047+0000) 2019-10-23T15:00:04.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:04.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:04.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:04.398+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:04.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:00:04.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:04.672206+0000) 2019-10-23T15:00:05.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:05.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:05.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:05.414+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:06.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:06.373+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:06.378 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:06.373+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:07.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:00:07.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:07.150846+0000) 2019-10-23T15:00:07.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:00:07.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:07.169414+0000) 2019-10-23T15:00:07.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:07.407+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:07.413 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:07.408+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:08.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:08.445+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:08.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:08.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:09.464 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:09.459+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:09.465 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:09.460+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:09.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:00:09.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:09.652404+0000) 2019-10-23T15:00:10.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:10.467+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:10.472 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:10.467+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:11.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:11.435+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:11.440 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:11.435+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:12.394 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:12.389+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:12.395 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:12.390+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:12.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:00:12.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:12.664480+0000) 2019-10-23T15:00:13.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:13.434+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:13.439 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:13.434+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:13.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:00:13.626+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:13.628145+0000) 2019-10-23T15:00:14.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:14.413+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:14.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:14.413+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:14.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:00:14.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:14.672312+0000) 2019-10-23T15:00:15.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:15.412+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:15.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:15.412+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:16.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:16.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:16.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:16.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:17.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:00:17.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:17.150945+0000) 2019-10-23T15:00:17.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:00:17.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:17.169508+0000) 2019-10-23T15:00:17.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:17.398+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:17.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:17.399+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:18.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:18.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:18.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:18.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:19.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:19.343+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:19.349 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:19.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:19.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:00:19.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:19.652516+0000) 2019-10-23T15:00:20.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:20.336+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:20.341 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:20.336+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:21.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:21.381+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:21.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:21.382+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:22.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:22.391+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:22.396 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:22.391+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:22.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:00:22.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:22.664580+0000) 2019-10-23T15:00:23.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:23.351+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:23.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:23.351+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:23.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:00:23.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:23.628242+0000) 2019-10-23T15:00:24.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:24.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:24.371 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:24.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:24.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:00:24.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:24.672460+0000) 2019-10-23T15:00:25.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:25.335+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:25.340 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:25.335+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:26.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:26.380+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:26.386 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:26.380+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:27.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:00:27.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:27.151043+0000) 2019-10-23T15:00:27.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:00:27.169+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:27.169601+0000) 2019-10-23T15:00:27.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:27.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:27.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:27.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:28.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:28.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:28.471 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:28.465+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:29.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:29.476+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:29.482 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:29.476+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:29.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:00:29.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:29.652654+0000) 2019-10-23T15:00:30.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:30.487+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:30.491 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:30.487+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:31.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:31.480+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:31.484 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:31.480+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:32.529 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:32.524+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:32.530 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:32.525+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:32.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:00:32.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:32.664678+0000) 2019-10-23T15:00:33.551 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:33.547+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:33.552 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:33.547+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:33.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:00:33.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:33.628339+0000) 2019-10-23T15:00:34.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:34.568+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T14:49:54.190370+0000 (oldest deadline 2019-10-23T14:50:14.190370+0000) 2019-10-23T15:00:34.573 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:34.568+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:34.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:00:34.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:34.672605+0000) 2019-10-23T15:00:35.539 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:35.534+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:36.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:36.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:37.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:00:37.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:37.151140+0000) 2019-10-23T15:00:37.171 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:00:37.169+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:37.169701+0000) 2019-10-23T15:00:37.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:37.516+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:38.542 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:38.538+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:39.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:39.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:39.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:00:39.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:39.652753+0000) 2019-10-23T15:00:40.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:40.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:41.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:41.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:42.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:42.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:42.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:00:42.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:42.664771+0000) 2019-10-23T15:00:43.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:00:43.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:43.628436+0000) 2019-10-23T15:00:43.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:43.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:44.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:00:44.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:44.672713+0000) 2019-10-23T15:00:44.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:44.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:45.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:45.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:46.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:46.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:47.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:00:47.149+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:47.151233+0000) 2019-10-23T15:00:47.172 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:00:47.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:47.169793+0000) 2019-10-23T15:00:47.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:47.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:48.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:48.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:49.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:00:49.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:49.652855+0000) 2019-10-23T15:00:49.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:49.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:50.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:50.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:51.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:51.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:52.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:00:52.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:52.664868+0000) 2019-10-23T15:00:52.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:52.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:53.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:00:53.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:53.628533+0000) 2019-10-23T15:00:53.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:53.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:54.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:00:54.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:54.672816+0000) 2019-10-23T15:00:54.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:54.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:00:54.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:54.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:55.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:55.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:00:55.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:55.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:56.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:56.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:00:56.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:56.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:57.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:00:57.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:57.151300+0000) 2019-10-23T15:00:57.172 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:00:57.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:57.169883+0000) 2019-10-23T15:00:57.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:57.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:00:57.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:57.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:58.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:58.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:00:58.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:58.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:00:59.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:00:59.651+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:00:59.652954+0000) 2019-10-23T15:00:59.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:59.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:00:59.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:00:59.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:00.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:00.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:00.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:00.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:01.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:01.723+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:01.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:01.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:02.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:01:02.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:02.664970+0000) 2019-10-23T15:01:02.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:02.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:02.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:02.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:03.630 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:01:03.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:03.628627+0000) 2019-10-23T15:01:03.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:03.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:03.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:03.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:04.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:01:04.671+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:04.672922+0000) 2019-10-23T15:01:04.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:04.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:04.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:04.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:05.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:05.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:05.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:05.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:06.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:06.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:06.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:06.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:07.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:01:07.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:07.151397+0000) 2019-10-23T15:01:07.172 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:07.168+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:07.169974+0000) 2019-10-23T15:01:07.173 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:07.169+0000 7fc3e1e86700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:07.170610+0000) 2019-10-23T15:01:07.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:07.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:07.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:07.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:08.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:08.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:08.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:08.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:09.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:01:09.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:09.653049+0000) 2019-10-23T15:01:09.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:09.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:09.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:09.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:10.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:10.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:10.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:10.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:11.672 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:11.668+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:11.670149+0000) 2019-10-23T15:01:11.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:11.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:11.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:11.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:12.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:01:12.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:12.665068+0000) 2019-10-23T15:01:12.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:12.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:12.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:12.680+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:13.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:01:13.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:13.628725+0000) 2019-10-23T15:01:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:13.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:13.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:13.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:14.676 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:01:14.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:14.673036+0000) 2019-10-23T15:01:14.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:14.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:14.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:14.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:15.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:15.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:15.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:15.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:16.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:16.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:16.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:16.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:17.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:01:17.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:17.151490+0000) 2019-10-23T15:01:17.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:17.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:17.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:17.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:18.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:18.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:18.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:18.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:19.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:01:19.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:19.653146+0000) 2019-10-23T15:01:19.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:19.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:19.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:19.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:20.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:20.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:20.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:20.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:21.672 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:21.668+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:21.670247+0000) 2019-10-23T15:01:21.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:21.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:21.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:21.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:22.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:01:22.663+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:22.665163+0000) 2019-10-23T15:01:22.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:22.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:22.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:22.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:23.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:01:23.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:23.628818+0000) 2019-10-23T15:01:23.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:23.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:23.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:23.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:24.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:01:24.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:24.673219+0000) 2019-10-23T15:01:24.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:24.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:24.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:24.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:25.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:25.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:25.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:25.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:26.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:26.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:26.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:26.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:27.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:01:27.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:27.151587+0000) 2019-10-23T15:01:27.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:27.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:27.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:27.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:28.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:28.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:28.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:28.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:29.656 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:01:29.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:29.653244+0000) 2019-10-23T15:01:29.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:29.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:29.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:29.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:30.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:30.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:30.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:30.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:31.672 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:31.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:31.670352+0000) 2019-10-23T15:01:31.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:31.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:31.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:31.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:32.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:01:32.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:32.665259+0000) 2019-10-23T15:01:32.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:32.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:32.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:32.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:33.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:01:33.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:33.628913+0000) 2019-10-23T15:01:33.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:33.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:33.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:33.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:34.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:01:34.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:34.673363+0000) 2019-10-23T15:01:34.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:34.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:34.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:34.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:35.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:35.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:35.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:35.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:36.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:36.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:36.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:36.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:37.153 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:01:37.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:37.151682+0000) 2019-10-23T15:01:38.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:38.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:38.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:38.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:39.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:39.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:39.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:39.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:39.657 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:01:39.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:39.653338+0000) 2019-10-23T15:01:40.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:40.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:40.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:40.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:41.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:41.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:41.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:41.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:41.672 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:41.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:41.670449+0000) 2019-10-23T15:01:42.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:41.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:42.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:41.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:42.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:01:42.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:42.665362+0000) 2019-10-23T15:01:43.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:43.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:43.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:43.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:43.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:01:43.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:43.629012+0000) 2019-10-23T15:01:44.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:43.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:44.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:43.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:44.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:01:44.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:44.673473+0000) 2019-10-23T15:01:44.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:44.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:44.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:44.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:45.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:45.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:45.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:45.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:46.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:46.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:46.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:46.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:47.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:01:47.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:47.151779+0000) 2019-10-23T15:01:47.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:47.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:47.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:47.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:48.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:48.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:48.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:48.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:49.667 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:01:49.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:49.653439+0000) 2019-10-23T15:01:49.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:49.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:49.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:49.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:50.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:50.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:50.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:50.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:51.672 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:01:51.669+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:51.670544+0000) 2019-10-23T15:01:51.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:51.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:51.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:51.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:52.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:01:52.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:52.665458+0000) 2019-10-23T15:01:52.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:52.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:52.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:52.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:53.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:01:53.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:53.629107+0000) 2019-10-23T15:01:53.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:53.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:53.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:53.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:54.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:01:54.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:54.673586+0000) 2019-10-23T15:01:54.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:54.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:54.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:54.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:55.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:55.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:55.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:55.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:56.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:56.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:56.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:56.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:57.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:01:57.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:57.151875+0000) 2019-10-23T15:01:57.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:57.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:57.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:57.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:58.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:58.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:58.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:58.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:01:59.657 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:01:59.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:01:59.653535+0000) 2019-10-23T15:01:59.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:59.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:01:59.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:01:59.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:00.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:00.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:00.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:00.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:01.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:02:01.669+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:01.670642+0000) 2019-10-23T15:02:01.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:01.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:01.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:01.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:02.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:02:02.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:02.665548+0000) 2019-10-23T15:02:03.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:03.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:03.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:03.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:03.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:02:03.627+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:03.629202+0000) 2019-10-23T15:02:03.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:03.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:03.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:03.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:04.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:02:04.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:04.673691+0000) 2019-10-23T15:02:05.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:05.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:05.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:05.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:06.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:06.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:06.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:06.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:07.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:07.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:07.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:07.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:07.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:02:07.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:07.151973+0000) 2019-10-23T15:02:08.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:08.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:08.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:08.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:09.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:09.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:09.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:09.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:09.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:02:09.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:09.653675+0000) 2019-10-23T15:02:10.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:10.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:10.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:10.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:11.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:11.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:11.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:11.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:11.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:02:11.669+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:11.670738+0000) 2019-10-23T15:02:12.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:12.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:12.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:12.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:12.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:02:12.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:12.665641+0000) 2019-10-23T15:02:13.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:13.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:13.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:13.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:13.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:02:13.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:13.629294+0000) 2019-10-23T15:02:14.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:14.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:14.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:14.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:14.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:02:14.672+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:14.673874+0000) 2019-10-23T15:02:15.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:15.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:15.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:15.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:16.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:16.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:16.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:16.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:16.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:16.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:16.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:16.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:17.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:02:17.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:17.152072+0000) 2019-10-23T15:02:17.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:17.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:17.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:17.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:18.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:18.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:18.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:18.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:19.657 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:02:19.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:19.653860+0000) 2019-10-23T15:02:20.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:20.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:20.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:20.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:21.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:21.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:21.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:21.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:21.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:02:21.669+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:21.670837+0000) 2019-10-23T15:02:22.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:22.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:22.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:22.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:22.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:02:22.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:22.665738+0000) 2019-10-23T15:02:23.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:23.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:23.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:23.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:23.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:02:23.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:23.629388+0000) 2019-10-23T15:02:24.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:24.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:24.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:24.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:24.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:02:24.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:24.674019+0000) 2019-10-23T15:02:25.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:25.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:25.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:25.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:26.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:26.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:26.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:26.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:27.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:27.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:27.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:27.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:27.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:02:27.150+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:27.152173+0000) 2019-10-23T15:02:28.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:28.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:28.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:28.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:29.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:29.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:29.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:29.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:29.657 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:02:29.652+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:29.654000+0000) 2019-10-23T15:02:30.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:30.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:30.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:30.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:31.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:31.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:31.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:31.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:31.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:02:31.669+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:31.670937+0000) 2019-10-23T15:02:32.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:32.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:32.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:32.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:32.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:02:32.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:32.665833+0000) 2019-10-23T15:02:33.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:33.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:33.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:33.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:33.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:02:33.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:33.629481+0000) 2019-10-23T15:02:34.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:34.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:34.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:34.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:34.677 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:02:34.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:34.674134+0000) 2019-10-23T15:02:35.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:35.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:35.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:35.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:36.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:36.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:36.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:36.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:37.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:37.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:37.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:37.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:37.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:02:37.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:37.152272+0000) 2019-10-23T15:02:38.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:38.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:38.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:38.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:39.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:39.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:39.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:39.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:39.657 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:02:39.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:39.654140+0000) 2019-10-23T15:02:40.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:40.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:40.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:40.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:40.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:40.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:40.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:40.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:41.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:02:41.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:41.671029+0000) 2019-10-23T15:02:42.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:42.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:42.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:42.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:42.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:02:42.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:42.665923+0000) 2019-10-23T15:02:42.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:42.974+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:42.979 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:42.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:43.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:02:43.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:43.629574+0000) 2019-10-23T15:02:43.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:43.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:43.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:43.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:44.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:02:44.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:44.674319+0000) 2019-10-23T15:02:44.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:44.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:44.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:44.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:45.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:45.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:45.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:45.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:46.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:46.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:46.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:46.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:47.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:02:47.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:47.152371+0000) 2019-10-23T15:02:47.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:47.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:47.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:47.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:48.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:48.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:48.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:48.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:49.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:02:49.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:49.654327+0000) 2019-10-23T15:02:49.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:49.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:49.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:49.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:50.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:50.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:50.936 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:50.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:51.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:02:51.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:51.671127+0000) 2019-10-23T15:02:51.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:51.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:51.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:51.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:52.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:02:52.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:52.666017+0000) 2019-10-23T15:02:52.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:52.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:52.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:52.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:53.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:02:53.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:53.629669+0000) 2019-10-23T15:02:53.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:53.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:53.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:53.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:54.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:02:54.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:54.674531+0000) 2019-10-23T15:02:54.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:54.874+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:54.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:54.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:55.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:55.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:55.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:55.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:56.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:56.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:56.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:56.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:57.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:02:57.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:57.152463+0000) 2019-10-23T15:02:57.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:57.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:57.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:57.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:58.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:58.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:58.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:58.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:02:59.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:02:59.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:02:59.654474+0000) 2019-10-23T15:02:59.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:59.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:02:59.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:02:59.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:00.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:00.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:00.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:00.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:01.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:03:01.669+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:01.671225+0000) 2019-10-23T15:03:01.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:01.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:01.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:01.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:02.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:03:02.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:02.666110+0000) 2019-10-23T15:03:02.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:02.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:02.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:02.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:03.631 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:03:03.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:03.629762+0000) 2019-10-23T15:03:03.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:03.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:03.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:03.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:04.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:03:04.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:04.674668+0000) 2019-10-23T15:03:04.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:04.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:04.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:04.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:05.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:05.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:05.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:05.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:06.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:06.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:06.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:06.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:07.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:03:07.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:07.152559+0000) 2019-10-23T15:03:07.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:07.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:07.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:07.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:08.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:08.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:08.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:08.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:09.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:03:09.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:09.654573+0000) 2019-10-23T15:03:09.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:09.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:09.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:09.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:10.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:10.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:10.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:10.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:11.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:03:11.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:11.671320+0000) 2019-10-23T15:03:11.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:11.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:11.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:11.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:12.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:03:12.664+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:12.666205+0000) 2019-10-23T15:03:12.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:12.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:12.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:12.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:13.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:03:13.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:13.629857+0000) 2019-10-23T15:03:13.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:13.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:13.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:13.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:14.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:03:14.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:14.674778+0000) 2019-10-23T15:03:14.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:14.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:14.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:14.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:15.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:15.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:15.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:15.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:16.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:16.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:16.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:16.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:17.154 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:03:17.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:17.152657+0000) 2019-10-23T15:03:17.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:17.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:17.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:17.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:18.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:18.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:18.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:18.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:19.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:03:19.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:19.654676+0000) 2019-10-23T15:03:19.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:19.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:19.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:19.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:20.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:20.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:20.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:20.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:21.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:03:21.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:21.671419+0000) 2019-10-23T15:03:21.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:21.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:21.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:21.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:22.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:03:22.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:22.666297+0000) 2019-10-23T15:03:22.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:22.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:22.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:22.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:23.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:03:23.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:23.629951+0000) 2019-10-23T15:03:23.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:23.877+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:23.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:23.877+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:24.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:03:24.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:24.674886+0000) 2019-10-23T15:03:24.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:24.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:24.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:24.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:25.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:25.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:25.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:25.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:26.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:26.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:26.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:26.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:27.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:03:27.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:27.152753+0000) 2019-10-23T15:03:27.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:27.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:27.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:27.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:28.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:28.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:28.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:28.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:29.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:03:29.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:29.654777+0000) 2019-10-23T15:03:29.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:29.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:29.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:29.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:30.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:30.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:30.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:30.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:31.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:03:31.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:31.671517+0000) 2019-10-23T15:03:31.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:31.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:31.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:31.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:32.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:03:32.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:32.666391+0000) 2019-10-23T15:03:33.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:33.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:33.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:33.006+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:33.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:03:33.628+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:33.630047+0000) 2019-10-23T15:03:34.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:34.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:34.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:34.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:34.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:03:34.673+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:34.674990+0000) 2019-10-23T15:03:35.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:34.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:35.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:34.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:36.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:36.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:36.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:36.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:37.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:37.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:37.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:37.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:37.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:03:37.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:37.152852+0000) 2019-10-23T15:03:38.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:38.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:38.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:38.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:39.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:39.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:39.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:39.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:39.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:03:39.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:39.654876+0000) 2019-10-23T15:03:40.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:40.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:40.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:40.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:41.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:41.183+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:41.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:41.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:41.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:03:41.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:41.671611+0000) 2019-10-23T15:03:42.220 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:42.216+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:42.221 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:42.216+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:42.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:03:42.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:42.666485+0000) 2019-10-23T15:03:43.175 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:43.171+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:43.176 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:43.171+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:43.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:03:43.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:43.630142+0000) 2019-10-23T15:03:44.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:44.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:44.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:44.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:44.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:03:44.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:44.675100+0000) 2019-10-23T15:03:45.178 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:45.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:45.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:45.174+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:46.226 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:46.222+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:46.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:46.222+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:47.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:03:47.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:47.152946+0000) 2019-10-23T15:03:47.201 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:47.197+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:47.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:47.197+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:48.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:48.226+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:48.231 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:48.226+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:49.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:49.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:49.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:49.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:49.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:03:49.653+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:49.654977+0000) 2019-10-23T15:03:50.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:50.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:50.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:50.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:51.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:51.260+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:51.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:51.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:51.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:03:51.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:51.671710+0000) 2019-10-23T15:03:52.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:52.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:52.275 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:52.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:52.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:03:52.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:52.666578+0000) 2019-10-23T15:03:53.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:53.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:53.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:53.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:53.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:03:53.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:53.630237+0000) 2019-10-23T15:03:54.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:54.272+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:54.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:54.272+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:54.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:03:54.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:54.675206+0000) 2019-10-23T15:03:55.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:55.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:55.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:55.267+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:56.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:56.230+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:56.235 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:56.230+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:57.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:03:57.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:57.153042+0000) 2019-10-23T15:03:57.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:57.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:57.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:57.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:58.229 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:58.225+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:58.230 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:58.225+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:59.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:59.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:03:59.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:03:59.227+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:03:59.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:03:59.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:03:59.655078+0000) 2019-10-23T15:04:00.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:00.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:00.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:00.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:01.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:01.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:01.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:01.140+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:01.673 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:04:01.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:01.671803+0000) 2019-10-23T15:04:02.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:02.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:02.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:02.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:02.668 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:04:02.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:02.666675+0000) 2019-10-23T15:04:03.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:03.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:03.134 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:03.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:03.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:04:03.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:03.630332+0000) 2019-10-23T15:04:04.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:04.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:04.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:04.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:04.678 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:04:04.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:04.675309+0000) 2019-10-23T15:04:05.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:05.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:05.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:05.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:06.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:06.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:06.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:06.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:07.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:07.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:07.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:07.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:07.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:04:07.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:07.153138+0000) 2019-10-23T15:04:08.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:08.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:08.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:08.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:09.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:09.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:09.211 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:09.207+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:09.658 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:04:09.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:09.655186+0000) 2019-10-23T15:04:10.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:10.209+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:10.213 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:10.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:11.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:11.249+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:11.255 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:11.250+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:11.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:04:11.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:11.671898+0000) 2019-10-23T15:04:12.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:12.239+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:12.244 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:12.239+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:12.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:04:12.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:12.666770+0000) 2019-10-23T15:04:13.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:13.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:13.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:13.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:13.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:04:13.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:13.630426+0000) 2019-10-23T15:04:14.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:14.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:14.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:14.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:14.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:04:14.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:14.675419+0000) 2019-10-23T15:04:15.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:15.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:15.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:15.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:16.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:16.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:16.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:16.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:17.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:17.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:17.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:17.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:17.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:04:17.151+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:17.153231+0000) 2019-10-23T15:04:18.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:18.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:18.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:18.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:19.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:19.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:19.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:19.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:19.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:04:19.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:19.655379+0000) 2019-10-23T15:04:20.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:20.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:20.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:20.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:21.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:21.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:21.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:21.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:21.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:04:21.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:21.671990+0000) 2019-10-23T15:04:22.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:22.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:22.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:22.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:22.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:04:22.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:22.666864+0000) 2019-10-23T15:04:23.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:23.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:23.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:23.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:23.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:04:23.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:23.630521+0000) 2019-10-23T15:04:24.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:24.115+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:24.120 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:24.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:24.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:04:24.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:24.675591+0000) 2019-10-23T15:04:25.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:25.123+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:25.128 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:25.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:26.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:26.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:26.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:26.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:27.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:27.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:27.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:27.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:27.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:04:27.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:27.153326+0000) 2019-10-23T15:04:28.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:28.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:28.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:29.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:29.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:29.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:29.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:29.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:04:29.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:29.655532+0000) 2019-10-23T15:04:30.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:30.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:30.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:30.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:31.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:31.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:31.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:31.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:31.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:04:31.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:31.672082+0000) 2019-10-23T15:04:32.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:32.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:32.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:32.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:32.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:04:32.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:32.666959+0000) 2019-10-23T15:04:33.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:33.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:33.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:33.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:33.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:04:33.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:33.630617+0000) 2019-10-23T15:04:34.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:34.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:34.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:34.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:34.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:04:34.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:34.675727+0000) 2019-10-23T15:04:35.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:35.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:35.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:35.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:36.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:36.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:36.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:36.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:36.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:36.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:36.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:36.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:37.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:04:37.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:37.153415+0000) 2019-10-23T15:04:38.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:38.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:38.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:38.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:39.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:39.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:39.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:39.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:39.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:04:39.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:39.655632+0000) 2019-10-23T15:04:39.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:39.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:39.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:39.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:40.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:40.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:40.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:40.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:41.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:04:41.670+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:41.672175+0000) 2019-10-23T15:04:41.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:41.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:41.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:41.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:42.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:04:42.665+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:42.667053+0000) 2019-10-23T15:04:42.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:42.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:42.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:42.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:43.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:04:43.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:43.630709+0000) 2019-10-23T15:04:43.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:43.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:43.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:43.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:44.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:04:44.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:44.675833+0000) 2019-10-23T15:04:44.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:44.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:44.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:44.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:45.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:45.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:45.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:45.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:46.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:46.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:46.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:46.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:47.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:04:47.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:47.153508+0000) 2019-10-23T15:04:47.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:47.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:47.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:47.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:48.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:48.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:48.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:48.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:49.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:04:49.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:49.655729+0000) 2019-10-23T15:04:49.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:49.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:49.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:49.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:50.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:50.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:50.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:50.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:51.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:04:51.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:51.672272+0000) 2019-10-23T15:04:51.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:51.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:51.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:51.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:52.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:04:52.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:52.667148+0000) 2019-10-23T15:04:52.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:52.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:52.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:52.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:53.632 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:04:53.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:53.630803+0000) 2019-10-23T15:04:53.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:53.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:53.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:53.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:54.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:04:54.674+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:54.675942+0000) 2019-10-23T15:04:54.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:54.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:54.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:54.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:55.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:55.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:55.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:55.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:56.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:56.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:56.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:56.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:57.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:04:57.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:57.153603+0000) 2019-10-23T15:04:57.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:57.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:57.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:57.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:58.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:58.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:58.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:58.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:04:59.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:04:59.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:04:59.655828+0000) 2019-10-23T15:04:59.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:59.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:04:59.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:04:59.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:00.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:00.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:00.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:00.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:01.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:05:01.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:01.672373+0000) 2019-10-23T15:05:01.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:01.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:01.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:01.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:02.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:05:02.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:02.667240+0000) 2019-10-23T15:05:02.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:02.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:02.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:02.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:03.633 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:05:03.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:03.630897+0000) 2019-10-23T15:05:03.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:03.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:03.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:03.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:04.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:05:04.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:04.676056+0000) 2019-10-23T15:05:04.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:04.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:04.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:04.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:05.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:05.841+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:05.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:05.841+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:06.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:06.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:06.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:06.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:07.155 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:05:07.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:07.153699+0000) 2019-10-23T15:05:07.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:07.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:07.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:07.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:08.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:08.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:08.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:08.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:09.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:05:09.654+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:09.655925+0000) 2019-10-23T15:05:09.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:09.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:09.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:09.759+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:10.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:10.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:10.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:10.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:11.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:05:11.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:11.672470+0000) 2019-10-23T15:05:11.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:11.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:11.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:11.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:12.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:05:12.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:12.667295+0000) 2019-10-23T15:05:12.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:12.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:12.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:12.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:13.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:05:13.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:13.630989+0000) 2019-10-23T15:05:13.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:13.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:13.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:13.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:14.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:05:14.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:14.676167+0000) 2019-10-23T15:05:14.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:14.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:14.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:14.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:15.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:15.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:15.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:15.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:16.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:16.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:16.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:16.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:17.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:05:17.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:17.153795+0000) 2019-10-23T15:05:17.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:17.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:17.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:17.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:18.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:18.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:18.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:18.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:19.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:05:19.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:19.656029+0000) 2019-10-23T15:05:19.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:19.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:19.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:19.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:20.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:20.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:20.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:20.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:21.674 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:05:21.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:21.672571+0000) 2019-10-23T15:05:21.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:21.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:21.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:21.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:22.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:22.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:22.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:22.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:22.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:05:22.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:22.667390+0000) 2019-10-23T15:05:23.633 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:05:23.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:23.631083+0000) 2019-10-23T15:05:23.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:23.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:23.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:23.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:24.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:05:24.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:24.676339+0000) 2019-10-23T15:05:24.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:24.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:24.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:24.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:25.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:25.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:25.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:25.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:26.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:26.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:26.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:26.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:27.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:05:27.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:27.153891+0000) 2019-10-23T15:05:27.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:27.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:27.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:27.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:28.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:28.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:28.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:28.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:29.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:05:29.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:29.656169+0000) 2019-10-23T15:05:29.707 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:29.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:29.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:29.703+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:30.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:30.716+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:30.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:30.717+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:31.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:05:31.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:31.672713+0000) 2019-10-23T15:05:31.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:31.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:31.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:31.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:32.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:32.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:32.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:32.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:32.669 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:05:32.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:32.667529+0000) 2019-10-23T15:05:33.633 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:05:33.629+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:33.631223+0000) 2019-10-23T15:05:33.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:33.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:33.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:33.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:34.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:34.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:34.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:34.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:34.679 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:05:34.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:34.676469+0000) 2019-10-23T15:05:35.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:35.687+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:35.692 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:35.687+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:36.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:36.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:36.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:36.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:37.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:05:37.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:37.154026+0000) 2019-10-23T15:05:37.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:37.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:37.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:37.676+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:38.690 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:38.686+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:38.691 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:38.686+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:39.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:05:39.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:39.656313+0000) 2019-10-23T15:05:39.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:39.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:39.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:39.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:40.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:40.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:40.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:40.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:41.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:05:41.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:41.672909+0000) 2019-10-23T15:05:41.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:41.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:41.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:41.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:42.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:05:42.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:42.667709+0000) 2019-10-23T15:05:42.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:42.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:42.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:42.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:43.633 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:05:43.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:43.631425+0000) 2019-10-23T15:05:43.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:43.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:43.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:43.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:44.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:05:44.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:44.676579+0000) 2019-10-23T15:05:44.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:44.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:44.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:44.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:45.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:45.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:45.686 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:45.682+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:46.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:46.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:46.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:46.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:47.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:05:47.152+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:47.154172+0000) 2019-10-23T15:05:47.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:47.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:47.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:47.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:48.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:48.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:48.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:48.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:49.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:49.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:49.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:49.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:49.659 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:05:49.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:49.656410+0000) 2019-10-23T15:05:50.601 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:50.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:50.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:50.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:51.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:51.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:51.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:51.578+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:51.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:05:51.671+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:51.673063+0000) 2019-10-23T15:05:52.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:52.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:52.589 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:52.585+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:52.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:05:52.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:52.667838+0000) 2019-10-23T15:05:53.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:53.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:53.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:53.597+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:53.633 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:05:53.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:53.631578+0000) 2019-10-23T15:05:54.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:54.629+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:54.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:54.629+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:54.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:05:54.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:54.676689+0000) 2019-10-23T15:05:55.587 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:55.583+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:55.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:55.583+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:56.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:56.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:56.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:56.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:57.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:05:57.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:57.154269+0000) 2019-10-23T15:05:57.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:57.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:57.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:57.636+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:58.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:58.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:58.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:58.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:05:59.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:05:59.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:05:59.656509+0000) 2019-10-23T15:05:59.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:59.674+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:05:59.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:05:59.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:00.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:00.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:00.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:00.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:01.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:01.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:01.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:01.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:06:01.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:01.673161+0000) 2019-10-23T15:06:02.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:02.633+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:02.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:02.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:02.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:06:02.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:02.667934+0000) 2019-10-23T15:06:03.633 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:06:03.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:03.631673+0000) 2019-10-23T15:06:03.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:03.680+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:03.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:03.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:04.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:06:04.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:04.676796+0000) 2019-10-23T15:06:04.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:04.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:04.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:04.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:05.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:05.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:05.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:05.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:06.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:06.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:06.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:06.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:07.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:06:07.154+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:07.154367+0000) 2019-10-23T15:06:07.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:07.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:07.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:07.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:08.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:08.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:08.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:08.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:09.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:06:09.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:09.656606+0000) 2019-10-23T15:06:09.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:09.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:09.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:09.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:10.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:10.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:10.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:10.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:11.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:06:11.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:11.673256+0000) 2019-10-23T15:06:11.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:11.724+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:11.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:11.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:12.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:06:12.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:12.668030+0000) 2019-10-23T15:06:12.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:12.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:12.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:12.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:13.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:06:13.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:13.631772+0000) 2019-10-23T15:06:13.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:13.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:13.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:13.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:14.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:06:14.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:14.676904+0000) 2019-10-23T15:06:14.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:14.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:14.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:14.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:15.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:15.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:15.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:15.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:16.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:16.677+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:16.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:16.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:17.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:06:17.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:17.154464+0000) 2019-10-23T15:06:17.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:17.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:17.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:17.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:18.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:18.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:18.630 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:18.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:19.607 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:19.603+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:19.608 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:19.603+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:19.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:06:19.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:19.656703+0000) 2019-10-23T15:06:20.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:20.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:20.639 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:20.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:21.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:21.623+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:21.628 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:21.623+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:21.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:06:21.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:21.673356+0000) 2019-10-23T15:06:22.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:06:22.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:22.668118+0000) 2019-10-23T15:06:22.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:22.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:22.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:22.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:23.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:06:23.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:23.631866+0000) 2019-10-23T15:06:23.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:23.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:23.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:23.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:24.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:24.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:24.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:24.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:24.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:06:24.675+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:24.677012+0000) 2019-10-23T15:06:25.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:25.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:25.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:25.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:26.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:26.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:26.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:26.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:27.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:06:27.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:27.154560+0000) 2019-10-23T15:06:27.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:27.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:27.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:27.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:28.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:28.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:28.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:28.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:29.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:06:29.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:29.656803+0000) 2019-10-23T15:06:29.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:29.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:29.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:29.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:30.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:30.792+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:30.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:30.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:31.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:06:31.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:31.673449+0000) 2019-10-23T15:06:31.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:31.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:31.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:31.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:32.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:06:32.666+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:32.668209+0000) 2019-10-23T15:06:32.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:32.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:32.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:32.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:33.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:06:33.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:33.631962+0000) 2019-10-23T15:06:33.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:33.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:33.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:33.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:34.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:06:34.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:34.677120+0000) 2019-10-23T15:06:34.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:34.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:34.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:34.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:35.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:35.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:35.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:35.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:36.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:36.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:36.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:36.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:37.156 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:06:37.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:37.154654+0000) 2019-10-23T15:06:37.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:37.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:37.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:37.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:38.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:38.749+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:38.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:38.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:39.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:06:39.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:39.656897+0000) 2019-10-23T15:06:39.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:39.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:39.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:39.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:40.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:40.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:40.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:40.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:41.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:06:41.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:41.673542+0000) 2019-10-23T15:06:41.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:41.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:41.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:41.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:42.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:06:42.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:42.668303+0000) 2019-10-23T15:06:42.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:42.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:42.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:42.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:43.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:06:43.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:43.632057+0000) 2019-10-23T15:06:43.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:43.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:43.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:43.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:44.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:06:44.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:44.677224+0000) 2019-10-23T15:06:44.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:44.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:44.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:44.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:45.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:45.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:45.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:45.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:46.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:46.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:46.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:46.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:47.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:06:47.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:47.154752+0000) 2019-10-23T15:06:47.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:47.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:47.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:47.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:48.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:48.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:48.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:48.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:49.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:06:49.655+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:49.656994+0000) 2019-10-23T15:06:49.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:49.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:49.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:49.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:50.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:50.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:50.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:50.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:51.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:06:51.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:51.673641+0000) 2019-10-23T15:06:51.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:51.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:51.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:51.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:52.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:06:52.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:52.668395+0000) 2019-10-23T15:06:52.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:52.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:52.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:52.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:53.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:06:53.630+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:53.632153+0000) 2019-10-23T15:06:53.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:53.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:53.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:53.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:54.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:06:54.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:54.677329+0000) 2019-10-23T15:06:54.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:54.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:54.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:54.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:55.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:55.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:55.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:55.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:56.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:56.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:56.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:56.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:57.163 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:06:57.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:57.154846+0000) 2019-10-23T15:06:57.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:57.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:57.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:57.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:58.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:58.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:58.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:58.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:06:59.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:06:59.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:06:59.657092+0000) 2019-10-23T15:06:59.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:59.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:06:59.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:06:59.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:00.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:00.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:00.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:00.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:01.675 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:07:01.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:01.673740+0000) 2019-10-23T15:07:01.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:01.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:01.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:01.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:02.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:07:02.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:02.668494+0000) 2019-10-23T15:07:02.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:02.700+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:02.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:02.700+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:03.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:07:03.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:03.632249+0000) 2019-10-23T15:07:03.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:03.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:03.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:03.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:04.680 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:07:04.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:04.677432+0000) 2019-10-23T15:07:04.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:04.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:04.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:04.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:05.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:05.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:05.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:05.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:06.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:06.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:06.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:06.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:07.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:07.154+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:07.154940+0000) 2019-10-23T15:07:07.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:07.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:07.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:07.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:08.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:08.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:08.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:08.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:09.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:07:09.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:09.657186+0000) 2019-10-23T15:07:09.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:09.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:09.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:09.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:10.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:10.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:10.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:10.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:11.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:07:11.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:11.673838+0000) 2019-10-23T15:07:11.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:11.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:11.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:11.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:12.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:07:12.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:12.668590+0000) 2019-10-23T15:07:12.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:12.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:12.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:12.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:13.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:07:13.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:13.632350+0000) 2019-10-23T15:07:13.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:13.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:13.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:13.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:14.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:07:14.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:14.677542+0000) 2019-10-23T15:07:14.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:14.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:14.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:14.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:15.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:15.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:15.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:15.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:16.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:16.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:16.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:16.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:17.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:17.154+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:17.155039+0000) 2019-10-23T15:07:17.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:17.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:17.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:17.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:18.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:18.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:18.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:18.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:19.660 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:07:19.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:19.657284+0000) 2019-10-23T15:07:19.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:19.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:19.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:19.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:20.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:20.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:20.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:20.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:21.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:07:21.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:21.673933+0000) 2019-10-23T15:07:21.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:21.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:21.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:21.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:22.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:07:22.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:22.668703+0000) 2019-10-23T15:07:22.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:22.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:22.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:22.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:23.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:07:23.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:23.632446+0000) 2019-10-23T15:07:23.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:23.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:23.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:23.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:24.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:07:24.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:24.677651+0000) 2019-10-23T15:07:24.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:24.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:24.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:24.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:25.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:25.746+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:25.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:25.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:26.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:26.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:26.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:26.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:27.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:27.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:27.155138+0000) 2019-10-23T15:07:27.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:27.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:27.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:27.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:28.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:28.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:28.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:28.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:29.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:07:29.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:29.657385+0000) 2019-10-23T15:07:29.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:29.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:29.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:29.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:30.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:30.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:30.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:30.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:31.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:07:31.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:31.674026+0000) 2019-10-23T15:07:31.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:31.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:31.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:31.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:32.670 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:07:32.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:32.668799+0000) 2019-10-23T15:07:32.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:32.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:32.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:32.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:33.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:07:33.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:33.632540+0000) 2019-10-23T15:07:33.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:33.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:33.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:33.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:34.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:07:34.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:34.677756+0000) 2019-10-23T15:07:34.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:34.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:34.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:34.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:35.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:35.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:35.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:35.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:36.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:36.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:36.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:36.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:37.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:37.153+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:37.155236+0000) 2019-10-23T15:07:37.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:37.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:37.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:37.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:38.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:38.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:38.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:38.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:39.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:07:39.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:39.657480+0000) 2019-10-23T15:07:39.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:39.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:39.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:39.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:40.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:40.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:40.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:40.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:41.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:07:41.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:41.674123+0000) 2019-10-23T15:07:41.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:41.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:41.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:41.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:42.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:07:42.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:42.668894+0000) 2019-10-23T15:07:42.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:42.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:42.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:42.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:43.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:07:43.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:43.632634+0000) 2019-10-23T15:07:43.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:43.759+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:43.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:43.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:44.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:07:44.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:44.677870+0000) 2019-10-23T15:07:44.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:44.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:44.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:44.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:45.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:45.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:45.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:45.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:46.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:46.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:46.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:46.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:47.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:47.154+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:47.155300+0000) 2019-10-23T15:07:47.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:47.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:47.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:47.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:48.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:48.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:48.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:48.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:49.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:07:49.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:49.657578+0000) 2019-10-23T15:07:49.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:49.729+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:49.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:49.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:50.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:50.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:50.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:50.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:51.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:07:51.672+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:51.674218+0000) 2019-10-23T15:07:51.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:51.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:51.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:51.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:52.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:07:52.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:52.668991+0000) 2019-10-23T15:07:52.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:52.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:52.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:52.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:53.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:07:53.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:53.632731+0000) 2019-10-23T15:07:53.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:53.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:53.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:53.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:54.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:07:54.676+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:54.677983+0000) 2019-10-23T15:07:54.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:54.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:54.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:54.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:55.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:55.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:55.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:55.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:56.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:56.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:56.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:56.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:57.157 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:57.154+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:57.155388+0000) 2019-10-23T15:07:57.158 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:07:57.154+0000 7fa171eda700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:57.155965+0000) 2019-10-23T15:07:57.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:57.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:57.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:57.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:58.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:58.649+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:58.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:58.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:07:59.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:07:59.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:07:59.657677+0000) 2019-10-23T15:07:59.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:59.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:07:59.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:07:59.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:00.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:00.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:00.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:00.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:01.657 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:08:01.654+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:01.655572+0000) 2019-10-23T15:08:01.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:08:01.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:01.674311+0000) 2019-10-23T15:08:01.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:01.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:01.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:01.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:02.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:08:02.667+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:02.669087+0000) 2019-10-23T15:08:02.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:02.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:02.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:02.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:03.634 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:08:03.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:03.632826+0000) 2019-10-23T15:08:03.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:03.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:03.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:03.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:04.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:08:04.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:04.678060+0000) 2019-10-23T15:08:04.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:04.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:04.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:04.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:05.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:05.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:05.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:05.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:06.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:06.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:06.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:06.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:07.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:07.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:07.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:07.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:08.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:08.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:08.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:08.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:09.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:08:09.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:09.657785+0000) 2019-10-23T15:08:09.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:09.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:09.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:09.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:10.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:10.871+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:10.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:10.871+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:11.657 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:08:11.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:11.655668+0000) 2019-10-23T15:08:11.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:08:11.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:11.674405+0000) 2019-10-23T15:08:11.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:11.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:11.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:11.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:12.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:08:12.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:12.669182+0000) 2019-10-23T15:08:12.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:12.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:12.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:12.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:13.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:08:13.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:13.632919+0000) 2019-10-23T15:08:13.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:13.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:13.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:13.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:14.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:08:14.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:14.678173+0000) 2019-10-23T15:08:14.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:14.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:14.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:14.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:15.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:15.774+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:15.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:15.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:16.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:16.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:16.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:16.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:17.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:17.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:17.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:17.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:18.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:18.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:18.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:18.716+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:19.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:08:19.656+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:19.657920+0000) 2019-10-23T15:08:19.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:19.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:19.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:19.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:20.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:20.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:20.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:20.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:21.657 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:08:21.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:21.655767+0000) 2019-10-23T15:08:21.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:08:21.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:21.674497+0000) 2019-10-23T15:08:21.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:21.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:21.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:21.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:22.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:08:22.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:22.669279+0000) 2019-10-23T15:08:22.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:22.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:22.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:22.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:23.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:08:23.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:23.633015+0000) 2019-10-23T15:08:23.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:23.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:23.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:23.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:24.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:08:24.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:24.678280+0000) 2019-10-23T15:08:24.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:24.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:24.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:24.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:25.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:25.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:25.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:25.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:26.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:26.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:26.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:26.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:27.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:27.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:27.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:27.776+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:28.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:28.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:28.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:28.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:29.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:08:29.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:29.658018+0000) 2019-10-23T15:08:29.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:29.781+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:29.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:29.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:30.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:30.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:30.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:30.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:31.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:08:31.654+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:31.655864+0000) 2019-10-23T15:08:31.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:08:31.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:31.674589+0000) 2019-10-23T15:08:31.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:31.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:31.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:31.750+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:32.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:08:32.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:32.669377+0000) 2019-10-23T15:08:32.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:32.703+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:32.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:32.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:33.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:08:33.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:33.633108+0000) 2019-10-23T15:08:33.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:33.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:33.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:33.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:34.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:08:34.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:34.678387+0000) 2019-10-23T15:08:34.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:34.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:34.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:34.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:35.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:35.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:35.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:35.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:36.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:36.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:36.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:36.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:37.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:37.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:37.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:37.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:38.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:38.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:38.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:38.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:39.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:08:39.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:39.658119+0000) 2019-10-23T15:08:39.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:39.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:39.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:39.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:40.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:40.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:40.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:40.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:41.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:08:41.654+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:41.655957+0000) 2019-10-23T15:08:41.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:08:41.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:41.674681+0000) 2019-10-23T15:08:41.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:41.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:41.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:41.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:42.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:08:42.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:42.669471+0000) 2019-10-23T15:08:42.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:42.702+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:42.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:42.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:43.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:08:43.631+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:43.633203+0000) 2019-10-23T15:08:43.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:43.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:43.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:43.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:44.681 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:08:44.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:44.678499+0000) 2019-10-23T15:08:44.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:44.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:44.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:44.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:45.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:45.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:45.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:45.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:46.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:46.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:46.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:46.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:47.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:47.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:47.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:47.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:48.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:48.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:48.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:48.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:49.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:08:49.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:49.658217+0000) 2019-10-23T15:08:49.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:49.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:49.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:49.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:50.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:50.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:50.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:50.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:51.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:08:51.654+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:51.656054+0000) 2019-10-23T15:08:51.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:08:51.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:51.674772+0000) 2019-10-23T15:08:51.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:51.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:51.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:51.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:52.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:08:52.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:52.669569+0000) 2019-10-23T15:08:52.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:52.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:52.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:52.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:53.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:08:53.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:53.633300+0000) 2019-10-23T15:08:53.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:53.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:53.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:53.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:54.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:08:54.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:54.678609+0000) 2019-10-23T15:08:54.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:54.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:54.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:54.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:55.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:55.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:55.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:55.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:56.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:56.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:56.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:56.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:57.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:57.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:57.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:57.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:58.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:58.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:58.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:58.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:08:59.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:08:59.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:08:59.658316+0000) 2019-10-23T15:08:59.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:59.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:08:59.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:08:59.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:00.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:00.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:00.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:00.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:01.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:09:01.654+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:01.656150+0000) 2019-10-23T15:09:01.676 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:09:01.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:01.674863+0000) 2019-10-23T15:09:01.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:01.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:01.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:01.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:02.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:09:02.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:02.669665+0000) 2019-10-23T15:09:02.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:02.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:02.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:02.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:03.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:09:03.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:03.633396+0000) 2019-10-23T15:09:03.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:03.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:03.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:03.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:04.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:09:04.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:04.678718+0000) 2019-10-23T15:09:04.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:04.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:04.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:04.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:05.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:05.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:05.876 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:05.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:06.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:06.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:06.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:06.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:07.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:07.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:07.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:07.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:08.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:08.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:08.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:08.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:09.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:09:09.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:09.658414+0000) 2019-10-23T15:09:09.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:09.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:09.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:09.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:10.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:10.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:10.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:10.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:11.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:09:11.654+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:11.656246+0000) 2019-10-23T15:09:11.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:09:11.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:11.674957+0000) 2019-10-23T15:09:11.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:11.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:11.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:11.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:12.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:09:12.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:12.669758+0000) 2019-10-23T15:09:13.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:13.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:13.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:13.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:13.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:09:13.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:13.633490+0000) 2019-10-23T15:09:14.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:14.023+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:14.028 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:14.024+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:14.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:09:14.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:14.678830+0000) 2019-10-23T15:09:15.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:15.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:15.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:15.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:15.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:15.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:15.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:15.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:16.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:16.980+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:16.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:16.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:17.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:17.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:17.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:17.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:18.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:18.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:18.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:18.991+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:19.661 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:09:19.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:19.658516+0000) 2019-10-23T15:09:20.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:20.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:20.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:20.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:21.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:21.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:21.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:21.043+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:21.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:09:21.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:21.656345+0000) 2019-10-23T15:09:21.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:09:21.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:21.675052+0000) 2019-10-23T15:09:22.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:22.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:22.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:22.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:22.671 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:09:22.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:22.669854+0000) 2019-10-23T15:09:22.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:22.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:22.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:22.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:23.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:09:23.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:23.633586+0000) 2019-10-23T15:09:24.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:24.012+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:24.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:24.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:24.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:09:24.677+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:24.678940+0000) 2019-10-23T15:09:24.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:24.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:24.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:24.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:26.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:26.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:26.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:26.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:27.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:27.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:27.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:27.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:28.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:28.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:28.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:28.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:28.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:28.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:28.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:28.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:29.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:09:29.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:29.658613+0000) 2019-10-23T15:09:30.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:30.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:30.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:30.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:31.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:31.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:31.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:31.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:31.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:09:31.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:31.656442+0000) 2019-10-23T15:09:31.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:09:31.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:31.675143+0000) 2019-10-23T15:09:32.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:32.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:32.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:32.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:32.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:09:32.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:32.669949+0000) 2019-10-23T15:09:33.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:33.001+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:33.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:33.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:33.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:09:33.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:33.633678+0000) 2019-10-23T15:09:33.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:33.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:33.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:33.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:34.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:09:34.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:34.679055+0000) 2019-10-23T15:09:34.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:34.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:34.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:34.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:35.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:35.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:35.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:35.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:36.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:36.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:36.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:36.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:37.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:37.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:37.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:37.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:38.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:38.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:38.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:38.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:39.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:09:39.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:39.658710+0000) 2019-10-23T15:09:39.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:39.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:39.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:39.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:40.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:40.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:40.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:40.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:41.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:09:41.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:41.656541+0000) 2019-10-23T15:09:41.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:09:41.673+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:41.675236+0000) 2019-10-23T15:09:41.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:41.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:41.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:41.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:42.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:09:42.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:42.670044+0000) 2019-10-23T15:09:42.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:42.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:42.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:42.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:43.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:09:43.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:43.633775+0000) 2019-10-23T15:09:43.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:43.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:43.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:43.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:44.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:09:44.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:44.679166+0000) 2019-10-23T15:09:44.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:44.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:44.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:44.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:45.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:45.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:45.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:45.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:46.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:46.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:46.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:46.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:47.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:47.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:47.926 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:47.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:48.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:48.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:48.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:48.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:49.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:09:49.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:49.658810+0000) 2019-10-23T15:09:49.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:49.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:49.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:49.863+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:50.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:50.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:50.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:50.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:51.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:09:51.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:51.656640+0000) 2019-10-23T15:09:51.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:09:51.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:51.675328+0000) 2019-10-23T15:09:51.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:51.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:51.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:51.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:52.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:09:52.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:52.670140+0000) 2019-10-23T15:09:52.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:52.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:52.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:52.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:53.635 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:09:53.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:53.633869+0000) 2019-10-23T15:09:53.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:53.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:53.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:53.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:54.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:09:54.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:54.679274+0000) 2019-10-23T15:09:54.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:54.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:54.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:54.959+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:55.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:55.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:55.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:55.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:57.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:56.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:57.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:57.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:58.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:58.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:58.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:58.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:58.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:58.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:58.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:58.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:09:59.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:09:59.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:09:59.658910+0000) 2019-10-23T15:09:59.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:59.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:09:59.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:09:59.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:01.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:01.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:01.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:01.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:01.658 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:10:01.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:01.656770+0000) 2019-10-23T15:10:01.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:10:01.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:01.675458+0000) 2019-10-23T15:10:02.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:02.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:02.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:02.068+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:02.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:10:02.668+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:02.670237+0000) 2019-10-23T15:10:03.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:03.107+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:03.112 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:03.107+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:03.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:10:03.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:03.633964+0000) 2019-10-23T15:10:04.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:04.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:04.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:04.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:04.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:10:04.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:04.679384+0000) 2019-10-23T15:10:05.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:05.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:05.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:05.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:05.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:05.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:05.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:05.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:07.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:07.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:07.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:07.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:08.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:08.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:08.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:08.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:09.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:08.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:09.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:08.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:09.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:10:09.657+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:09.659007+0000) 2019-10-23T15:10:10.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:10.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:10.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:10.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:10.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:10.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:10.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:10.985+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:11.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:10:11.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:11.656904+0000) 2019-10-23T15:10:11.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:10:11.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:11.675588+0000) 2019-10-23T15:10:12.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:12.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:12.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:12.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:12.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:10:12.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:12.670334+0000) 2019-10-23T15:10:13.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:12.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:13.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:12.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:13.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:10:13.632+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:13.634059+0000) 2019-10-23T15:10:13.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:13.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:13.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:13.953+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:14.682 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:10:14.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:14.679493+0000) 2019-10-23T15:10:14.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:14.938+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:14.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:14.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:15.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:15.916+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:15.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:15.917+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:16.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:16.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:16.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:16.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:17.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:17.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:17.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:17.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:18.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:18.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:18.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:18.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:19.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:10:19.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:19.659108+0000) 2019-10-23T15:10:19.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:19.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:19.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:19.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:20.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:20.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:20.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:20.868+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:21.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:10:21.655+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:21.657001+0000) 2019-10-23T15:10:21.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:10:21.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:21.675684+0000) 2019-10-23T15:10:21.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:21.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:21.872 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:21.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:22.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:10:22.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:22.670428+0000) 2019-10-23T15:10:22.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:22.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:22.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:22.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:23.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:10:23.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:23.634154+0000) 2019-10-23T15:10:23.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:23.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:23.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:23.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:24.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:10:24.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:24.679605+0000) 2019-10-23T15:10:24.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:24.745+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:24.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:24.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:25.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:25.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:25.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:25.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:26.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:26.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:26.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:26.725+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:27.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:27.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:27.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:27.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:28.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:28.667+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:28.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:28.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:29.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:10:29.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:29.659207+0000) 2019-10-23T15:10:29.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:29.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:29.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:29.695+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:30.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:30.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:30.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:30.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:31.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:10:31.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:31.657099+0000) 2019-10-23T15:10:31.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:10:31.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:31.675777+0000) 2019-10-23T15:10:31.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:31.688+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:31.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:31.688+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:32.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:10:32.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:32.670524+0000) 2019-10-23T15:10:32.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:32.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:32.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:32.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:33.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:10:33.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:33.634247+0000) 2019-10-23T15:10:33.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:33.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:33.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:33.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:34.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:10:34.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:34.679712+0000) 2019-10-23T15:10:34.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:34.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:34.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:34.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:35.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:35.764+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:35.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:35.764+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:36.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:36.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:36.744 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:36.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:37.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:37.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:37.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:37.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:38.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:38.685+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:38.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:38.685+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:39.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:39.653+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:39.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:39.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:39.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:10:39.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:39.659300+0000) 2019-10-23T15:10:40.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:40.635+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:40.640 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:40.635+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:41.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:10:41.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:41.657195+0000) 2019-10-23T15:10:41.673 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:41.669+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:41.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:41.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:41.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:10:41.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:41.675873+0000) 2019-10-23T15:10:42.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:42.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:42.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:42.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:42.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:10:42.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:42.670621+0000) 2019-10-23T15:10:43.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:10:43.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:43.634298+0000) 2019-10-23T15:10:43.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:43.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:43.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:43.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:44.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:10:44.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:44.679821+0000) 2019-10-23T15:10:44.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:44.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:44.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:44.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:45.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:45.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:45.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:45.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:46.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:46.732+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:46.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:46.732+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:47.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:47.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:47.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:47.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:48.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:48.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:48.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:48.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:49.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:10:49.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:49.659400+0000) 2019-10-23T15:10:49.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:49.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:49.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:49.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:50.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:50.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:50.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:50.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:51.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:10:51.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:51.657296+0000) 2019-10-23T15:10:51.677 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:10:51.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:51.675968+0000) 2019-10-23T15:10:51.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:51.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:51.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:51.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:52.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:10:52.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:52.670715+0000) 2019-10-23T15:10:52.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:52.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:52.699 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:52.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:53.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:10:53.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:53.634394+0000) 2019-10-23T15:10:53.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:53.707+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:53.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:53.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:54.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:54.661+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:54.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:54.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:54.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:10:54.678+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:54.679933+0000) 2019-10-23T15:10:55.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:55.699+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:55.704 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:55.699+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:56.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:56.656+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:56.661 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:56.657+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:57.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:57.637+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:57.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:57.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:58.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:58.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:58.609 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:58.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:59.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:59.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:10:59.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:10:59.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:10:59.662 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:10:59.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:10:59.659495+0000) 2019-10-23T15:11:00.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:00.576+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:00.582 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:00.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:01.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:01.597+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:01.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:01.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:01.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:11:01.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:01.657392+0000) 2019-10-23T15:11:01.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:11:01.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:01.676061+0000) 2019-10-23T15:11:02.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:02.563+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:02.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:02.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:02.672 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:11:02.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:02.670829+0000) 2019-10-23T15:11:03.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:03.555+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:03.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:03.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:03.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:11:03.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:03.634482+0000) 2019-10-23T15:11:04.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:04.593+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:04.597 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:04.593+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:04.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:11:04.679+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:04.680117+0000) 2019-10-23T15:11:05.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:05.620+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:05.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:05.621+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:06.620 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:06.615+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:00:34.618043+0000 (oldest deadline 2019-10-23T15:00:54.618043+0000) 2019-10-23T15:11:06.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:06.616+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:07.625 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:07.620+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:08.585 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:08.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:09.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:09.566+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:09.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:11:09.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:09.659628+0000) 2019-10-23T15:11:10.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:10.517+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:11.558 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:11.553+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:11.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:11:11.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:11.657487+0000) 2019-10-23T15:11:11.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:11:11.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:11.676157+0000) 2019-10-23T15:11:12.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:12.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:12.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:11:12.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:12.670918+0000) 2019-10-23T15:11:13.574 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:13.570+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:13.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:11:13.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:13.634580+0000) 2019-10-23T15:11:14.572 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:14.563+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:14.683 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:11:14.679+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:14.680339+0000) 2019-10-23T15:11:15.586 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:15.581+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:16.599 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:16.594+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:17.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:17.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:18.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:18.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:19.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:19.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:19.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:11:19.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:19.659751+0000) 2019-10-23T15:11:20.619 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:20.615+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:21.654 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:21.647+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:21.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:11:21.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:21.657591+0000) 2019-10-23T15:11:21.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:11:21.674+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:21.676254+0000) 2019-10-23T15:11:22.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:22.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:22.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:11:22.669+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:22.671008+0000) 2019-10-23T15:11:23.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:11:23.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:23.634678+0000) 2019-10-23T15:11:23.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:23.669+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:24.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:11:24.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:24.680556+0000) 2019-10-23T15:11:24.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:24.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:25.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:25.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:26.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:26.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:27.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:27.641+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:28.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:28.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:28.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:28.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:29.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:29.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:29.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:29.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:29.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:11:29.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:29.659846+0000) 2019-10-23T15:11:30.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:30.601+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:30.606 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:30.601+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:31.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:31.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:31.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:31.628+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:31.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:11:31.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:31.657688+0000) 2019-10-23T15:11:31.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:11:31.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:31.676298+0000) 2019-10-23T15:11:32.634 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:32.630+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:32.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:32.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:32.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:11:32.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:32.671099+0000) 2019-10-23T15:11:33.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:11:33.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:33.634776+0000) 2019-10-23T15:11:33.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:33.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:33.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:33.659+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:34.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:34.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:34.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:34.653+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:34.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:11:34.679+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:34.680699+0000) 2019-10-23T15:11:35.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:35.607+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:35.611 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:35.607+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:36.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:36.578+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:36.583 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:36.579+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:37.614 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:37.610+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:37.615 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:37.610+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:38.635 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:38.631+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:38.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:38.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:39.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:39.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:39.592 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:39.588+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:39.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:11:39.658+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:39.659981+0000) 2019-10-23T15:11:40.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:40.575+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:40.580 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:40.576+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:41.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:41.621+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:41.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:41.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:41.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:11:41.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:41.657790+0000) 2019-10-23T15:11:41.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:11:41.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:41.676386+0000) 2019-10-23T15:11:42.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:42.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:42.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:42.599+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:42.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:11:42.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:42.671188+0000) 2019-10-23T15:11:43.604 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:43.600+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:43.605 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:43.600+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:43.636 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:11:43.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:43.634874+0000) 2019-10-23T15:11:44.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:44.604+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:44.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:44.604+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:44.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:11:44.679+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:44.680808+0000) 2019-10-23T15:11:45.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:45.624+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:45.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:45.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:46.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:46.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:46.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:46.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:47.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:47.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:47.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:47.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:48.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:48.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:48.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:48.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:49.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:11:49.659+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:49.660118+0000) 2019-10-23T15:11:49.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:49.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:49.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:49.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:50.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:50.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:50.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:50.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:51.659 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:11:51.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:51.657886+0000) 2019-10-23T15:11:51.665 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:51.660+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:51.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:51.661+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:51.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:11:51.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:51.676478+0000) 2019-10-23T15:11:52.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:11:52.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:52.671289+0000) 2019-10-23T15:11:52.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:52.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:52.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:52.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:53.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:11:53.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:53.634970+0000) 2019-10-23T15:11:53.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:53.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:53.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:53.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:54.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:54.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:54.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:54.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:54.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:11:54.679+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:54.680912+0000) 2019-10-23T15:11:55.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:55.683+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:55.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:55.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:56.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:56.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:56.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:56.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:57.710 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:57.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:57.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:57.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:58.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:58.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:58.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:58.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:11:59.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:11:59.659+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:11:59.660258+0000) 2019-10-23T15:11:59.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:59.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:11:59.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:11:59.722+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:00.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:00.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:00.736 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:00.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:01.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:12:01.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:01.657986+0000) 2019-10-23T15:12:01.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:12:01.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:01.676576+0000) 2019-10-23T15:12:01.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:01.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:01.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:01.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:02.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:12:02.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:02.671384+0000) 2019-10-23T15:12:02.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:02.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:02.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:02.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:03.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:12:03.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:03.635067+0000) 2019-10-23T15:12:03.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:03.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:03.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:03.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:04.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:12:04.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:04.681111+0000) 2019-10-23T15:12:04.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:04.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:04.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:04.745+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:05.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:05.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:05.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:05.742+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:06.721 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:06.717+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:06.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:06.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:07.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:07.706+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:07.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:07.707+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:08.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:08.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:08.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:08.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:09.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:12:09.659+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:09.660398+0000) 2019-10-23T15:12:09.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:09.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:09.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:09.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:10.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:10.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:10.734 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:10.730+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:11.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:12:11.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:11.658085+0000) 2019-10-23T15:12:11.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:12:11.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:11.676671+0000) 2019-10-23T15:12:11.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:11.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:11.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:11.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:12.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:12:12.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:12.671481+0000) 2019-10-23T15:12:12.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:12.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:12.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:12.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:13.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:12:13.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:13.635156+0000) 2019-10-23T15:12:13.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:13.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:13.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:13.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:14.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:12:14.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:14.681249+0000) 2019-10-23T15:12:14.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:14.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:14.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:14.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:15.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:15.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:15.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:15.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:16.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:16.730+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:16.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:16.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:17.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:17.742+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:17.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:17.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:18.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:18.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:18.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:18.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:19.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:12:19.659+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:19.660495+0000) 2019-10-23T15:12:19.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:19.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:19.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:19.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:20.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:20.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:20.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:20.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:21.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:12:21.656+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:21.658181+0000) 2019-10-23T15:12:21.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:12:21.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:21.676765+0000) 2019-10-23T15:12:21.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:21.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:21.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:21.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:22.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:12:22.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:22.671576+0000) 2019-10-23T15:12:22.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:22.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:22.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:22.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:23.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:12:23.633+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:23.635250+0000) 2019-10-23T15:12:23.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:23.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:23.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:23.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:24.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:12:24.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:24.681352+0000) 2019-10-23T15:12:24.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:24.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:24.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:24.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:25.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:25.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:25.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:25.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:26.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:26.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:26.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:26.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:27.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:27.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:27.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:27.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:28.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:28.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:28.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:28.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:29.663 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:12:29.659+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:29.660593+0000) 2019-10-23T15:12:29.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:29.920+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:29.925 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:29.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:30.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:30.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:30.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:30.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:31.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:12:31.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:31.658279+0000) 2019-10-23T15:12:31.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:12:31.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:31.676857+0000) 2019-10-23T15:12:31.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:31.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:31.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:31.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:32.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:12:32.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:32.671675+0000) 2019-10-23T15:12:33.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:33.011+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:33.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:33.012+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:33.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:12:33.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:33.635347+0000) 2019-10-23T15:12:33.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:33.982+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:33.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:33.982+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:34.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:12:34.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:34.681459+0000) 2019-10-23T15:12:35.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:35.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:35.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:35.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:36.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:36.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:36.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:36.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:37.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:37.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:37.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:37.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:38.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:38.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:38.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:38.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:39.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:39.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:39.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:39.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:39.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:12:39.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:39.661042+0000) 2019-10-23T15:12:40.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:40.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:40.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:40.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:41.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:41.191+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:41.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:41.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:41.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:12:41.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:41.658378+0000) 2019-10-23T15:12:41.678 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:12:41.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:41.676953+0000) 2019-10-23T15:12:42.150 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:42.146+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:42.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:42.146+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:42.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:12:42.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:42.671767+0000) 2019-10-23T15:12:43.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:43.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:43.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:43.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:43.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:12:43.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:43.635441+0000) 2019-10-23T15:12:44.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:44.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:44.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:44.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:44.684 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:12:44.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:44.681565+0000) 2019-10-23T15:12:45.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:45.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:45.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:45.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:46.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:46.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:46.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:46.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:47.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:47.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:47.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:47.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:48.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:48.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:48.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:48.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:49.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:49.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:49.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:49.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:49.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:12:49.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:49.661139+0000) 2019-10-23T15:12:50.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:50.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:50.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:50.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:51.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:50.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:51.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:50.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:51.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:12:51.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:51.658471+0000) 2019-10-23T15:12:51.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:12:51.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:51.677046+0000) 2019-10-23T15:12:51.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:51.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:51.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:51.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:52.673 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:12:52.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:52.671860+0000) 2019-10-23T15:12:52.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:52.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:52.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:52.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:53.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:12:53.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:53.635533+0000) 2019-10-23T15:12:53.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:53.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:53.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:54.685 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:12:54.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:54.681739+0000) 2019-10-23T15:12:55.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:55.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:55.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:55.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:56.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:56.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:56.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:56.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:57.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:57.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:57.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:57.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:57.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:57.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:57.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:57.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:58.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:58.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:12:58.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:12:58.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:12:59.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:12:59.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:12:59.661235+0000) 2019-10-23T15:13:00.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:00.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:00.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:00.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:01.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:01.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:01.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:01.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:01.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:13:01.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:01.658567+0000) 2019-10-23T15:13:01.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:13:01.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:01.677135+0000) 2019-10-23T15:13:02.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:02.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:02.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:02.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:02.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:13:02.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:02.671954+0000) 2019-10-23T15:13:03.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:03.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:03.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:03.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:03.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:13:03.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:03.635624+0000) 2019-10-23T15:13:04.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:04.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:04.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:04.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:04.685 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:13:04.680+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:04.681952+0000) 2019-10-23T15:13:05.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:05.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:05.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:05.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:06.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:06.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:06.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:06.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:07.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:07.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:07.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:07.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:08.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:08.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:08.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:08.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:09.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:09.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:09.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:09.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:09.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:13:09.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:09.661369+0000) 2019-10-23T15:13:10.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:10.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:10.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:10.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:11.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:11.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:11.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:11.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:11.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:13:11.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:11.658668+0000) 2019-10-23T15:13:11.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:13:11.675+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:11.677229+0000) 2019-10-23T15:13:12.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:12.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:12.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:12.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:12.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:13:12.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:12.672048+0000) 2019-10-23T15:13:13.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:13.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:13.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:13.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:13.637 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:13:13.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:13.635715+0000) 2019-10-23T15:13:13.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:13.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:13.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:13.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:14.685 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:13:14.681+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:14.682161+0000) 2019-10-23T15:13:15.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:15.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:15.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:15.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:16.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:16.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:16.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:16.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:16.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:16.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:16.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:16.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:17.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:17.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:17.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:17.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:18.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:18.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:18.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:18.974+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:19.664 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:13:19.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:19.661545+0000) 2019-10-23T15:13:19.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:19.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:19.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:19.993+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:21.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:20.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:21.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:20.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:21.660 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:13:21.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:21.658766+0000) 2019-10-23T15:13:21.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:13:21.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:21.677299+0000) 2019-10-23T15:13:21.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:21.994+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:21.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:21.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:22.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:13:22.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:22.672143+0000) 2019-10-23T15:13:22.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:22.985+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:22.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:22.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:23.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:13:23.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:23.635810+0000) 2019-10-23T15:13:23.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:23.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:23.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:23.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:24.685 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:13:24.681+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:24.682350+0000) 2019-10-23T15:13:24.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:24.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:24.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:24.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:25.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:25.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:25.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:25.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:26.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:26.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:26.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:26.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:27.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:27.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:27.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:27.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:29.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:28.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:29.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:28.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:29.665 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:13:29.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:29.661727+0000) 2019-10-23T15:13:30.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:30.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:30.033 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:30.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:31.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:31.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:31.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:31.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:31.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:13:31.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:31.658859+0000) 2019-10-23T15:13:31.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:13:31.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:31.677394+0000) 2019-10-23T15:13:32.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:32.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:32.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:32.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:32.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:13:32.670+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:32.672231+0000) 2019-10-23T15:13:33.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:33.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:33.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:33.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:33.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:13:33.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:33.635905+0000) 2019-10-23T15:13:34.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:34.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:34.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:34.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:34.685 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:13:34.681+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:34.682545+0000) 2019-10-23T15:13:34.995 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:34.991+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:34.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:34.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:36.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:36.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:36.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:36.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:37.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:37.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:37.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:37.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:38.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:38.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:38.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:38.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:39.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:39.002+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:39.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:39.002+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:39.665 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:13:39.660+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:39.661891+0000) 2019-10-23T15:13:40.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:40.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:40.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:40.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:41.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:41.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:41.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:41.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:41.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:13:41.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:41.658955+0000) 2019-10-23T15:13:41.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:13:41.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:41.677490+0000) 2019-10-23T15:13:42.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:42.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:42.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:42.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:42.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:13:42.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:42.672325+0000) 2019-10-23T15:13:43.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:43.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:43.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:43.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:43.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:13:43.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:43.635992+0000) 2019-10-23T15:13:44.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:44.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:44.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:44.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:44.686 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:13:44.681+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:44.682751+0000) 2019-10-23T15:13:45.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:45.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:45.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:45.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:46.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:46.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:46.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:46.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:47.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:47.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:47.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:47.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:48.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:48.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:48.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:48.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:49.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:49.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:49.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:49.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:49.665 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:13:49.661+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:49.662069+0000) 2019-10-23T15:13:50.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:50.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:50.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:50.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:51.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:51.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:51.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:51.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:51.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:13:51.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:51.659050+0000) 2019-10-23T15:13:51.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:13:51.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:51.677587+0000) 2019-10-23T15:13:52.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:52.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:52.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:52.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:52.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:13:52.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:52.672415+0000) 2019-10-23T15:13:53.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:53.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:53.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:53.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:53.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:13:53.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:53.636080+0000) 2019-10-23T15:13:54.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:54.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:54.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:54.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:54.686 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:13:54.681+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:54.682961+0000) 2019-10-23T15:13:55.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:55.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:55.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:55.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:56.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:56.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:56.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:56.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:57.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:57.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:57.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:57.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:58.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:58.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:58.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:58.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:59.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:59.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:13:59.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:13:59.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:13:59.665 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:13:59.661+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:13:59.662249+0000) 2019-10-23T15:14:00.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:00.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:00.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:00.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:01.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:01.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:01.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:01.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:01.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:14:01.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:01.659146+0000) 2019-10-23T15:14:01.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:14:01.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:01.677683+0000) 2019-10-23T15:14:02.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:02.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:02.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:02.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:02.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:14:02.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:02.672507+0000) 2019-10-23T15:14:03.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:03.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:03.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:03.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:03.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:14:03.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:03.636169+0000) 2019-10-23T15:14:04.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:04.165+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:04.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:04.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:04.686 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:14:04.682+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:04.683177+0000) 2019-10-23T15:14:05.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:05.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:05.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:05.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:06.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:06.156+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:06.161 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:06.157+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:07.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:07.138+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:07.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:07.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:08.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:08.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:08.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:08.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:09.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:09.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:09.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:09.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:09.665 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:09.661+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:09.662389+0000) 2019-10-23T15:14:10.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:10.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:10.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:10.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:11.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:11.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:11.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:11.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:11.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:14:11.657+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:11.659243+0000) 2019-10-23T15:14:11.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:14:11.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:11.677783+0000) 2019-10-23T15:14:12.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:12.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:12.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:12.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:12.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:14:12.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:12.672598+0000) 2019-10-23T15:14:13.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:13.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:13.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:13.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:13.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:14:13.634+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:13.636261+0000) 2019-10-23T15:14:14.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:14.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:14.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:14.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:14.686 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:14:14.682+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:14.683385+0000) 2019-10-23T15:14:15.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:15.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:15.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:15.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:16.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:16.030+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:16.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:16.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:17.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:17.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:17.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:17.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:18.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:18.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:18.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:18.041+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:19.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:19.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:19.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:19.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:19.665 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:19.661+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:19.662525+0000) 2019-10-23T15:14:19.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:19.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:19.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:19.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:21.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:21.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:21.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:21.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:21.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:14:21.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:21.659299+0000) 2019-10-23T15:14:21.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:14:21.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:21.677882+0000) 2019-10-23T15:14:22.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:22.020+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:22.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:22.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:22.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:14:22.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:22.672693+0000) 2019-10-23T15:14:23.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:23.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:23.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:23.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:23.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:14:23.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:23.636359+0000) 2019-10-23T15:14:24.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:24.024+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:24.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:24.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:24.686 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:14:24.682+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:24.683581+0000) 2019-10-23T15:14:24.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:24.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:24.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:24.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:25.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:25.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:25.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:25.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:26.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:26.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:26.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:26.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:28.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:28.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:28.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:28.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:29.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:29.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:29.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:29.052+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:29.666 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:29.661+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:29.662705+0000) 2019-10-23T15:14:29.666 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:29.662+0000 7f2d2295b700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:29.663554+0000) 2019-10-23T15:14:30.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:30.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:30.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:30.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:31.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:31.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:31.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:31.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:31.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:14:31.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:31.659399+0000) 2019-10-23T15:14:31.679 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:14:31.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:31.677976+0000) 2019-10-23T15:14:32.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:32.032+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:32.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:32.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:32.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:14:32.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:32.672786+0000) 2019-10-23T15:14:33.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:33.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:33.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:33.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:33.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:14:33.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:33.636454+0000) 2019-10-23T15:14:34.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:34.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:34.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:34.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:34.166 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:34.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:34.163067+0000) 2019-10-23T15:14:34.686 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:14:34.682+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:34.683719+0000) 2019-10-23T15:14:35.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:35.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:35.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:35.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:36.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:36.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:36.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:36.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:37.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:37.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:37.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:37.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:38.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:38.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:38.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:38.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:39.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:39.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:39.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:39.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:40.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:40.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:40.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:40.162+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:41.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:41.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:41.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:41.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:41.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:14:41.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:41.659499+0000) 2019-10-23T15:14:41.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:14:41.676+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:41.678071+0000) 2019-10-23T15:14:42.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:42.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:42.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:42.134+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:42.674 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:14:42.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:42.672879+0000) 2019-10-23T15:14:43.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:43.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:43.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:43.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:43.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:14:43.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:43.636545+0000) 2019-10-23T15:14:44.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:44.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:44.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:44.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:44.166 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:44.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:44.163162+0000) 2019-10-23T15:14:44.687 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:14:44.682+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:44.683825+0000) 2019-10-23T15:14:45.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:45.042+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:45.047 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:45.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:46.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:46.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:46.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:46.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:47.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:47.073+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:47.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:47.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:48.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:48.052+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:48.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:48.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:49.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:49.100+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:49.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:49.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:50.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:50.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:50.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:50.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:51.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:51.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:51.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:51.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:51.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:14:51.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:51.659598+0000) 2019-10-23T15:14:51.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:14:51.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:51.678173+0000) 2019-10-23T15:14:52.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:52.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:52.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:52.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:52.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:14:52.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:52.672975+0000) 2019-10-23T15:14:53.143 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:53.139+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:53.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:53.139+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:53.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:14:53.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:53.636641+0000) 2019-10-23T15:14:54.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:54.140+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:54.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:54.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:54.166 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:14:54.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:54.163257+0000) 2019-10-23T15:14:54.687 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:14:54.682+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:14:54.683924+0000) 2019-10-23T15:14:55.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:55.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:55.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:55.190+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:56.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:56.213+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:56.218 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:56.213+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:57.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:57.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:57.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:57.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:58.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:58.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:58.160 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:58.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:14:59.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:59.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:14:59.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:14:59.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:00.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:00.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:00.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:00.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:01.256 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:01.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:01.257 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:01.253+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:01.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:15:01.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:01.659740+0000) 2019-10-23T15:15:01.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:15:01.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:01.678318+0000) 2019-10-23T15:15:02.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:02.275+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:02.279 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:02.275+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:02.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:15:02.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:02.673064+0000) 2019-10-23T15:15:03.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:03.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:03.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:03.307+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:03.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:15:03.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:03.636736+0000) 2019-10-23T15:15:04.166 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:15:04.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:04.163350+0000) 2019-10-23T15:15:04.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:04.349+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:04.354 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:04.349+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:04.687 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:15:04.683+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:04.684037+0000) 2019-10-23T15:15:05.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:05.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:05.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:05.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:06.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:06.427+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:06.432 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:06.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:07.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:07.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:07.419 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:07.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:08.430 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:08.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:08.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:08.426+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:09.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:09.461+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:09.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:09.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:10.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:10.501+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:10.506 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:10.502+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:11.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:11.482+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:11.486 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:11.482+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:11.661 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:15:11.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:11.659883+0000) 2019-10-23T15:15:11.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:15:11.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:11.678443+0000) 2019-10-23T15:15:12.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:12.437+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:12.441 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:12.437+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:12.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:15:12.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:12.673158+0000) 2019-10-23T15:15:13.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:13.479+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:13.483 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:13.479+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:13.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:15:13.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:13.636827+0000) 2019-10-23T15:15:14.166 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:15:14.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:14.163490+0000) 2019-10-23T15:15:14.461 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:14.444+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:14.462 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:14.445+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:14.687 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:15:14.683+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:14.684219+0000) 2019-10-23T15:15:15.489 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:15.485+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:15.490 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:15.485+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:16.469 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:16.465+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:16.470 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:16.466+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:17.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:17.450+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:17.455 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:17.451+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:18.420 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:18.416+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:18.421 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:18.416+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:19.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:19.368+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:19.373 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:19.368+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:20.364 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:20.360+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:20.365 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:20.360+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:21.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:21.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:21.333 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:21.329+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:21.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:15:21.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:21.659974+0000) 2019-10-23T15:15:21.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:15:21.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:21.678534+0000) 2019-10-23T15:15:22.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:22.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:22.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:22.282+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:22.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:15:22.671+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:22.673247+0000) 2019-10-23T15:15:23.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:23.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:23.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:23.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:23.638 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:15:23.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:23.636923+0000) 2019-10-23T15:15:24.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:15:24.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:24.163666+0000) 2019-10-23T15:15:24.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:24.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:24.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:24.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:24.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:15:24.683+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:24.684436+0000) 2019-10-23T15:15:25.297 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:25.293+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:25.298 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:25.293+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:26.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:26.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:26.251 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:26.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:27.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:27.211+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:27.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:27.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:28.252 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:28.248+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:28.253 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:28.248+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:29.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:29.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:29.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:29.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:30.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:30.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:30.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:30.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:31.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:31.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:31.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:31.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:31.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:15:31.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:31.660071+0000) 2019-10-23T15:15:31.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:15:31.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:31.678627+0000) 2019-10-23T15:15:32.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:32.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:32.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:32.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:32.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:15:32.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:32.673335+0000) 2019-10-23T15:15:33.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:33.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:33.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:33.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:33.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:15:33.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:33.637015+0000) 2019-10-23T15:15:34.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:15:34.162+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:34.163853+0000) 2019-10-23T15:15:34.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:34.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:34.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:34.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:34.687 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:15:34.683+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:34.684647+0000) 2019-10-23T15:15:35.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:35.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:35.262 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:35.258+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:36.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:36.266+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:36.271 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:36.266+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:37.239 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:37.235+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:37.240 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:37.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:38.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:38.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:38.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:38.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:39.247 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:39.243+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:39.248 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:39.243+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:40.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:40.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:40.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:40.278+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:41.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:41.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:41.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:41.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:41.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:15:41.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:41.660168+0000) 2019-10-23T15:15:41.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:15:41.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:41.678722+0000) 2019-10-23T15:15:42.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:42.229+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:42.234 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:42.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:42.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:15:42.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:42.673426+0000) 2019-10-23T15:15:43.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:43.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:43.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:43.186+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:43.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:15:43.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:43.637109+0000) 2019-10-23T15:15:44.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:44.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:44.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:44.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:44.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:15:44.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:44.164049+0000) 2019-10-23T15:15:44.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:15:44.683+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:44.684859+0000) 2019-10-23T15:15:45.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:45.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:45.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:45.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:46.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:46.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:46.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:46.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:47.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:47.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:47.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:47.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:48.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:48.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:48.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:48.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:49.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:49.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:49.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:49.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:50.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:50.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:50.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:50.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:51.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:51.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:51.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:51.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:51.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:15:51.658+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:51.660267+0000) 2019-10-23T15:15:51.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:15:51.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:51.678819+0000) 2019-10-23T15:15:51.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:51.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:51.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:51.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:52.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:15:52.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:52.673522+0000) 2019-10-23T15:15:52.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:52.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:52.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:52.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:53.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:15:53.635+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:53.637197+0000) 2019-10-23T15:15:53.960 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:53.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:53.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:53.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:54.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:15:54.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:54.164216+0000) 2019-10-23T15:15:54.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:15:54.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:15:54.685085+0000) 2019-10-23T15:15:54.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:54.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:54.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:54.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:55.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:55.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:55.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:55.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:57.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:57.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:57.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:57.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:57.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:57.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:57.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:57.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:58.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:58.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:58.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:58.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:15:59.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:59.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:15:59.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:15:59.969+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:00.957 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:00.953+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:00.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:00.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:01.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:16:01.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:01.660367+0000) 2019-10-23T15:16:01.680 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:16:01.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:01.678911+0000) 2019-10-23T15:16:01.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:01.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:01.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:01.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:02.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:16:02.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:02.673618+0000) 2019-10-23T15:16:02.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:02.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:02.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:02.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:03.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:16:03.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:03.637297+0000) 2019-10-23T15:16:03.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:03.993+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:03.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:03.994+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:04.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:16:04.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:04.164367+0000) 2019-10-23T15:16:04.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:16:04.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:04.685295+0000) 2019-10-23T15:16:05.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:05.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:05.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:05.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:06.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:06.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:06.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:06.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:07.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:07.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:07.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:07.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:08.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:08.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:08.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:08.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:09.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:09.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:09.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:09.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:10.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:10.006+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:10.011 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:10.007+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:11.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:11.025+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:11.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:11.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:11.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:16:11.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:11.660462+0000) 2019-10-23T15:16:11.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:16:11.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:11.679010+0000) 2019-10-23T15:16:12.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:12.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:12.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:12.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:12.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:16:12.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:12.673714+0000) 2019-10-23T15:16:13.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:13.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:13.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:13.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:13.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:16:13.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:13.637391+0000) 2019-10-23T15:16:14.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:13.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:14.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:13.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:14.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:16:14.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:14.164540+0000) 2019-10-23T15:16:14.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:16:14.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:14.685434+0000) 2019-10-23T15:16:14.996 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:14.992+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:14.997 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:14.992+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:15.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:15.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:15.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:15.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:16.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:16.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:16.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:16.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:18.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:18.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:18.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:18.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:19.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:19.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:19.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:19.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:20.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:20.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:20.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:20.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:21.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:21.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:21.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:21.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:21.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:16:21.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:21.660555+0000) 2019-10-23T15:16:21.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:16:21.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:21.679105+0000) 2019-10-23T15:16:22.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:22.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:22.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:22.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:22.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:16:22.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:22.673807+0000) 2019-10-23T15:16:23.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:23.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:23.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:23.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:23.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:16:23.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:23.637486+0000) 2019-10-23T15:16:24.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:24.090+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:24.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:24.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:24.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:16:24.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:24.164683+0000) 2019-10-23T15:16:24.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:16:24.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:24.685535+0000) 2019-10-23T15:16:25.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:25.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:25.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:25.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:26.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:26.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:26.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:26.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:27.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:27.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:27.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:27.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:28.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:28.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:28.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:28.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:29.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:29.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:29.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:29.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:30.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:30.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:30.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:30.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:31.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:31.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:31.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:31.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:31.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:16:31.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:31.660653+0000) 2019-10-23T15:16:31.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:16:31.677+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:31.679205+0000) 2019-10-23T15:16:32.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:32.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:32.169 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:32.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:32.675 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:16:32.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:32.673903+0000) 2019-10-23T15:16:33.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:33.157+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:33.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:33.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:33.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:16:33.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:33.637580+0000) 2019-10-23T15:16:34.167 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:16:34.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:34.164779+0000) 2019-10-23T15:16:34.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:34.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:34.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:34.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:34.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:16:34.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:34.685640+0000) 2019-10-23T15:16:35.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:35.185+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:35.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:35.185+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:36.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:36.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:36.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:36.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:37.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:37.208+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:37.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:37.208+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:38.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:38.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:38.209 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:38.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:39.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:39.161+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:39.166 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:39.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:40.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:40.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:40.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:40.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:41.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:41.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:41.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:41.083+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:41.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:16:41.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:41.660750+0000) 2019-10-23T15:16:41.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:16:41.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:41.679297+0000) 2019-10-23T15:16:42.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:42.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:42.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:42.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:42.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:16:42.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:42.673997+0000) 2019-10-23T15:16:43.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:43.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:43.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:43.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:43.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:16:43.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:43.637669+0000) 2019-10-23T15:16:44.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:44.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:44.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:44.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:44.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:16:44.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:44.164874+0000) 2019-10-23T15:16:44.688 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:16:44.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:44.685741+0000) 2019-10-23T15:16:45.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:45.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:45.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:45.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:46.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:46.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:46.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:46.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:47.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:47.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:47.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:47.065+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:48.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:48.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:48.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:48.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:49.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:49.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:49.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:49.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:50.100 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:50.096+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:50.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:50.096+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:51.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:51.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:51.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:51.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:51.662 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:16:51.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:51.660845+0000) 2019-10-23T15:16:51.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:16:51.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:51.679394+0000) 2019-10-23T15:16:52.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:52.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:52.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:52.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:52.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:16:52.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:52.674092+0000) 2019-10-23T15:16:53.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:53.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:53.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:53.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:53.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:16:53.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:53.637763+0000) 2019-10-23T15:16:54.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:54.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:54.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:54.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:54.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:16:54.163+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:54.164970+0000) 2019-10-23T15:16:54.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:16:54.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:16:54.685847+0000) 2019-10-23T15:16:55.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:55.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:55.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:55.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:56.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:56.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:56.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:56.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:57.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:57.173+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:57.177 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:57.173+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:58.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:58.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:58.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:58.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:16:59.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:59.228+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:16:59.233 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:16:59.229+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:00.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:00.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:00.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:00.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:01.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:01.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:01.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:01.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:01.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:17:01.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:01.660944+0000) 2019-10-23T15:17:01.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:17:01.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:01.679489+0000) 2019-10-23T15:17:02.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:02.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:02.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:02.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:02.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:17:02.672+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:02.674189+0000) 2019-10-23T15:17:03.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:03.159+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:03.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:03.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:03.639 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:17:03.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:03.637859+0000) 2019-10-23T15:17:04.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:04.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:04.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:04.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:04.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:17:04.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:04.165065+0000) 2019-10-23T15:17:04.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:17:04.684+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:04.685954+0000) 2019-10-23T15:17:05.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:05.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:05.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:05.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:06.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:06.083+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:06.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:06.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:07.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:07.041+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:07.046 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:07.042+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:08.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:08.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:08.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:09.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:09.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:09.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:09.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:10.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:10.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:10.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:10.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:11.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:11.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:11.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:11.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:11.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:17:11.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:11.661043+0000) 2019-10-23T15:17:11.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:17:11.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:11.679587+0000) 2019-10-23T15:17:12.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:12.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:12.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:12.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:12.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:17:12.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:12.674280+0000) 2019-10-23T15:17:13.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:13.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:13.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:13.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:13.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:17:13.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:13.637949+0000) 2019-10-23T15:17:14.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:14.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:14.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:14.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:14.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:17:14.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:14.165159+0000) 2019-10-23T15:17:14.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:17:14.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:14.686058+0000) 2019-10-23T15:17:15.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:15.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:15.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:15.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:16.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:16.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:16.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:16.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:17.075 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:17.071+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:17.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:17.071+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:18.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:18.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:18.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:18.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:19.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:19.035+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:19.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:19.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:20.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:20.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:20.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:20.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:21.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:21.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:21.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:21.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:21.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:17:21.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:21.661138+0000) 2019-10-23T15:17:21.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:17:21.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:21.679681+0000) 2019-10-23T15:17:22.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:22.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:22.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:22.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:22.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:17:22.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:22.674374+0000) 2019-10-23T15:17:23.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:23.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:23.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:23.087+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:23.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:17:23.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:23.638039+0000) 2019-10-23T15:17:24.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:24.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:24.131 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:24.127+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:24.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:17:24.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:24.165253+0000) 2019-10-23T15:17:24.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:17:24.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:24.686162+0000) 2019-10-23T15:17:25.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:25.152+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:25.157 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:25.153+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:26.141 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:26.137+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:26.142 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:26.137+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:27.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:27.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:27.172 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:27.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:28.188 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:28.184+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:28.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:28.184+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:29.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:29.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:29.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:29.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:30.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:30.103+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:30.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:30.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:31.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:31.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:31.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:31.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:31.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:17:31.659+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:31.661238+0000) 2019-10-23T15:17:31.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:17:31.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:31.679782+0000) 2019-10-23T15:17:32.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:32.133+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:32.138 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:32.133+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:32.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:17:32.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:32.674470+0000) 2019-10-23T15:17:33.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:33.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:33.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:33.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:33.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:17:33.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:33.638134+0000) 2019-10-23T15:17:34.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:34.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:34.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:34.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:34.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:17:34.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:34.165344+0000) 2019-10-23T15:17:34.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:17:34.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:34.686267+0000) 2019-10-23T15:17:35.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:35.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:35.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:35.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:36.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:36.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:36.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:36.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:37.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:37.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:37.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:37.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:37.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:37.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:37.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:37.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:38.987 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:38.983+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:38.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:38.983+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:39.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:39.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:39.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:39.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:41.003 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:40.999+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:41.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:40.999+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:41.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:17:41.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:41.661298+0000) 2019-10-23T15:17:41.681 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:17:41.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:41.679880+0000) 2019-10-23T15:17:41.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:41.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:41.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:41.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:42.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:17:42.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:42.674563+0000) 2019-10-23T15:17:42.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:42.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:42.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:42.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:43.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:17:43.636+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:43.638226+0000) 2019-10-23T15:17:43.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:43.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:43.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:43.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:44.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:17:44.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:44.165433+0000) 2019-10-23T15:17:44.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:17:44.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:44.686373+0000) 2019-10-23T15:17:44.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:44.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:44.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:44.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:45.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:45.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:45.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:45.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:46.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:46.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:46.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:46.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:47.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:47.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:47.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:47.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:48.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:48.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:48.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:48.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:49.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:49.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:49.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:49.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:50.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:50.981+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:50.986 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:50.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:51.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:17:51.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:51.661398+0000) 2019-10-23T15:17:51.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:17:51.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:51.679976+0000) 2019-10-23T15:17:51.988 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:51.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:51.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:51.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:52.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:17:52.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:52.674657+0000) 2019-10-23T15:17:52.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:52.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:52.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:52.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:53.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:17:53.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:53.638317+0000) 2019-10-23T15:17:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:53.956+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:53.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:53.956+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:54.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:17:54.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:54.165530+0000) 2019-10-23T15:17:54.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:17:54.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:17:54.686477+0000) 2019-10-23T15:17:55.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:55.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:55.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:55.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:55.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:55.976+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:55.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:55.976+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:57.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:57.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:57.018 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:57.014+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:58.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:58.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:58.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:58.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:59.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:59.016+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:59.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:59.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:17:59.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:59.990+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:17:59.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:17:59.990+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:01.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:01.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:01.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:01.022+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:01.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:18:01.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:01.661498+0000) 2019-10-23T15:18:01.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:18:01.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:01.680070+0000) 2019-10-23T15:18:02.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:02.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:02.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:02.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:02.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:18:02.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:02.674753+0000) 2019-10-23T15:18:03.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:03.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:03.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:03.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:03.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:18:03.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:03.638413+0000) 2019-10-23T15:18:04.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:04.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:04.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:04.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:04.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:18:04.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:04.165626+0000) 2019-10-23T15:18:04.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:18:04.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:04.686578+0000) 2019-10-23T15:18:05.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:05.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:05.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:05.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:06.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:06.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:06.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:06.048+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:07.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:07.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:07.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:07.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:08.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:08.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:08.056 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:08.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:09.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:09.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:09.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:09.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:10.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:10.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:10.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:10.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:11.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:11.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:11.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:11.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:11.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:18:11.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:11.661595+0000) 2019-10-23T15:18:11.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:18:11.678+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:11.680167+0000) 2019-10-23T15:18:12.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:12.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:12.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:12.109+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:12.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:18:12.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:12.674850+0000) 2019-10-23T15:18:13.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:13.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:13.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:13.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:13.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:18:13.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:13.638504+0000) 2019-10-23T15:18:14.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:14.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:14.155 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:14.151+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:14.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:18:14.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:14.165724+0000) 2019-10-23T15:18:14.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:18:14.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:14.686683+0000) 2019-10-23T15:18:15.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:15.181+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:15.186 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:15.181+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:16.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:16.206+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:16.210 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:16.206+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:17.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:17.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:17.223 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:17.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:18.193 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:18.189+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:18.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:18.189+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:19.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:19.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:19.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:19.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:20.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:20.236+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:20.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:20.236+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:21.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:21.265+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:21.270 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:21.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:21.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:18:21.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:21.661694+0000) 2019-10-23T15:18:21.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:18:21.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:21.680262+0000) 2019-10-23T15:18:22.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:22.257+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:22.261 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:22.257+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:22.676 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:18:22.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:22.674942+0000) 2019-10-23T15:18:23.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:23.264+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:23.269 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:23.265+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:23.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:18:23.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:23.638598+0000) 2019-10-23T15:18:24.168 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:18:24.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:24.165815+0000) 2019-10-23T15:18:24.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:24.279+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:24.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:24.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:24.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:18:24.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:24.686787+0000) 2019-10-23T15:18:25.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:25.308+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:25.313 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:25.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:26.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:26.348+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:26.352 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:26.348+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:27.390 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:27.386+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:27.391 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:27.386+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:28.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:28.383+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:28.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:28.383+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:29.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:29.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:29.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:29.396+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:30.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:30.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:30.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:30.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:31.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:31.442+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:31.446 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:31.442+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:31.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:18:31.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:31.661792+0000) 2019-10-23T15:18:31.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:18:31.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:31.680363+0000) 2019-10-23T15:18:32.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:32.473+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:32.477 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:32.473+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:32.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:18:32.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:32.675038+0000) 2019-10-23T15:18:33.428 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:33.424+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:33.429 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:33.424+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:33.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:18:33.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:33.638688+0000) 2019-10-23T15:18:34.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:18:34.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:34.165913+0000) 2019-10-23T15:18:34.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:34.395+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:34.399 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:34.395+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:34.689 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:18:34.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:34.686889+0000) 2019-10-23T15:18:35.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:35.420+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:35.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:35.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:36.387 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:36.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:36.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:36.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:37.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:37.421+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:37.425 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:37.421+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:38.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:38.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:38.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:38.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:39.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:39.367+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:39.372 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:39.367+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:40.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:40.330+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:40.334 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:40.330+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:41.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:41.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:41.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:41.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:41.663 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:18:41.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:41.661891+0000) 2019-10-23T15:18:41.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:18:41.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:41.680459+0000) 2019-10-23T15:18:42.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:42.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:42.331 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:42.327+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:42.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:18:42.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:42.675131+0000) 2019-10-23T15:18:43.319 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:43.315+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:43.320 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:43.315+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:43.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:18:43.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:43.638787+0000) 2019-10-23T15:18:44.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:18:44.164+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:44.166008+0000) 2019-10-23T15:18:44.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:44.326+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:44.330 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:44.326+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:44.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:18:44.685+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:44.686996+0000) 2019-10-23T15:18:45.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:45.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:45.286 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:45.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:46.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:46.321+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:46.325 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:46.321+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:47.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:47.280+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:47.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:47.280+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:48.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:48.317+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:48.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:48.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:49.316 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:49.312+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:49.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:49.312+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:50.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:50.300+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:50.304 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:50.300+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:51.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:51.270+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:51.274 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:51.270+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:51.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:18:51.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:51.661991+0000) 2019-10-23T15:18:51.693 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:18:51.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:51.680551+0000) 2019-10-23T15:18:52.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:52.287+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:52.292 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:52.287+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:52.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:18:52.673+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:52.675225+0000) 2019-10-23T15:18:53.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:53.245+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:53.250 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:53.246+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:53.640 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:18:53.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:53.638881+0000) 2019-10-23T15:18:54.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:18:54.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:54.166106+0000) 2019-10-23T15:18:54.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:54.204+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:54.208 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:54.204+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:54.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:18:54.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:18:54.687102+0000) 2019-10-23T15:18:55.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:55.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:55.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:55.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:56.151 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:56.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:56.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:56.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:57.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:57.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:57.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:57.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:58.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:58.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:58.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:58.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:18:59.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:59.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:18:59.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:18:59.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:00.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:00.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:00.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:00.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:01.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:01.125+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:01.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:01.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:01.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:19:01.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:01.662090+0000) 2019-10-23T15:19:01.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:19:01.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:01.680647+0000) 2019-10-23T15:19:02.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:02.093+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:02.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:02.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:02.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:19:02.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:02.675297+0000) 2019-10-23T15:19:03.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:03.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:03.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:03.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:03.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:19:03.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:03.638976+0000) 2019-10-23T15:19:04.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:04.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:04.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:04.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:04.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:19:04.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:04.166196+0000) 2019-10-23T15:19:04.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:19:04.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:04.687207+0000) 2019-10-23T15:19:05.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:05.132+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:05.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:05.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:06.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:06.175+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:06.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:06.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:07.145 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:07.141+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:07.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:07.141+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:08.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:08.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:08.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:08.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:09.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:09.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:09.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:09.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:10.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:10.172+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:10.189 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:10.172+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:11.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:11.149+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:11.154 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:11.150+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:11.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:19:11.660+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:11.662187+0000) 2019-10-23T15:19:11.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:19:11.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:11.680743+0000) 2019-10-23T15:19:12.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:12.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:12.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:12.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:12.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:19:12.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:12.675388+0000) 2019-10-23T15:19:13.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:13.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:13.124 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:13.120+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:13.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:19:13.637+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:13.639066+0000) 2019-10-23T15:19:14.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:14.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:14.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:14.147+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:14.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:19:14.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:14.166292+0000) 2019-10-23T15:19:14.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:19:14.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:14.687315+0000) 2019-10-23T15:19:15.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:15.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:15.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:15.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:16.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:16.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:16.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:16.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:17.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:17.055+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:17.059 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:17.055+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:18.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:18.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:18.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:18.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:19.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:19.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:19.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:19.018+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:20.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:19.997+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:20.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:19.997+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:20.999 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:20.995+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:21.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:20.995+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:21.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:19:21.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:21.662292+0000) 2019-10-23T15:19:21.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:19:21.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:21.680840+0000) 2019-10-23T15:19:21.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:21.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:21.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:21.949+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:22.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:19:22.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:22.675485+0000) 2019-10-23T15:19:22.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:22.984+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:22.989 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:22.984+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:23.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:19:23.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:23.639159+0000) 2019-10-23T15:19:23.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:23.970+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:23.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:23.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:24.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:19:24.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:24.166385+0000) 2019-10-23T15:19:24.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:19:24.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:24.687423+0000) 2019-10-23T15:19:24.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:24.958+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:24.962 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:24.958+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:25.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:25.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:25.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:25.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:26.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:26.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:26.920 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:26.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:27.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:27.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:27.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:27.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:28.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:28.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:28.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:28.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:29.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:29.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:29.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:29.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:30.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:30.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:30.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:30.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:31.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:19:31.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:31.662390+0000) 2019-10-23T15:19:31.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:19:31.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:31.680932+0000) 2019-10-23T15:19:31.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:31.969+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:31.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:31.970+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:32.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:19:32.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:32.675582+0000) 2019-10-23T15:19:32.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:32.973+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:32.978 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:32.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:33.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:19:33.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:33.639253+0000) 2019-10-23T15:19:33.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:33.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:33.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:33.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:34.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:19:34.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:34.166476+0000) 2019-10-23T15:19:34.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:19:34.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:34.687531+0000) 2019-10-23T15:19:34.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:34.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:34.973 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:34.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:35.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:35.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:35.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:35.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:36.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:36.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:36.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:36.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:37.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:37.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:37.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:37.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:39.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:39.014+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:39.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:39.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:40.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:40.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:40.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:40.045+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:41.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:41.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:41.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:41.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:41.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:19:41.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:41.662485+0000) 2019-10-23T15:19:41.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:19:41.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:41.681032+0000) 2019-10-23T15:19:42.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:42.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:42.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:42.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:42.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:19:42.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:42.675671+0000) 2019-10-23T15:19:43.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:43.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:43.109 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:43.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:43.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:19:43.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:43.639351+0000) 2019-10-23T15:19:44.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:44.068+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:44.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:44.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:44.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:19:44.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:44.166573+0000) 2019-10-23T15:19:44.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:19:44.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:44.687639+0000) 2019-10-23T15:19:45.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:45.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:45.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:45.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:46.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:46.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:46.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:46.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:47.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:47.166+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:47.170 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:47.166+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:48.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:48.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:48.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:48.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:49.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:49.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:49.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:49.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:50.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:50.151+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:50.156 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:50.152+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:51.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:51.148+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:51.153 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:51.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:51.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:19:51.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:51.662581+0000) 2019-10-23T15:19:51.682 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:19:51.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:51.681129+0000) 2019-10-23T15:19:52.182 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:52.178+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:52.183 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:52.178+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:52.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:19:52.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:52.675760+0000) 2019-10-23T15:19:53.173 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:53.169+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:53.174 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:53.169+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:53.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:19:53.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:53.639444+0000) 2019-10-23T15:19:54.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:54.126+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:54.130 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:54.126+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:54.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:19:54.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:54.166669+0000) 2019-10-23T15:19:54.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:19:54.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:19:54.687758+0000) 2019-10-23T15:19:55.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:55.091+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:55.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:55.091+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:56.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:56.129+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:56.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:56.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:57.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:57.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:57.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:57.129+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:58.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:58.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:58.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:58.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:19:59.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:59.200+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:19:59.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:19:59.200+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:00.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:00.174+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:00.179 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:00.175+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:01.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:01.147+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:01.152 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:01.148+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:01.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:20:01.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:01.662681+0000) 2019-10-23T15:20:01.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:20:01.679+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:01.681225+0000) 2019-10-23T15:20:02.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:02.180+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:02.185 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:02.180+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:02.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:20:02.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:02.675856+0000) 2019-10-23T15:20:03.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:03.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:03.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:03.156+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:03.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:20:03.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:03.639539+0000) 2019-10-23T15:20:04.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:20:04.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:04.166766+0000) 2019-10-23T15:20:04.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:04.202+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:04.206 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:04.202+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:04.690 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:20:04.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:04.687874+0000) 2019-10-23T15:20:05.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:05.223+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:05.227 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:05.223+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:06.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:06.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:06.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:06.193+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:07.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:07.218+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:07.222 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:07.218+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:08.198 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:08.194+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:08.199 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:08.194+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:09.167 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:09.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:09.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:09.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:10.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:10.203+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:10.207 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:10.203+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:11.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:11.238+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:11.243 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:11.238+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:11.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:20:11.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:11.662779+0000) 2019-10-23T15:20:11.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:20:11.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:11.681299+0000) 2019-10-23T15:20:12.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:12.210+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:12.214 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:12.210+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:12.677 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:20:12.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:12.675952+0000) 2019-10-23T15:20:13.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:13.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:13.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:13.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:13.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:20:13.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:13.639634+0000) 2019-10-23T15:20:14.169 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:20:14.165+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:14.166865+0000) 2019-10-23T15:20:14.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:14.220+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:14.225 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:14.221+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:14.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:20:14.686+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:14.687979+0000) 2019-10-23T15:20:15.216 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:15.212+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:15.217 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:15.212+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:16.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:16.253+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:16.258 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:16.254+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:17.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:17.297+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:17.302 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:17.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:18.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:18.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:18.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:18.314+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:19.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:19.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:19.296 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:19.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:20.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:20.318+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:20.322 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:20.318+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:21.317 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:21.313+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:21.318 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:21.313+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:21.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:20:21.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:21.662873+0000) 2019-10-23T15:20:21.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:20:21.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:21.681392+0000) 2019-10-23T15:20:22.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:22.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:22.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:22.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:22.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:20:22.674+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:22.676049+0000) 2019-10-23T15:20:23.287 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:23.283+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:23.288 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:23.283+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:23.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:20:23.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:23.639729+0000) 2019-10-23T15:20:24.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:20:24.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:24.166959+0000) 2019-10-23T15:20:24.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:24.273+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:24.277 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:24.273+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:24.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:20:24.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:24.688085+0000) 2019-10-23T15:20:25.280 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:25.276+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:25.281 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:25.277+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:26.241 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:26.237+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:26.242 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:26.237+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 192 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:27.194 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:27.190+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:27.195 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:27.191+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:28.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:28.201+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:28.205 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:28.201+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:29.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:29.227+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:29.232 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:29.228+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:30.202 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:30.198+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:30.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:30.198+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:31.180 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:31.176+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:31.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:31.176+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:31.664 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:20:31.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:31.662963+0000) 2019-10-23T15:20:31.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:20:31.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:31.681486+0000) 2019-10-23T15:20:32.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:32.155+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:32.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:32.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:32.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:20:32.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:32.676140+0000) 2019-10-23T15:20:33.148 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:33.144+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:33.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:33.144+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:33.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:20:33.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:33.639828+0000) 2019-10-23T15:20:34.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:20:34.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:34.167049+0000) 2019-10-23T15:20:34.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:34.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:34.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:34.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:34.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:20:34.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:34.688188+0000) 2019-10-23T15:20:35.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:35.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:35.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:35.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:36.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:36.215+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:36.219 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:36.215+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:37.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:37.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:37.192 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:37.188+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:38.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:38.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:38.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:38.154+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:39.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:39.163+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:39.168 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:39.164+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:40.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:40.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:40.136 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:40.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:41.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:41.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:41.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:41.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:41.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:20:41.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:41.663057+0000) 2019-10-23T15:20:41.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:20:41.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:41.681577+0000) 2019-10-23T15:20:42.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:42.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:42.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:42.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:42.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:20:42.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:42.676238+0000) 2019-10-23T15:20:43.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:43.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:43.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:43.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:43.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:20:43.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:43.639918+0000) 2019-10-23T15:20:44.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:44.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:44.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:44.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:44.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:20:44.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:44.167142+0000) 2019-10-23T15:20:44.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:20:44.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:44.688294+0000) 2019-10-23T15:20:45.087 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:45.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:45.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:45.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:46.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:46.050+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:46.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:46.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:47.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:47.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:47.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:47.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:48.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:48.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:48.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:48.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:49.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:49.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:49.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:49.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:50.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:50.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:50.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:50.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:51.049 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:51.045+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:51.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:51.046+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:51.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:20:51.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:51.663151+0000) 2019-10-23T15:20:51.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:20:51.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:51.681675+0000) 2019-10-23T15:20:52.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:52.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:52.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:52.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:52.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:20:52.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:52.676298+0000) 2019-10-23T15:20:53.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:53.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:53.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:53.050+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:53.641 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:20:53.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:53.640007+0000) 2019-10-23T15:20:54.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:54.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:54.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:54.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:54.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:20:54.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:54.167237+0000) 2019-10-23T15:20:54.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:20:54.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:20:54.688402+0000) 2019-10-23T15:20:55.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:55.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:55.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:55.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:56.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:56.066+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:56.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:56.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:57.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:57.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:57.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:57.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:58.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:58.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:58.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:58.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:20:59.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:59.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:20:59.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:20:59.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:00.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:00.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:00.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:00.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:01.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:01.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:01.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:01.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:01.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:21:01.661+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:01.663246+0000) 2019-10-23T15:21:01.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:21:01.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:01.681769+0000) 2019-10-23T15:21:02.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:02.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:02.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:02.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:02.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:21:02.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:02.676394+0000) 2019-10-23T15:21:03.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:03.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:03.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:03.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:03.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:21:03.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:03.640103+0000) 2019-10-23T15:21:04.113 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:04.109+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:04.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:04.110+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:04.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:21:04.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:04.167333+0000) 2019-10-23T15:21:04.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:21:04.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:04.688512+0000) 2019-10-23T15:21:05.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:05.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:05.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:05.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:06.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:06.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:06.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:06.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:07.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:07.130+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:07.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:07.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:08.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:08.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:08.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:08.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:09.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:09.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:09.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:09.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:10.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:10.018+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:10.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:10.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:11.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:11.054+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:11.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:11.054+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:11.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:21:11.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:11.663299+0000) 2019-10-23T15:21:11.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:21:11.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:11.681860+0000) 2019-10-23T15:21:12.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:12.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:12.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:12.060+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:12.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:21:12.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:12.676488+0000) 2019-10-23T15:21:13.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:13.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:13.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:13.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:13.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:21:13.638+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:13.640197+0000) 2019-10-23T15:21:14.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:14.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:14.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:14.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:14.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:21:14.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:14.167429+0000) 2019-10-23T15:21:14.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:21:14.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:14.688615+0000) 2019-10-23T15:21:15.064 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:15.060+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:15.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:15.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:16.114 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:16.110+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:16.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:16.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:17.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:17.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:17.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:17.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:18.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:18.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:18.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:18.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:19.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:19.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:19.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:19.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:20.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:20.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:20.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:20.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:21.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:21.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:21.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:21.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:21.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:21:21.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:21.663396+0000) 2019-10-23T15:21:21.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:21:21.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:21.681952+0000) 2019-10-23T15:21:22.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:22.119+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:22.123 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:22.119+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:22.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:21:22.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:22.676578+0000) 2019-10-23T15:21:23.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:23.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:23.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:23.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:23.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:21:23.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:23.640292+0000) 2019-10-23T15:21:24.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:24.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:24.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:24.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:24.171 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:21:24.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:24.167521+0000) 2019-10-23T15:21:24.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:21:24.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:24.688717+0000) 2019-10-23T15:21:25.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:25.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:25.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:25.069+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:26.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:26.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:26.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:26.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:27.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:27.134+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:27.139 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:27.135+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:28.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:28.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:28.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:28.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:29.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:29.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:29.072 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:29.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:30.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:30.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:30.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:30.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:31.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:31.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:31.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:31.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:31.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:21:31.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:31.663494+0000) 2019-10-23T15:21:31.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:21:31.680+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:31.682046+0000) 2019-10-23T15:21:32.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:32.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:32.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:32.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:32.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:21:32.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:32.676672+0000) 2019-10-23T15:21:32.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:32.977+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:32.981 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:32.977+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:33.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:21:33.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:33.640385+0000) 2019-10-23T15:21:34.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:34.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:34.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:34.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:34.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:21:34.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:34.167616+0000) 2019-10-23T15:21:34.691 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:21:34.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:34.688826+0000) 2019-10-23T15:21:35.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:35.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:35.024 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:35.019+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:36.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:36.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:36.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:36.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:37.079 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:37.075+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:37.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:37.075+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:38.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:38.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:38.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:38.034+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:39.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:39.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:39.058 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:39.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:40.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:40.008+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:40.012 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:40.008+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:41.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:41.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:41.015 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:41.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:41.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:21:41.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:41.663589+0000) 2019-10-23T15:21:41.683 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:21:41.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:41.682144+0000) 2019-10-23T15:21:41.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:41.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:41.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:41.980+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:42.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:21:42.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:42.676764+0000) 2019-10-23T15:21:42.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:42.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:11:08.147451+0000 (oldest deadline 2019-10-23T15:11:28.147451+0000) 2019-10-23T15:21:42.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:42.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:43.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:21:43.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:43.640475+0000) 2019-10-23T15:21:43.993 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:43.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:44.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:21:44.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:44.167712+0000) 2019-10-23T15:21:44.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:21:44.687+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:44.688932+0000) 2019-10-23T15:21:44.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:44.981+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:46.016 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:46.011+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:47.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:47.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:48.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:49.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:49.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:50.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:50.103+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:51.095 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:51.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:51.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:21:51.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:51.663686+0000) 2019-10-23T15:21:51.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:21:51.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:51.682238+0000) 2019-10-23T15:21:52.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:52.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:52.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:21:52.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:52.676857+0000) 2019-10-23T15:21:53.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:53.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:53.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:21:53.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:53.640563+0000) 2019-10-23T15:21:54.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:54.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:54.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:21:54.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:54.167804+0000) 2019-10-23T15:21:54.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:21:54.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:21:54.689045+0000) 2019-10-23T15:21:55.029 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:55.025+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:55.998 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:55.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:56.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:56.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:57.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:57.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:58.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:58.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:21:59.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:21:59.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:00.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:00.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:01.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:22:01.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:01.663779+0000) 2019-10-23T15:22:01.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:22:01.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:01.682296+0000) 2019-10-23T15:22:01.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:01.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:02.678 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:22:02.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:02.676946+0000) 2019-10-23T15:22:02.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:02.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:03.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:22:03.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:03.640653+0000) 2019-10-23T15:22:03.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:03.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:04.170 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:04.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:04.167896+0000) 2019-10-23T15:22:04.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:22:04.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:04.689153+0000) 2019-10-23T15:22:04.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:04.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:04.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:04.925+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:05.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:05.923+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:05.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:05.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:06.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:06.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:06.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:06.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:07.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:07.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:07.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:07.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:08.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:08.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:08.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:08.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:09.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:09.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:09.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:09.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:10.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:10.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:10.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:10.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:11.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:22:11.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:11.663873+0000) 2019-10-23T15:22:11.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:22:11.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:11.682392+0000) 2019-10-23T15:22:11.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:11.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:11.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:11.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:12.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:22:12.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:12.677040+0000) 2019-10-23T15:22:12.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:12.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:12.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:12.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:13.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:22:13.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:13.640748+0000) 2019-10-23T15:22:13.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:13.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:13.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:13.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:14.171 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:14.166+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:14.167985+0000) 2019-10-23T15:22:14.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:22:14.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:14.689259+0000) 2019-10-23T15:22:14.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:14.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:14.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:14.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:15.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:15.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:15.786 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:15.782+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:16.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:16.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:16.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:16.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:17.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:17.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:17.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:17.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:18.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:18.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:18.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:18.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:19.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:19.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:19.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:19.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:20.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:20.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:20.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:20.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:21.665 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:22:21.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:21.663971+0000) 2019-10-23T15:22:21.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:22:21.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:21.682486+0000) 2019-10-23T15:22:21.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:21.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:21.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:21.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:22.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:22:22.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:22.677135+0000) 2019-10-23T15:22:22.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:22.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:22.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:22.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:23.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:22:23.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:23.640842+0000) 2019-10-23T15:22:23.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:23.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:23.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:23.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:24.171 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:24.167+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:24.168075+0000) 2019-10-23T15:22:24.171 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:24.167+0000 7f2d21959700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:24.168663+0000) 2019-10-23T15:22:24.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:22:24.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:24.689368+0000) 2019-10-23T15:22:24.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:24.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:24.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:24.835+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:25.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:25.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:25.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:25.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:26.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:26.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:26.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:26.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:27.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:27.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:27.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:27.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:28.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:28.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:28.668259+0000) 2019-10-23T15:22:28.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:28.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:28.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:28.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:29.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:29.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:29.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:29.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:30.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:30.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:30.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:30.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:31.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:22:31.662+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:31.664066+0000) 2019-10-23T15:22:31.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:22:31.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:31.682580+0000) 2019-10-23T15:22:31.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:31.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:31.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:31.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:32.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:22:32.675+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:32.677225+0000) 2019-10-23T15:22:32.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:32.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:32.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:32.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:33.642 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:22:33.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:33.640939+0000) 2019-10-23T15:22:33.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:33.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:33.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:33.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:34.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:22:34.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:34.689474+0000) 2019-10-23T15:22:34.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:34.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:34.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:34.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:35.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:35.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:35.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:35.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:36.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:36.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:36.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:36.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:37.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:37.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:37.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:37.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:38.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:38.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:38.668353+0000) 2019-10-23T15:22:38.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:38.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:38.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:38.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:39.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:39.961+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:39.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:39.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:40.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:40.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:40.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:40.940+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:41.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:22:41.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:41.664160+0000) 2019-10-23T15:22:41.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:22:41.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:41.682675+0000) 2019-10-23T15:22:41.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:41.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:41.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:41.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:42.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:22:42.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:42.677315+0000) 2019-10-23T15:22:42.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:42.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:42.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:42.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:43.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:22:43.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:43.641034+0000) 2019-10-23T15:22:43.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:43.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:43.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:43.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:44.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:22:44.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:44.689577+0000) 2019-10-23T15:22:44.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:44.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:44.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:44.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:45.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:45.848+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:45.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:45.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:46.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:46.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:46.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:46.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:47.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:47.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:47.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:47.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:48.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:48.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:48.668447+0000) 2019-10-23T15:22:48.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:48.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:48.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:48.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:49.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:49.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:49.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:49.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:50.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:50.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:50.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:50.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:51.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:22:51.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:51.664300+0000) 2019-10-23T15:22:51.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:22:51.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:51.682812+0000) 2019-10-23T15:22:51.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:51.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:51.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:51.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:52.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:22:52.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:52.677408+0000) 2019-10-23T15:22:52.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:52.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:52.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:52.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:53.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:22:53.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:53.641131+0000) 2019-10-23T15:22:53.822 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:53.818+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:53.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:53.818+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:54.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:22:54.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:54.689686+0000) 2019-10-23T15:22:54.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:54.838+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:54.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:54.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:55.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:55.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:55.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:55.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:56.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:56.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:56.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:56.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:57.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:57.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:57.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:57.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:58.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:22:58.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:22:58.668543+0000) 2019-10-23T15:22:58.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:58.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:58.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:58.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:22:59.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:59.915+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:22:59.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:22:59.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:00.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:00.906+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:00.911 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:00.907+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:01.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:23:01.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:01.664430+0000) 2019-10-23T15:23:01.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:23:01.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:01.682962+0000) 2019-10-23T15:23:01.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:01.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:01.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:01.874+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:02.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:23:02.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:02.677499+0000) 2019-10-23T15:23:02.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:02.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:02.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:02.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:03.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:23:03.639+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:03.641228+0000) 2019-10-23T15:23:03.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:03.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:03.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:03.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:04.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:23:04.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:04.689794+0000) 2019-10-23T15:23:04.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:04.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:04.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:04.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:05.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:05.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:05.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:05.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:06.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:06.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:06.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:06.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:07.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:07.900+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:07.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:07.900+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:08.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:23:08.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:08.668640+0000) 2019-10-23T15:23:08.947 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:08.943+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:08.948 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:08.943+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:09.912 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:09.908+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:09.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:09.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:10.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:10.866+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:10.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:10.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:11.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:23:11.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:11.664529+0000) 2019-10-23T15:23:11.684 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:23:11.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:11.683058+0000) 2019-10-23T15:23:11.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:11.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:11.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:11.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:12.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:23:12.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:12.677592+0000) 2019-10-23T15:23:12.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:12.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:12.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:12.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:13.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:23:13.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:13.641299+0000) 2019-10-23T15:23:13.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:13.873+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:13.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:13.873+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:14.692 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:23:14.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:14.689901+0000) 2019-10-23T15:23:14.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:14.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:14.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:14.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:15.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:15.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:15.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:15.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:16.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:16.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:16.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:16.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:17.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:17.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:17.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:17.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:18.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:23:18.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:18.668740+0000) 2019-10-23T15:23:18.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:18.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:18.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:18.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:19.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:19.819+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:19.823 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:19.819+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:20.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:20.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:20.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:20.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:21.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:23:21.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:21.664628+0000) 2019-10-23T15:23:21.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:23:21.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:21.683152+0000) 2019-10-23T15:23:21.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:21.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:21.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:21.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:22.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:23:22.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:22.677682+0000) 2019-10-23T15:23:22.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:22.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:22.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:22.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:23.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:23:23.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:23.641391+0000) 2019-10-23T15:23:23.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:23.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:23.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:23.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:24.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:23:24.688+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:24.690009+0000) 2019-10-23T15:23:24.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:24.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:24.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:24.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:25.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:25.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:25.775 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:25.771+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:26.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:26.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:26.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:26.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:27.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:27.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:27.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:27.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:28.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:23:28.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:28.668838+0000) 2019-10-23T15:23:28.779 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:28.771+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:28.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:28.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:29.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:29.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:29.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:29.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:30.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:30.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:30.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:30.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:31.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:23:31.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:31.664723+0000) 2019-10-23T15:23:31.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:23:31.681+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:31.683247+0000) 2019-10-23T15:23:31.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:31.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:31.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:31.691+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:32.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:32.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:32.653 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:32.649+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:32.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:23:32.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:32.677769+0000) 2019-10-23T15:23:33.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:33.636+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:33.641 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:33.637+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:33.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:23:33.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:33.641488+0000) 2019-10-23T15:23:34.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:34.665+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:34.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:34.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:34.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:23:34.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:34.690123+0000) 2019-10-23T15:23:35.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:35.644+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:35.649 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:35.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:36.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:36.605+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:36.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:36.605+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:37.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:37.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:37.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:37.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:38.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:38.550+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:38.555 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:38.550+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:38.671 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:23:38.667+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:38.668935+0000) 2019-10-23T15:23:39.522 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:39.518+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:39.523 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:39.518+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:40.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:40.492+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:40.496 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:40.492+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:41.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:41.494+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:41.498 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:41.494+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:41.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:23:41.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:41.664823+0000) 2019-10-23T15:23:41.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:23:41.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:41.683296+0000) 2019-10-23T15:23:42.525 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:42.521+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:42.526 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:42.522+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:42.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:23:42.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:42.677860+0000) 2019-10-23T15:23:43.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:43.549+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:43.553 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:43.549+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:43.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:23:43.640+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:43.641584+0000) 2019-10-23T15:23:44.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:44.530+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:44.535 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:44.531+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:44.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:23:44.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:44.690230+0000) 2019-10-23T15:23:45.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:45.565+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:45.578 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:45.565+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:46.563 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:46.559+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:46.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:46.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:47.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:47.556+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:47.560 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:47.556+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:48.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:48.606+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:48.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:48.608+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:48.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:23:48.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:48.669036+0000) 2019-10-23T15:23:49.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:49.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:49.648 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:49.644+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:50.632 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:50.628+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:50.633 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:50.630+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:51.663 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:51.659+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:51.664 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:51.660+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:51.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:23:51.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:51.664923+0000) 2019-10-23T15:23:51.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:23:51.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:51.683356+0000) 2019-10-23T15:23:52.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:52.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:52.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:52.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:52.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:23:52.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:52.677949+0000) 2019-10-23T15:23:53.643 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:23:53.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:53.641676+0000) 2019-10-23T15:23:53.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:53.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:53.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:53.650+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:54.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:54.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:54.689 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:54.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:54.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:23:54.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:54.690337+0000) 2019-10-23T15:23:55.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:55.682+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:55.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:55.683+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:56.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:56.728+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:56.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:56.728+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:57.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:57.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:57.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:57.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:58.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:23:58.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:23:58.669135+0000) 2019-10-23T15:23:58.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:58.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:58.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:58.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:23:59.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:59.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:23:59.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:23:59.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:00.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:00.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:00.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:00.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:01.683 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:24:01.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:01.665028+0000) 2019-10-23T15:24:01.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:24:01.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:01.683452+0000) 2019-10-23T15:24:01.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:01.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:01.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:01.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:02.679 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:24:02.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:02.678044+0000) 2019-10-23T15:24:02.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:02.790+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:02.794 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:02.790+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:03.644 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:24:03.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:03.641772+0000) 2019-10-23T15:24:03.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:03.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:03.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:03.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:04.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:24:04.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:04.690465+0000) 2019-10-23T15:24:04.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:04.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:04.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:04.826+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:05.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:05.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:05.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:05.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:06.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:06.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:06.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:06.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:07.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:07.859+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:07.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:07.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:08.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:24:08.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:08.669232+0000) 2019-10-23T15:24:08.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:08.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:08.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:08.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:09.877 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:09.872+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:09.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:09.872+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:10.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:10.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:10.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:10.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:11.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:24:11.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:11.665125+0000) 2019-10-23T15:24:11.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:24:11.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:11.683548+0000) 2019-10-23T15:24:11.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:11.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:11.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:11.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:12.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:24:12.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:12.678139+0000) 2019-10-23T15:24:12.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:12.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:12.875 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:12.869+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:13.644 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:24:13.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:13.642516+0000) 2019-10-23T15:24:13.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:13.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:13.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:13.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:14.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:24:14.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:14.690579+0000) 2019-10-23T15:24:14.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:14.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:14.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:14.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:15.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:15.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:15.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:15.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:16.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:16.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:16.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:16.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:17.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:17.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:17.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:17.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:18.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:24:18.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:18.669330+0000) 2019-10-23T15:24:18.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:18.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:18.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:18.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:19.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:19.827+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:19.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:19.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:20.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:20.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:20.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:20.793+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:21.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:24:21.663+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:21.665219+0000) 2019-10-23T15:24:21.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:24:21.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:21.683643+0000) 2019-10-23T15:24:21.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:21.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:21.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:21.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:22.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:24:22.676+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:22.678238+0000) 2019-10-23T15:24:22.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:22.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:22.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:22.820+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:23.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:24:23.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:23.642616+0000) 2019-10-23T15:24:23.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:23.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:23.842 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:23.838+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:24.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:24:24.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:24.690688+0000) 2019-10-23T15:24:24.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:24.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:24.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:24.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:25.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:25.835+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:25.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:25.836+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:26.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:26.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:26.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:26.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:27.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:27.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:27.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:27.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:28.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:24:28.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:28.669431+0000) 2019-10-23T15:24:28.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:28.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:28.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:28.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:29.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:29.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:29.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:29.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:30.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:30.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:30.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:30.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:31.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:24:31.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:31.665300+0000) 2019-10-23T15:24:31.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:24:31.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:31.683735+0000) 2019-10-23T15:24:31.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:31.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:31.732 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:31.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:32.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:24:32.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:32.678294+0000) 2019-10-23T15:24:32.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:32.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:32.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:32.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:33.644 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:24:33.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:33.642709+0000) 2019-10-23T15:24:33.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:33.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:33.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:33.791+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:34.694 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:24:34.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:34.690798+0000) 2019-10-23T15:24:34.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:34.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:34.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:34.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:35.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:35.789+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:35.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:35.789+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:36.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:36.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:36.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:36.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:37.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:37.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:37.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:37.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:38.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:24:38.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:38.669528+0000) 2019-10-23T15:24:38.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:38.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:38.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:38.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:39.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:39.692+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:39.697 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:39.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:40.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:40.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:40.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:40.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:41.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:24:41.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:41.665399+0000) 2019-10-23T15:24:41.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:24:41.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:41.683831+0000) 2019-10-23T15:24:41.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:41.715+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:41.720 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:41.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:42.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:24:42.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:42.678384+0000) 2019-10-23T15:24:42.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:42.694+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:42.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:42.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:43.644 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:24:43.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:43.642804+0000) 2019-10-23T15:24:43.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:43.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:43.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:43.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:44.680 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:44.676+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:44.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:44.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:44.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:24:44.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:44.690906+0000) 2019-10-23T15:24:45.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:45.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:45.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:45.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:46.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:46.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:46.706 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:46.702+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:47.695 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:47.691+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:47.696 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:47.692+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:48.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:24:48.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:48.669630+0000) 2019-10-23T15:24:48.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:48.670+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:48.674 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:48.670+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:49.708 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:49.704+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:49.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:49.704+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:50.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:50.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:50.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:50.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:51.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:24:51.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:51.665497+0000) 2019-10-23T15:24:51.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:24:51.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:51.683925+0000) 2019-10-23T15:24:51.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:51.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:51.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:51.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:52.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:24:52.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:52.678479+0000) 2019-10-23T15:24:52.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:52.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:52.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:52.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:53.644 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:24:53.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:53.642896+0000) 2019-10-23T15:24:53.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:53.778+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:53.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:53.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:54.693 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:24:54.689+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:54.691015+0000) 2019-10-23T15:24:54.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:54.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:54.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:54.738+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:55.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:55.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:55.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:55.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:56.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:56.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:56.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:56.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:57.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:57.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:57.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:57.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:58.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:58.642+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:58.646 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:58.642+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:24:58.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:24:58.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:24:58.669729+0000) 2019-10-23T15:24:59.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:59.598+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:24:59.603 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:24:59.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:00.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:00.587+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:00.591 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:00.587+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:01.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:01.625+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:01.629 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:01.625+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:01.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:25:01.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:01.665597+0000) 2019-10-23T15:25:01.685 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:25:01.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:01.684023+0000) 2019-10-23T15:25:02.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:02.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:02.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:02.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:02.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:25:02.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:02.678578+0000) 2019-10-23T15:25:03.644 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:25:03.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:03.642993+0000) 2019-10-23T15:25:03.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:03.675+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:03.679 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:03.675+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:04.694 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:25:04.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:04.691129+0000) 2019-10-23T15:25:04.711 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:04.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:04.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:04.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:05.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:05.662+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:05.666 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:05.662+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:06.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:06.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:06.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:06.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:07.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:07.658+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:07.662 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:07.658+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:08.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:25:08.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:08.669825+0000) 2019-10-23T15:25:08.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:08.678+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:08.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:08.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:09.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:09.696+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:09.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:09.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:10.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:10.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:10.701 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:10.697+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:11.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:25:11.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:11.665696+0000) 2019-10-23T15:25:11.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:25:11.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:11.684120+0000) 2019-10-23T15:25:11.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:11.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:11.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:11.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:12.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:25:12.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:12.678675+0000) 2019-10-23T15:25:12.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:12.719+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:12.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:12.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:13.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:25:13.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:13.643093+0000) 2019-10-23T15:25:13.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:13.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:13.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:13.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:14.694 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:25:14.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:14.691235+0000) 2019-10-23T15:25:14.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:14.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:14.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:14.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:15.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:15.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:15.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:15.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:16.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:16.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:16.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:16.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:17.803 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:17.799+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:17.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:17.799+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:18.672 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:25:18.668+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:18.669923+0000) 2019-10-23T15:25:18.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:18.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:18.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:18.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:19.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:19.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:19.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:19.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:20.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:20.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:20.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:20.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:21.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:25:21.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:21.665794+0000) 2019-10-23T15:25:21.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:25:21.682+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:21.684214+0000) 2019-10-23T15:25:21.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:21.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:21.768 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:21.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:22.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:25:22.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:22.678770+0000) 2019-10-23T15:25:22.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:22.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:22.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:22.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:23.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:25:23.641+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:23.643184+0000) 2019-10-23T15:25:23.828 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:23.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:23.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:23.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:24.694 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:25:24.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:24.691341+0000) 2019-10-23T15:25:24.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:24.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:24.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:24.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:25.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:25.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:25.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:25.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:26.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:26.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:26.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:26.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:27.917 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:27.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:27.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:27.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:28.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:25:28.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:28.670021+0000) 2019-10-23T15:25:28.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:28.882+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:28.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:28.882+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:29.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:29.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:29.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:29.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:30.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:30.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:30.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:30.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:31.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:25:31.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:31.665889+0000) 2019-10-23T15:25:31.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:25:31.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:31.684297+0000) 2019-10-23T15:25:31.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:31.813+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:31.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:31.813+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:32.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:25:32.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:32.678833+0000) 2019-10-23T15:25:32.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:32.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:32.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:32.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:33.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:25:33.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:33.643281+0000) 2019-10-23T15:25:33.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:33.825+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:33.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:33.825+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:34.694 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:25:34.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:34.691446+0000) 2019-10-23T15:25:34.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:34.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:34.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:34.780+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:35.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:35.798+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:35.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:35.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:36.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:36.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:36.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:36.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:37.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:37.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:37.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:37.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:38.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:25:38.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:38.670123+0000) 2019-10-23T15:25:38.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:38.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:38.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:38.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:39.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:39.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:39.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:39.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:40.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:40.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:40.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:40.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:41.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:25:41.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:41.665987+0000) 2019-10-23T15:25:41.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:25:41.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:41.684394+0000) 2019-10-23T15:25:41.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:41.783+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:41.787 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:41.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:42.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:25:42.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:42.678930+0000) 2019-10-23T15:25:42.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:42.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:42.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:42.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:43.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:25:43.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:43.643380+0000) 2019-10-23T15:25:43.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:43.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:43.751 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:43.747+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:44.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:25:44.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:44.691550+0000) 2019-10-23T15:25:44.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:44.739+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:44.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:44.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:45.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:45.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:45.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:45.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:46.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:46.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:46.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:46.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:47.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:47.740+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:47.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:47.740+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:48.683 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:25:48.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:48.670220+0000) 2019-10-23T15:25:48.726 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:48.722+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:48.727 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:48.723+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:49.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:49.697+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:49.702 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:49.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:50.656 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:50.652+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:50.657 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:50.652+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:51.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:51.646+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:51.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:51.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:51.667 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:25:51.664+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:51.666088+0000) 2019-10-23T15:25:51.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:25:51.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:51.684483+0000) 2019-10-23T15:25:52.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:52.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:52.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:52.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:52.680 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:25:52.677+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:52.679025+0000) 2019-10-23T15:25:53.626 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:53.622+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:53.627 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:53.622+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:53.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:25:53.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:53.643473+0000) 2019-10-23T15:25:54.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:54.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:54.671 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:54.667+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:54.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:25:54.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:54.691656+0000) 2019-10-23T15:25:55.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:55.705+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:55.709 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:55.705+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:56.683 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:56.679+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:56.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:56.679+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:57.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:57.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:57.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:57.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:58.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:58.663+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:58.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:58.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:25:58.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:25:58.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:25:58.670319+0000) 2019-10-23T15:25:59.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:59.664+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:25:59.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:25:59.664+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:00.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:00.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:00.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:00.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:01.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:26:01.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:01.666187+0000) 2019-10-23T15:26:01.684 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:01.681+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:01.685 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:01.681+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:01.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:26:01.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:01.684581+0000) 2019-10-23T15:26:02.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:26:02.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:02.679134+0000) 2019-10-23T15:26:02.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:02.709+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:02.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:02.709+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:03.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:26:03.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:03.643570+0000) 2019-10-23T15:26:03.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:03.727+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:03.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:03.727+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:04.694 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:26:04.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:04.691765+0000) 2019-10-23T15:26:04.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:04.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:04.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:04.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:05.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:05.757+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:05.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:05.757+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:06.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:06.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:06.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:06.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:07.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:07.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:07.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:07.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:08.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:26:08.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:08.670414+0000) 2019-10-23T15:26:08.807 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:08.803+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:08.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:08.803+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:09.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:09.763+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:09.767 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:09.763+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:10.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:10.733+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:10.737 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:10.733+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:11.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:26:11.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:11.666292+0000) 2019-10-23T15:26:11.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:26:11.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:11.684679+0000) 2019-10-23T15:26:11.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:11.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:11.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:11.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:12.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:26:12.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:12.679230+0000) 2019-10-23T15:26:12.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:12.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:12.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:12.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:13.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:26:13.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:13.643668+0000) 2019-10-23T15:26:13.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:13.689+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:13.693 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:13.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:14.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:26:14.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:14.691872+0000) 2019-10-23T15:26:14.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:14.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:14.730 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:14.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:15.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:15.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:15.761 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:15.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:16.762 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:16.758+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:16.763 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:16.758+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:17.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:17.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:17.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:18.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:26:18.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:18.670513+0000) 2019-10-23T15:26:18.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:18.737+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:18.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:18.737+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:19.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:19.747+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:19.752 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:19.748+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:20.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:20.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:20.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:20.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:21.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:26:21.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:21.666390+0000) 2019-10-23T15:26:21.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:26:21.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:21.684776+0000) 2019-10-23T15:26:21.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:21.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:21.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:21.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:22.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:26:22.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:22.679298+0000) 2019-10-23T15:26:22.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:22.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:22.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:22.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:23.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:26:23.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:23.643765+0000) 2019-10-23T15:26:23.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:23.767+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:23.771 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:23.767+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:24.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:26:24.690+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:24.691982+0000) 2019-10-23T15:26:24.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:24.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:24.778 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:24.774+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:25.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:25.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:25.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:25.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:26.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:26.735+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:26.741 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:26.735+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:27.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:27.718+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:27.722 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:27.718+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:28.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:26:28.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:28.670609+0000) 2019-10-23T15:26:28.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:28.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:28.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:28.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:29.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:29.804+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:29.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:29.804+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:30.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:30.802+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:30.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:30.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:31.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:26:31.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:31.666485+0000) 2019-10-23T15:26:31.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:26:31.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:31.684870+0000) 2019-10-23T15:26:31.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:31.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:31.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:31.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:32.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:26:32.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:32.679395+0000) 2019-10-23T15:26:32.784 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:32.780+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:32.785 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:32.781+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:33.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:26:33.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:33.643861+0000) 2019-10-23T15:26:33.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:33.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:33.809 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:33.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:34.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:26:34.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:34.692093+0000) 2019-10-23T15:26:34.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:34.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:34.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:34.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:35.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:35.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:35.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:35.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:36.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:36.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:36.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:36.859+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:37.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:37.832+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:37.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:37.832+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:38.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:26:38.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:38.670704+0000) 2019-10-23T15:26:38.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:38.839+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:38.843 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:38.839+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:39.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:39.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:39.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:39.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:40.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:40.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:40.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:40.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:41.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:26:41.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:41.666585+0000) 2019-10-23T15:26:41.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:26:41.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:41.684964+0000) 2019-10-23T15:26:41.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:41.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:41.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:41.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:42.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:26:42.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:42.679490+0000) 2019-10-23T15:26:42.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:42.852+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:42.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:42.852+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:43.645 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:26:43.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:43.643958+0000) 2019-10-23T15:26:43.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:43.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:43.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:43.842+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:44.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:26:44.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:44.692202+0000) 2019-10-23T15:26:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:44.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:44.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:44.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:45.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:45.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:45.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:45.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:46.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:46.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:46.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:46.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:47.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:47.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:47.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:47.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:48.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:26:48.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:48.670805+0000) 2019-10-23T15:26:48.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:48.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:48.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:48.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:49.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:49.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:49.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:49.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:50.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:50.883+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:50.887 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:50.883+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:51.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:26:51.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:51.666709+0000) 2019-10-23T15:26:51.686 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:26:51.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:51.685062+0000) 2019-10-23T15:26:51.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:51.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:51.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:51.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:52.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:26:52.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:52.679587+0000) 2019-10-23T15:26:52.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:52.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:52.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:52.888+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:53.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:26:53.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:53.644052+0000) 2019-10-23T15:26:53.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:53.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:53.910 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:53.906+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:54.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:26:54.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:54.692310+0000) 2019-10-23T15:26:54.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:54.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:54.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:54.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:55.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:55.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:55.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:55.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:56.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:56.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:56.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:56.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:57.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:57.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:57.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:57.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:58.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:26:58.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:26:58.670902+0000) 2019-10-23T15:26:58.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:58.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:58.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:58.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:26:59.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:59.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:26:59.889 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:26:59.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:00.921 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:00.917+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:00.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:00.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:01.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:27:01.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:01.666821+0000) 2019-10-23T15:27:01.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:27:01.683+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:01.685178+0000) 2019-10-23T15:27:01.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:01.948+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:01.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:01.948+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:02.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:27:02.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:02.679685+0000) 2019-10-23T15:27:02.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:02.986+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:02.990 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:02.986+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:03.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:27:03.642+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:03.644150+0000) 2019-10-23T15:27:03.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:03.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:03.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:03.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:04.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:27:04.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:04.692419+0000) 2019-10-23T15:27:04.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:04.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:04.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:04.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:05.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:05.907+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:05.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:05.908+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:06.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:06.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:06.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:06.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:07.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:07.945+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:07.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:07.945+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:08.673 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:27:08.669+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:08.670998+0000) 2019-10-23T15:27:08.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:08.975+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:08.980 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:08.975+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:09.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:09.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:09.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:09.965+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:10.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:10.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:10.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:10.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:11.668 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:27:11.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:11.666919+0000) 2019-10-23T15:27:11.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:27:11.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:11.685270+0000) 2019-10-23T15:27:11.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:11.955+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:11.959 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:11.955+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:12.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:27:12.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:12.679779+0000) 2019-10-23T15:27:12.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:12.944+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:12.949 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:12.944+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:13.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:27:13.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:13.644256+0000) 2019-10-23T15:27:13.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:13.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:13.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:13.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:14.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:27:14.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:14.692528+0000) 2019-10-23T15:27:14.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:14.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:14.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:14.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:15.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:15.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:15.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:15.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:16.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:16.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:16.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:16.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:17.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:17.897+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:17.901 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:17.897+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:18.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:27:18.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:18.671099+0000) 2019-10-23T15:27:18.881 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:18.878+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:18.882 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:18.878+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:19.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:19.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:19.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:19.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:20.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:20.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:20.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:20.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:21.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:27:21.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:21.667010+0000) 2019-10-23T15:27:21.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:27:21.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:21.685368+0000) 2019-10-23T15:27:21.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:21.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:21.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:21.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:22.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:27:22.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:22.679875+0000) 2019-10-23T15:27:22.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:22.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:22.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:22.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:23.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:27:23.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:23.644363+0000) 2019-10-23T15:27:23.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:23.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:23.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:23.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:24.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:27:24.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:24.692639+0000) 2019-10-23T15:27:24.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:24.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:24.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:24.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:25.909+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:25.913 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:25.909+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:26.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:26.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:26.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:26.879+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:27.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:27.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:27.845 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:27.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:28.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:27:28.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:28.671195+0000) 2019-10-23T15:27:28.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:28.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:28.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:28.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:29.885 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:29.881+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:29.886 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:29.881+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:30.905 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:30.901+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:30.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:30.901+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:31.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:27:31.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:31.667106+0000) 2019-10-23T15:27:31.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:27:31.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:31.685463+0000) 2019-10-23T15:27:31.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:31.914+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:31.919 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:31.915+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:32.681 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:27:32.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:32.679973+0000) 2019-10-23T15:27:32.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:32.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:32.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:32.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:33.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:27:33.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:33.644458+0000) 2019-10-23T15:27:33.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:33.895+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:33.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:33.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:34.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:27:34.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:34.692748+0000) 2019-10-23T15:27:34.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:34.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:34.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:34.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:35.878 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:35.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:35.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:35.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:36.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:36.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:36.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:36.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:37.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:37.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:37.802 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:37.798+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:38.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:27:38.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:38.671290+0000) 2019-10-23T15:27:38.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:38.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:38.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:38.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:39.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:39.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:39.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:39.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:40.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:40.766+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:40.770 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:40.766+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:41.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:27:41.665+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:41.667205+0000) 2019-10-23T15:27:41.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:27:41.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:41.685555+0000) 2019-10-23T15:27:41.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:41.772+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:41.776 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:41.772+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:42.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:27:42.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:42.680064+0000) 2019-10-23T15:27:42.738 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:42.734+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:42.739 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:42.734+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:43.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:27:43.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:43.644552+0000) 2019-10-23T15:27:43.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:43.720+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:43.724 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:43.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:44.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:27:44.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:44.692858+0000) 2019-10-23T15:27:44.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:44.756+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:44.760 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:44.756+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:45.714 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:45.710+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:45.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:45.710+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:46.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:46.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:46.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:46.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:47.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:47.748+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:47.753 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:47.749+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:48.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:27:48.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:48.671390+0000) 2019-10-23T15:27:48.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:48.755+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:48.759 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:48.755+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:49.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:49.770+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:49.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:49.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:50.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:50.786+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:50.790 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:50.786+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:51.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:27:51.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:51.667300+0000) 2019-10-23T15:27:51.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:27:51.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:51.685648+0000) 2019-10-23T15:27:51.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:51.760+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:51.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:51.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:52.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:27:52.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:52.680161+0000) 2019-10-23T15:27:52.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:52.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:52.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:52.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:53.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:27:53.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:53.644647+0000) 2019-10-23T15:27:53.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:53.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:53.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:53.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:54.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:27:54.691+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:54.692968+0000) 2019-10-23T15:27:54.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:54.821+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:54.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:54.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:55.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:55.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:55.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:55.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:56.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:56.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:56.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:56.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:57.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:57.845+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:57.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:57.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:58.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:27:58.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:27:58.671489+0000) 2019-10-23T15:27:58.883 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:58.879+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:58.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:58.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:27:59.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:59.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:27:59.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:27:59.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:00.846 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:00.842+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:00.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:00.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:01.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:28:01.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:01.667398+0000) 2019-10-23T15:28:01.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:28:01.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:01.685739+0000) 2019-10-23T15:28:01.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:01.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:01.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:01.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:02.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:28:02.678+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:02.680257+0000) 2019-10-23T15:28:02.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:02.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:02.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:02.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:03.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:28:03.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:03.644740+0000) 2019-10-23T15:28:03.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:03.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:03.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:03.938+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:04.695 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:28:04.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:04.693073+0000) 2019-10-23T15:28:04.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:04.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:04.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:04.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:05.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:05.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:05.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:05.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:06.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:06.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:06.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:06.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:08.025 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:08.021+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:08.026 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:08.021+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:08.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:28:08.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:08.671583+0000) 2019-10-23T15:28:09.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:09.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:09.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:09.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:10.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:10.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:10.077 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:10.073+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:11.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:11.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:11.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:11.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:11.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:28:11.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:11.667492+0000) 2019-10-23T15:28:11.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:28:11.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:11.685837+0000) 2019-10-23T15:28:12.091 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:12.087+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:12.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:12.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:12.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:28:12.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:12.680354+0000) 2019-10-23T15:28:13.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:13.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:13.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:13.114+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:13.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:28:13.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:13.644834+0000) 2019-10-23T15:28:14.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:14.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:14.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:14.085+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:14.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:28:14.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:14.693183+0000) 2019-10-23T15:28:15.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:15.053+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:15.057 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:15.053+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:16.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:16.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:16.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:16.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:17.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:17.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:17.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:17.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:18.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:18.033+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:18.037 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:18.033+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:18.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:28:18.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:18.671683+0000) 2019-10-23T15:28:18.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:18.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:18.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:18.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:19.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:19.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:19.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:19.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:20.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:20.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:20.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:20.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:21.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:28:21.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:21.667590+0000) 2019-10-23T15:28:21.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:28:21.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:21.685933+0000) 2019-10-23T15:28:21.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:21.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:21.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:21.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:22.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:28:22.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:22.680448+0000) 2019-10-23T15:28:22.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:22.870+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:22.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:22.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:23.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:28:23.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:23.644933+0000) 2019-10-23T15:28:23.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:23.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:23.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:23.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:24.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:28:24.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:24.693290+0000) 2019-10-23T15:28:24.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:24.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:24.852 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:24.848+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:25.873 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:25.869+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:25.874 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:25.870+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:26.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:26.887+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:26.891 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:26.887+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:27.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:27.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:27.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:27.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:28.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:28:28.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:28.671782+0000) 2019-10-23T15:28:28.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:28.921+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:28.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:28.921+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:29.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:29.931+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:29.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:29.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:30.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:30.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:30.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:30.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:31.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:28:31.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:31.667687+0000) 2019-10-23T15:28:31.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:28:31.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:31.686033+0000) 2019-10-23T15:28:31.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:31.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:31.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:31.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:32.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:28:32.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:32.680541+0000) 2019-10-23T15:28:32.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:32.946+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:32.950 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:32.946+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:33.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:28:33.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:33.645030+0000) 2019-10-23T15:28:33.944 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:33.940+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:33.945 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:33.941+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:34.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:28:34.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:34.693405+0000) 2019-10-23T15:28:34.927 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:34.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:34.928 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:34.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:35.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:35.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:35.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:35.914+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:36.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:36.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:36.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:36.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:37.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:37.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:37.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:37.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:38.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:28:38.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:38.671878+0000) 2019-10-23T15:28:39.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:39.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:39.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:39.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:39.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:39.966+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:39.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:39.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:40.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:40.954+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:40.958 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:40.954+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:41.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:28:41.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:41.667788+0000) 2019-10-23T15:28:41.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:28:41.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:41.686130+0000) 2019-10-23T15:28:41.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:41.934+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:41.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:41.934+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:42.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:28:42.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:42.680634+0000) 2019-10-23T15:28:42.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:42.922+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:42.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:42.922+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:43.646 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:28:43.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:43.645127+0000) 2019-10-23T15:28:43.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:43.951+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:43.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:43.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:44.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:28:44.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:44.693510+0000) 2019-10-23T15:28:44.963 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:44.959+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:44.964 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:44.960+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:45.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:45.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:45.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:45.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:46.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:46.924+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:46.929 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:46.924+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:47.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:47.911+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:47.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:47.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:48.674 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:28:48.670+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:48.671974+0000) 2019-10-23T15:28:48.937 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:48.933+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:48.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:48.933+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:49.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:49.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:49.971 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:49.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:50.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:50.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:50.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:50.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:51.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:28:51.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:51.667884+0000) 2019-10-23T15:28:51.687 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:28:51.684+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:51.686227+0000) 2019-10-23T15:28:51.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:51.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:51.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:51.919+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:52.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:28:52.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:52.680723+0000) 2019-10-23T15:28:52.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:52.960+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:52.965 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:52.961+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:53.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:28:53.643+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:53.645221+0000) 2019-10-23T15:28:53.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:53.979+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:53.984 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:53.979+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:54.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:28:54.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:54.693615+0000) 2019-10-23T15:28:54.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:54.988+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:54.992 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:54.988+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:55.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:55.942+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:55.946 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:55.942+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:56.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:56.926+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:56.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:56.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:57.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:57.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:57.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:57.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:58.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:28:58.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:28:58.672072+0000) 2019-10-23T15:28:58.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:58.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:58.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:58.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:28:59.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:59.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:28:59.977 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:28:59.973+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:01.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:01.004+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:01.008 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:01.004+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:01.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:29:01.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:01.667984+0000) 2019-10-23T15:29:01.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:29:01.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:01.686298+0000) 2019-10-23T15:29:01.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:01.968+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:01.972 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:01.968+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:02.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:29:02.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:02.680818+0000) 2019-10-23T15:29:02.969 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:02.965+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:02.970 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:02.966+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:03.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:29:03.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:03.645315+0000) 2019-10-23T15:29:03.923 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:03.919+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:03.924 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:03.920+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:04.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:29:04.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:04.693719+0000) 2019-10-23T15:29:04.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:04.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:04.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:04.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:05.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:05.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:05.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:05.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:06.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:06.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:06.899 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:06.895+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:07.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:07.851+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:07.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:07.851+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:08.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:29:08.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:08.672170+0000) 2019-10-23T15:29:08.867 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:08.863+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:08.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:08.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:09.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:09.822+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:09.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:09.822+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:10.824 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:10.820+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:10.825 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:10.821+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:11.669 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:29:11.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:11.668083+0000) 2019-10-23T15:29:11.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:29:11.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:11.686393+0000) 2019-10-23T15:29:11.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:11.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:11.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:11.833+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:12.682 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:29:12.679+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:12.680912+0000) 2019-10-23T15:29:12.795 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:12.791+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:12.796 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:12.792+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:13.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:29:13.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:13.645412+0000) 2019-10-23T15:29:13.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:13.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:13.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:13.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:14.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:29:14.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:14.693826+0000) 2019-10-23T15:29:14.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:14.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:14.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:14.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:15.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:15.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:15.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:15.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:16.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:16.840+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:16.844 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:16.840+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:17.854 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:17.850+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:17.855 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:17.850+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:18.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:29:18.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:18.672271+0000) 2019-10-23T15:29:18.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:18.885+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:18.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:18.885+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:19.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:19.884+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:19.888 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:19.884+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:20.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:20.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:20.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:20.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:21.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:29:21.666+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:21.668208+0000) 2019-10-23T15:29:21.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:29:21.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:21.686504+0000) 2019-10-23T15:29:21.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:21.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:21.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:21.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:22.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:29:22.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:22.681049+0000) 2019-10-23T15:29:22.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:22.889+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:22.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:22.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:23.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:29:23.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:23.645508+0000) 2019-10-23T15:29:23.850 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:23.846+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:23.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:23.846+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:24.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:29:24.692+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:24.693929+0000) 2019-10-23T15:29:24.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:24.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:24.836 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:24.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:25.804 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:25.800+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:25.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:25.800+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:26.799 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:26.795+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:26.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:26.795+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:27.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:27.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:27.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:27.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:28.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:29:28.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:28.672382+0000) 2019-10-23T15:29:28.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:28.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:28.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:28.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:29.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:29.858+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:29.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:29.858+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:30.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:30.894+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:30.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:30.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:31.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:29:31.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:31.668298+0000) 2019-10-23T15:29:31.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:29:31.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:31.686610+0000) 2019-10-23T15:29:31.908 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:31.904+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:31.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:31.904+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:32.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:29:32.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:32.681195+0000) 2019-10-23T15:29:32.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:32.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:32.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:32.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:33.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:29:33.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:33.645603+0000) 2019-10-23T15:29:33.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:33.865+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:33.870 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:33.866+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:34.696 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:29:34.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:34.694037+0000) 2019-10-23T15:29:34.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:34.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:34.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:34.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:35.861 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:35.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:35.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:35.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:36.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:36.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:36.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:36.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:37.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:37.912+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:37.916 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:37.912+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:38.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:29:38.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:38.672480+0000) 2019-10-23T15:29:38.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:38.867+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:38.871 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:38.867+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:39.893 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:39.890+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:39.894 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:39.890+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:40.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:40.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:40.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:40.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:41.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:29:41.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:41.668394+0000) 2019-10-23T15:29:41.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:29:41.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:41.686705+0000) 2019-10-23T15:29:41.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:41.876+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:41.880 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:41.876+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:42.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:29:42.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:42.681289+0000) 2019-10-23T15:29:42.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:42.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:42.869 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:42.865+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:43.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:29:43.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:43.645696+0000) 2019-10-23T15:29:43.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:43.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:43.904 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:43.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:44.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:29:44.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:44.694146+0000) 2019-10-23T15:29:44.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:44.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:44.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:44.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:45.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:45.898+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:45.902 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:45.898+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:46.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:46.875+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:46.879 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:46.875+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:47.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:47.886+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:47.890 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:47.886+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:48.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:29:48.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:48.672580+0000) 2019-10-23T15:29:48.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:48.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:48.915 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:48.911+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:49.953 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:49.949+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:49.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:49.950+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:50.956 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:50.952+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:51.137 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:50.952+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:51.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:29:51.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:51.668486+0000) 2019-10-23T15:29:51.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:29:51.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:51.686801+0000) 2019-10-23T15:29:51.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:51.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:51.985 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:51.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:52.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:29:52.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:52.681383+0000) 2019-10-23T15:29:53.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:53.009+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:53.013 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:53.009+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:53.652 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:29:53.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:53.645789+0000) 2019-10-23T15:29:53.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:53.989+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:53.994 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:53.989+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:54.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:29:54.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:54.694248+0000) 2019-10-23T15:29:55.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:55.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:55.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:55.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:56.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:56.029+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:56.034 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:56.030+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:57.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:57.010+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:57.014 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:57.010+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:58.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:58.047+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:58.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:58.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:29:58.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:29:58.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:29:58.672679+0000) 2019-10-23T15:29:59.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:59.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:29:59.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:29:59.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:00.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:00.088+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:00.092 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:00.088+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:01.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:01.124+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:01.129 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:01.125+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:01.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:30:01.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:01.668585+0000) 2019-10-23T15:30:01.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:30:01.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:01.686896+0000) 2019-10-23T15:30:02.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:02.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:02.144 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:02.132+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:02.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:30:02.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:02.681483+0000) 2019-10-23T15:30:03.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:03.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:03.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:03.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:03.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:30:03.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:03.645885+0000) 2019-10-23T15:30:04.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:04.122+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:04.127 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:04.123+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:04.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:30:04.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:04.694348+0000) 2019-10-23T15:30:05.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:05.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:05.163 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:05.159+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:06.158 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:06.154+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:06.159 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:06.155+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:07.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:07.117+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:07.121 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:07.117+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:08.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:08.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:08.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:08.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:08.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:30:08.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:08.672779+0000) 2019-10-23T15:30:09.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:09.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:09.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:09.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:10.117 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:10.113+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:10.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:10.113+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:11.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:11.079+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:11.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:11.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:11.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:30:11.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:11.668683+0000) 2019-10-23T15:30:11.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:30:11.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:11.686995+0000) 2019-10-23T15:30:12.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:12.061+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:12.065 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:12.061+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:12.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:30:12.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:12.681577+0000) 2019-10-23T15:30:13.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:13.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:13.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:13.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:13.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:30:13.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:13.645982+0000) 2019-10-23T15:30:13.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:13.987+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:13.991 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:13.987+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:14.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:30:14.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:14.694452+0000) 2019-10-23T15:30:15.006 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:15.003+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:15.007 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:15.003+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:16.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:16.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:16.054 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:16.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:17.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:17.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:17.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:17.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:18.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:18.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:18.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:18.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:18.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:30:18.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:18.672883+0000) 2019-10-23T15:30:19.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:19.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:19.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:19.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:20.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:20.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:20.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:20.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:21.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:21.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:21.104 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:21.100+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:21.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:30:21.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:21.668780+0000) 2019-10-23T15:30:21.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:30:21.685+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:21.687091+0000) 2019-10-23T15:30:22.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:22.142+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:22.146 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:22.142+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:22.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:30:22.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:22.681670+0000) 2019-10-23T15:30:23.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:23.167+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:23.171 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:23.167+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:23.647 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:30:23.644+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:23.646077+0000) 2019-10-23T15:30:24.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:24.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:24.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:24.121+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:24.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:30:24.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:24.694557+0000) 2019-10-23T15:30:25.132 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:25.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:25.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:25.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:26.107 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:26.104+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:26.108 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:26.104+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:27.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:27.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:27.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:27.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:28.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:28.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:28.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:28.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:28.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:30:28.671+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:28.672979+0000) 2019-10-23T15:30:29.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:29.085+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:29.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:29.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:30.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:30.044+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:30.048 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:30.044+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:31.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:31.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:31.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:31.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:31.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:30:31.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:31.668875+0000) 2019-10-23T15:30:31.688 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:30:31.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:31.687186+0000) 2019-10-23T15:30:32.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:32.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:32.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:32.000+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:32.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:30:32.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:32.681767+0000) 2019-10-23T15:30:32.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:32.964+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:32.968 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:32.964+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:33.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:30:33.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:33.646172+0000) 2019-10-23T15:30:33.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:33.936+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:33.940 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:33.936+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:34.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:30:34.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:34.694660+0000) 2019-10-23T15:30:34.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:34.913+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:34.918 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:34.913+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:35.954 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:35.950+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:35.955 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:35.951+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:36.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:36.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:36.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:36.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:37.903+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:37.907 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:37.903+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:38.675 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:30:38.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:38.673080+0000) 2019-10-23T15:30:38.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:38.899+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:38.903 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:38.899+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:39.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:39.918+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:39.922 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:39.918+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:40.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:40.925+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:40.930 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:40.926+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:41.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:30:41.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:41.668973+0000) 2019-10-23T15:30:41.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:30:41.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:41.687281+0000) 2019-10-23T15:30:41.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:41.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:41.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:41.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:42.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:30:42.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:42.681861+0000) 2019-10-23T15:30:42.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:42.902+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:42.906 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:42.902+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:43.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:30:43.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:43.646264+0000) 2019-10-23T15:30:43.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:43.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:43.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:43.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:44.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:30:44.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:44.694767+0000) 2019-10-23T15:30:44.951 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:44.947+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:44.952 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:44.947+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:46.000 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:45.996+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:46.001 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:45.996+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:46.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:46.962+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:46.966 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:46.962+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:47.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:47.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:47.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:47.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:48.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:30:48.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:48.673179+0000) 2019-10-23T15:30:48.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:48.928+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:48.932 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:48.928+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:49.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:49.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:49.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:49.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:50.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:50.855+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:50.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:50.855+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:51.670 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:30:51.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:51.669070+0000) 2019-10-23T15:30:51.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:30:51.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:51.687377+0000) 2019-10-23T15:30:51.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:51.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:51.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:51.893+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:52.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:30:52.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:52.681955+0000) 2019-10-23T15:30:52.941 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:52.937+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:52.942 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:52.937+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:53.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:30:53.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:53.646363+0000) 2019-10-23T15:30:53.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:53.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:53.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:53.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:54.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:30:54.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:54.694869+0000) 2019-10-23T15:30:54.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:54.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:54.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:54.931+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:55.934 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:55.930+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:55.935 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:55.930+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:56.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:56.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:56.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:56.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:57.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:57.929+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:57.933 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:57.929+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:30:58.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:30:58.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:30:58.673277+0000) 2019-10-23T15:30:58.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:58.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:30:58.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:30:58.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:00.009 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:00.005+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:00.010 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:00.005+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:01.004 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:01.000+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:01.005 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:01.001+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:01.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:31:01.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:01.669171+0000) 2019-10-23T15:31:01.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:31:01.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:01.687473+0000) 2019-10-23T15:31:02.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:02.040+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:02.044 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:02.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:02.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:31:02.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:02.682052+0000) 2019-10-23T15:31:03.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:03.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:03.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:03.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:03.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:31:03.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:03.646457+0000) 2019-10-23T15:31:04.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:04.049+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:04.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:04.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:04.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:31:04.693+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:04.694972+0000) 2019-10-23T15:31:05.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:05.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:05.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:05.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:06.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:06.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:06.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:06.093+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:07.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:07.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:07.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:07.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:08.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:08.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:08.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:08.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:08.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:31:08.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:08.673379+0000) 2019-10-23T15:31:09.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:09.065+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:09.070 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:09.066+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:10.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:10.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:10.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:10.031+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:11.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:11.058+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:11.063 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:11.059+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:11.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:31:11.667+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:11.669271+0000) 2019-10-23T15:31:11.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:31:11.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:11.687567+0000) 2019-10-23T15:31:12.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:12.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:12.062 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:12.058+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:12.683 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:31:12.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:12.682141+0000) 2019-10-23T15:31:13.038 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:13.034+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:13.039 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:13.035+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:13.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:31:13.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:13.646550+0000) 2019-10-23T15:31:14.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:14.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:14.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:14.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:14.697 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:31:14.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:14.695075+0000) 2019-10-23T15:31:15.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:15.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:15.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:15.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:16.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:16.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:16.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:16.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:17.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:17.022+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:17.027 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:17.023+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:18.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:18.028+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:18.032 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:18.028+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:18.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:31:18.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:18.673476+0000) 2019-10-23T15:31:19.052 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:19.048+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:19.053 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:19.049+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:20.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:20.070+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:20.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:20.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:21.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:21.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:21.069 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:21.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:21.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:31:21.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:21.669370+0000) 2019-10-23T15:31:21.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:31:21.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:21.687658+0000) 2019-10-23T15:31:22.089 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:22.086+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:22.090 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:22.086+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:22.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:31:22.680+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:22.682235+0000) 2019-10-23T15:31:23.125 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:23.121+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:23.126 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:23.122+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:23.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:31:23.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:23.646643+0000) 2019-10-23T15:31:24.164 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:24.160+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:24.165 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:24.161+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:24.701 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:31:24.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:24.695182+0000) 2019-10-23T15:31:25.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:25.177+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:25.181 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:25.177+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:26.190 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:26.186+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:26.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:26.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:27.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:27.158+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:27.162 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:27.158+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:28.203 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:28.199+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:28.204 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:28.199+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:28.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:31:28.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:28.673577+0000) 2019-10-23T15:31:29.196 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:29.192+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:29.197 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:29.192+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:30.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:30.195+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:30.200 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:30.196+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:31.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:31.187+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:31.191 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:31.187+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:31.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:31:31.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:31.669466+0000) 2019-10-23T15:31:31.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:31:31.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:31.687750+0000) 2019-10-23T15:31:32.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:32.232+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:32.237 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:32.233+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:32.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:31:32.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:32.682296+0000) 2019-10-23T15:31:33.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:33.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:33.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:33.261+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:33.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:31:33.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:33.646736+0000) 2019-10-23T15:31:34.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:34.302+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:34.307 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:34.302+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:34.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:31:34.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:34.695284+0000) 2019-10-23T15:31:35.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:35.291+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:35.295 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:35.291+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:36.311 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:36.307+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:36.312 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:36.308+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:37.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:37.296+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:37.301 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:37.297+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:38.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:38.342+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:38.347 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:38.343+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:38.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:31:38.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:38.673677+0000) 2019-10-23T15:31:39.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:39.294+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:39.299 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:39.295+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:40.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:40.299+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:40.303 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:40.299+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:41.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:41.325+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:41.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:41.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:41.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:31:41.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:41.669563+0000) 2019-10-23T15:31:41.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:31:41.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:41.687846+0000) 2019-10-23T15:31:42.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:42.338+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:42.342 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:42.338+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:42.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:31:42.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:42.682386+0000) 2019-10-23T15:31:43.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:43.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:43.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:43.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:43.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:31:43.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:43.646830+0000) 2019-10-23T15:31:44.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:44.346+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:44.350 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:44.346+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:44.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:31:44.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:44.695389+0000) 2019-10-23T15:31:45.328 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:45.324+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:45.329 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:45.325+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:46.282 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:46.278+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:46.283 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:46.279+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:47.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:47.310+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:47.314 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:47.310+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:48.265 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:48.261+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:48.266 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:48.262+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:48.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:31:48.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:48.673775+0000) 2019-10-23T15:31:49.284 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:49.281+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:49.285 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:49.281+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:50.309 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:50.306+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:50.310 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:50.306+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:51.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:51.344+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:51.348 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:51.344+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:51.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:31:51.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:51.669659+0000) 2019-10-23T15:31:51.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:31:51.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:51.687939+0000) 2019-10-23T15:31:52.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:52.322+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:52.326 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:52.322+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:52.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:31:52.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:52.682480+0000) 2019-10-23T15:31:53.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:53.289+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:53.293 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:53.289+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:53.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:31:53.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:53.646919+0000) 2019-10-23T15:31:54.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:54.328+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:54.332 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:54.328+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:54.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:31:54.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:54.695498+0000) 2019-10-23T15:31:55.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:55.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:55.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:55.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:56.356 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:56.352+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:56.357 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:56.353+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:57.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:57.366+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:57.370 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:57.366+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:58.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:58.397+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:58.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:58.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:31:58.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:31:58.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:31:58.673871+0000) 2019-10-23T15:31:59.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:59.384+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:31:59.388 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:31:59.384+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:00.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:00.378+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:00.382 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:00.378+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:01.426 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:01.422+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:01.427 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:01.423+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:01.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:32:01.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:01.669752+0000) 2019-10-23T15:32:01.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:32:01.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:01.688029+0000) 2019-10-23T15:32:02.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:02.426+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:02.431 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:02.427+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:02.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:32:02.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:02.682576+0000) 2019-10-23T15:32:03.417 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:03.414+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:03.418 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:03.415+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:03.648 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:32:03.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:03.647010+0000) 2019-10-23T15:32:04.400 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:04.396+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:04.401 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:04.397+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:04.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:32:04.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:04.695603+0000) 2019-10-23T15:32:05.414 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:05.410+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:05.415 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:05.411+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:06.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:06.400+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:06.404 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:06.400+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:07.450 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:07.446+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:07.451 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:07.447+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:08.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:08.462+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:08.466 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:08.462+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:08.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:32:08.672+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:08.673969+0000) 2019-10-23T15:32:09.515 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:09.511+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:09.516 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:09.511+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:10.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:10.560+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:10.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:10.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:11.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:11.567+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:11.571 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:11.567+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:11.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:32:11.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:11.669849+0000) 2019-10-23T15:32:11.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:32:11.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:11.688124+0000) 2019-10-23T15:32:12.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:12.584+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:12.588 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:12.584+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:12.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:32:12.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:12.682667+0000) 2019-10-23T15:32:13.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:13.561+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:13.566 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:13.562+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:13.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:32:13.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:13.647102+0000) 2019-10-23T15:32:14.567 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:14.564+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:21:44.380120+0000 (oldest deadline 2019-10-23T15:22:04.380120+0000) 2019-10-23T15:32:14.568 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:14.564+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:14.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:32:14.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:14.695710+0000) 2019-10-23T15:32:15.596 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:15.592+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:16.564 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:16.560+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:17.602 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:17.598+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:18.610 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:18.606+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:18.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:32:18.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:18.674070+0000) 2019-10-23T15:32:19.631 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:19.627+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:20.636 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:20.631+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:21.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:32:21.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:21.669946+0000) 2019-10-23T15:32:21.682 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:21.678+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:21.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:32:21.686+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:21.688219+0000) 2019-10-23T15:32:22.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:32:22.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:22.682759+0000) 2019-10-23T15:32:22.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:22.689+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:23.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:32:23.645+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:23.647197+0000) 2019-10-23T15:32:23.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:23.719+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:24.681 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:24.677+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:24.705 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:32:24.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:24.695817+0000) 2019-10-23T15:32:25.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:25.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:26.728 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:26.724+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:27.700 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:27.696+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:28.667 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:28.663+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:28.676 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:32:28.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:28.674166+0000) 2019-10-23T15:32:29.650 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:29.646+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:30.698 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:30.694+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:31.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:32:31.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:31.670040+0000) 2019-10-23T15:32:31.689 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:32:31.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:31.688318+0000) 2019-10-23T15:32:31.717 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:31.714+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:32.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:32:32.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:32.682848+0000) 2019-10-23T15:32:32.733 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:32.729+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:33.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:32:33.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:33.647294+0000) 2019-10-23T15:32:33.750 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:33.746+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:34.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:32:34.694+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:34.695926+0000) 2019-10-23T15:32:34.723 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:34.720+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:35.764 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:35.760+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:36.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:36.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:36.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:36.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:37.712 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:37.708+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:37.713 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:37.708+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:38.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:32:38.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:38.674261+0000) 2019-10-23T15:32:38.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:38.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:38.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:38.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:39.729 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:39.725+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:39.731 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:39.726+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:40.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:40.752+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:40.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:40.752+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:41.671 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:32:41.668+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:41.670140+0000) 2019-10-23T15:32:41.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:32:41.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:41.688411+0000) 2019-10-23T15:32:41.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:41.744+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:41.749 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:41.744+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:42.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:32:42.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:42.682942+0000) 2019-10-23T15:32:42.745 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:42.741+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:42.746 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:42.741+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:43.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:32:43.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:43.647388+0000) 2019-10-23T15:32:43.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:43.701+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:43.705 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:43.701+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:44.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:32:44.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:44.696039+0000) 2019-10-23T15:32:44.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:44.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:44.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:44.711+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:45.687 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:45.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:45.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:45.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:46.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:46.713+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:46.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:46.713+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:47.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:47.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:47.670 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:47.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:48.658 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:48.654+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:48.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:48.655+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:48.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:32:48.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:48.674354+0000) 2019-10-23T15:32:49.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:49.638+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:49.642 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:49.638+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:50.612 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:50.608+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:50.613 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:50.609+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:51.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:51.640+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:51.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:51.640+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:51.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:32:51.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:51.670236+0000) 2019-10-23T15:32:51.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:32:51.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:51.688504+0000) 2019-10-23T15:32:52.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:52.671+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:52.675 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:52.671+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:52.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:32:52.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:52.683041+0000) 2019-10-23T15:32:53.637 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:53.634+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:53.638 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:53.634+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:53.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:32:53.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:53.647486+0000) 2019-10-23T15:32:54.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:54.643+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:54.647 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:54.643+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:54.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:32:54.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:54.696147+0000) 2019-10-23T15:32:55.622 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:55.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:55.623 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:55.619+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:56.668 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:56.666+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:56.669 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:56.666+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:57.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:57.618+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:57.621 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:57.618+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:58.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:58.648+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:58.652 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:58.648+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:32:58.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:32:58.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:32:58.674452+0000) 2019-10-23T15:32:59.644 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:59.639+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:32:59.645 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:32:59.639+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:00.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:00.650+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:00.655 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:00.651+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:01.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:33:01.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:01.670297+0000) 2019-10-23T15:33:01.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:33:01.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:01.688601+0000) 2019-10-23T15:33:01.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:01.690+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:01.694 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:01.690+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:02.684 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:33:02.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:02.683137+0000) 2019-10-23T15:33:02.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:02.698+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:02.703 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:02.698+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:03.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:33:03.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:03.647578+0000) 2019-10-23T15:33:03.659 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:03.655+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:03.660 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:03.656+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:04.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:04.684+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:04.688 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:04.684+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:04.698 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:33:04.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:04.696254+0000) 2019-10-23T15:33:05.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:05.731+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:05.735 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:05.731+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:06.718 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:06.714+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:06.719 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:06.715+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:07.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:07.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:07.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:07.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:08.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:33:08.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:08.674551+0000) 2019-10-23T15:33:08.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:08.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:08.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:08.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:09.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:09.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:09.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:09.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:10.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:10.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:10.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:10.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:11.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:33:11.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:11.670395+0000) 2019-10-23T15:33:11.698 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:33:11.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:11.688698+0000) 2019-10-23T15:33:11.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:11.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:11.774 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:11.770+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:12.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:33:12.681+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:12.683234+0000) 2019-10-23T15:33:12.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:12.817+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:12.821 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:12.817+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:13.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:33:13.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:13.647673+0000) 2019-10-23T15:33:13.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:13.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:13.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:13.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:14.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:33:14.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:14.696361+0000) 2019-10-23T15:33:14.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:14.837+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:14.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:14.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:15.858 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:15.854+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:15.859 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:15.854+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:16.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:16.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:16.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:16.844+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:17.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:17.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:17.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:17.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:18.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:33:18.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:18.674650+0000) 2019-10-23T15:33:18.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:18.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:18.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:18.828+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:19.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:19.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:19.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:19.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:20.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:20.812+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:20.816 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:20.812+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:21.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:33:21.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:21.670491+0000) 2019-10-23T15:33:21.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:33:21.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:21.688789+0000) 2019-10-23T15:33:21.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:21.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:21.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:21.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:22.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:33:22.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:22.683323+0000) 2019-10-23T15:33:22.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:22.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:22.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:22.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:23.656 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:33:23.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:23.647765+0000) 2019-10-23T15:33:23.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:23.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:23.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:23.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:24.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:33:24.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:24.696466+0000) 2019-10-23T15:33:24.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:24.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:24.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:24.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:25.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:25.811+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:25.815 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:25.811+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:26.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:26.849+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:26.853 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:26.849+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:27.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:27.861+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:27.865 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:27.861+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:28.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:33:28.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:28.674747+0000) 2019-10-23T15:33:28.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:28.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:28.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:28.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:29.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:29.927+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:29.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:29.927+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:30.897 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:30.893+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:30.898 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:30.894+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:31.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:33:31.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:31.670587+0000) 2019-10-23T15:33:31.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:33:31.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:31.688882+0000) 2019-10-23T15:33:31.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:31.939+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:31.943 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:31.939+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:32.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:33:32.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:32.683416+0000) 2019-10-23T15:33:32.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:32.963+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:32.967 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:32.963+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:33.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:33:33.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:33.647859+0000) 2019-10-23T15:33:34.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:33.998+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:34.002 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:33.998+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:34.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:33:34.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:34.696571+0000) 2019-10-23T15:33:35.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:35.026+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:35.030 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:35.026+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:36.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:36.057+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:36.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:36.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:37.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:37.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:37.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:37.081+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:38.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:38.074+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:38.078 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:38.074+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:38.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:33:38.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:38.674847+0000) 2019-10-23T15:33:39.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:39.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:39.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:39.111+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:40.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:40.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:40.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:40.079+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:41.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:41.081+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:41.086 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:41.082+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:41.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:33:41.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:41.670686+0000) 2019-10-23T15:33:41.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:33:41.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:41.688977+0000) 2019-10-23T15:33:42.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:42.098+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:42.102 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:42.098+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:42.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:33:42.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:42.683509+0000) 2019-10-23T15:33:43.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:43.063+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:43.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:43.063+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:43.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:33:43.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:43.647950+0000) 2019-10-23T15:33:44.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:44.101+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:44.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:44.101+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:44.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:33:44.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:44.696681+0000) 2019-10-23T15:33:45.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:45.128+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:45.133 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:45.128+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:46.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:46.105+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:46.110 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:46.105+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:47.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:47.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:47.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:47.056+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:48.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:48.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:48.038+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:48.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:33:48.673+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:48.674943+0000) 2019-10-23T15:33:49.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:49.078+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:49.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:49.078+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:50.041 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:50.037+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:50.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:50.037+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:51.022 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:51.019+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:51.023 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:51.020+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:51.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:33:51.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:51.670779+0000) 2019-10-23T15:33:51.694 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:33:51.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:51.689069+0000) 2019-10-23T15:33:52.066 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:52.062+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:52.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:52.062+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:52.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:33:52.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:52.683607+0000) 2019-10-23T15:33:53.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:53.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:53.082 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:53.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:53.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:33:53.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:53.648042+0000) 2019-10-23T15:33:54.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:54.077+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:54.081 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:54.077+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:54.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:33:54.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:54.696789+0000) 2019-10-23T15:33:55.118 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:55.114+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:55.119 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:55.115+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:56.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:56.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:56.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:56.089+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:57.115 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:57.111+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:57.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:57.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:58.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:58.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:58.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:58.094+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:33:58.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:33:58.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:33:58.675039+0000) 2019-10-23T15:33:59.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:59.072+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:33:59.076 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:33:59.072+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:00.096 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:00.092+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:00.097 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:00.092+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:01.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:01.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:01.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:01.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:01.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:34:01.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:01.670874+0000) 2019-10-23T15:34:01.690 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:34:01.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:01.689163+0000) 2019-10-23T15:34:02.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:02.051+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:02.055 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:02.051+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:02.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:34:02.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:02.683701+0000) 2019-10-23T15:34:03.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:03.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:03.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:03.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:03.649 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:34:03.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:03.648137+0000) 2019-10-23T15:34:04.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:04.099+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:04.103 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:04.099+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:04.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:34:04.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:04.696899+0000) 2019-10-23T15:34:05.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:05.145+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:05.149 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:05.145+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:06.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:06.097+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:06.101 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:06.097+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:07.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:07.118+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:07.122 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:07.118+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:08.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:08.076+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:08.080 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:08.076+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:08.677 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:34:08.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:08.675145+0000) 2019-10-23T15:34:09.042 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:09.038+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:09.043 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:09.039+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:10.083 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:10.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:10.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:10.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:11.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:11.084+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:11.088 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:11.084+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:11.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:34:11.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:11.670972+0000) 2019-10-23T15:34:11.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:34:11.687+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:11.689259+0000) 2019-10-23T15:34:12.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:12.036+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:12.040 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:12.036+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:12.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:34:12.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:12.683792+0000) 2019-10-23T15:34:13.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:13.027+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:13.031 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:13.027+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:13.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:34:13.646+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:13.648230+0000) 2019-10-23T15:34:13.982 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:13.978+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:13.983 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:13.978+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:14.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:34:14.695+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:14.697007+0000) 2019-10-23T15:34:15.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:15.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:15.020 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:15.016+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:16.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:16.039+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:16.045 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:16.040+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:17.084 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:17.080+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:17.085 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:17.080+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:18.060 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:18.056+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:18.061 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:18.057+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:18.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:34:18.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:18.675246+0000) 2019-10-23T15:34:19.093 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:19.089+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:19.094 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:19.090+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:20.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:20.067+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:20.071 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:20.067+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:21.035 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:21.031+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:21.036 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:21.032+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:21.672 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:34:21.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:21.671064+0000) 2019-10-23T15:34:21.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:34:21.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:21.689356+0000) 2019-10-23T15:34:22.050 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:22.046+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:22.051 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:22.047+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:22.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:34:22.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:22.683884+0000) 2019-10-23T15:34:23.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:23.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:23.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:23.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:23.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:34:23.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:23.648322+0000) 2019-10-23T15:34:24.105 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:24.102+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:24.106 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:24.102+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:24.699 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:34:24.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:24.697116+0000) 2019-10-23T15:34:25.073 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:25.069+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:25.074 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:25.070+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:26.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:26.095+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:26.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:26.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:27.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:27.131+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:27.135 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:27.131+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:28.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:28.112+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:28.116 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:28.112+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:28.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:34:28.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:28.675344+0000) 2019-10-23T15:34:29.098 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:29.094+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:29.099 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:29.095+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:30.067 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:30.064+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:30.068 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:30.064+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:31.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:31.017+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:31.021 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:31.017+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:31.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:34:31.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:31.671158+0000) 2019-10-23T15:34:31.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:34:31.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:31.689449+0000) 2019-10-23T15:34:32.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:32.015+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:32.019 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:32.015+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:32.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:34:32.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:32.683978+0000) 2019-10-23T15:34:32.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:32.972+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:32.976 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:32.972+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:33.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:34:33.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:33.648412+0000) 2019-10-23T15:34:34.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:34.013+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:34.017 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:34.013+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:34.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:34:34.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:34.697220+0000) 2019-10-23T15:34:34.974 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:34.971+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:34.975 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:34.971+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:35.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:35.957+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:35.961 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:35.957+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:36.938 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:36.935+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:36.939 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:36.935+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:37.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:37.892+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:37.896 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:37.892+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:38.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:34:38.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:38.675444+0000) 2019-10-23T15:34:38.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:38.888+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:38.892 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:38.889+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:39.856 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:39.853+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:39.857 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:39.853+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:40.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:40.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:40.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:40.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:41.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:34:41.669+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:41.671253+0000) 2019-10-23T15:34:41.697 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:34:41.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:41.689543+0000) 2019-10-23T15:34:41.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:41.847+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:41.851 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:41.847+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:42.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:34:42.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:42.684071+0000) 2019-10-23T15:34:42.817 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:42.814+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:42.818 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:42.814+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:43.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:34:43.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:43.648501+0000) 2019-10-23T15:34:43.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:43.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:43.782 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:43.778+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:44.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:34:44.697+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:44.697328+0000) 2019-10-23T15:34:44.826 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:44.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:44.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:44.823+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:45.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:45.831+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:45.835 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:45.831+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:46.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:46.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:46.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:46.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:47.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:47.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:47.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:47.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:48.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:34:48.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:48.675544+0000) 2019-10-23T15:34:48.742 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:48.738+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:48.743 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:48.739+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:49.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:49.768+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:49.772 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:49.768+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:50.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:50.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:50.788 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:50.784+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:51.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:34:51.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:51.671351+0000) 2019-10-23T15:34:51.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:34:51.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:51.689637+0000) 2019-10-23T15:34:51.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:51.751+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:51.756 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:51.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:52.685 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:34:52.682+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:52.684166+0000) 2019-10-23T15:34:52.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:52.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:52.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:52.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:53.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:34:53.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:53.648596+0000) 2019-10-23T15:34:53.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:53.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:53.806 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:53.802+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:54.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:34:54.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:54.697435+0000) 2019-10-23T15:34:54.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:54.762+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:54.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:54.762+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:55.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:55.794+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:55.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:55.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:56.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:56.785+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:56.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:56.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:57.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:57.808+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:57.812 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:57.808+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:58.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:34:58.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:34:58.675645+0000) 2019-10-23T15:34:58.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:58.765+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:58.769 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:58.765+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:34:59.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:59.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:34:59.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:34:59.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:00.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:00.773+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:00.777 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:00.773+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:01.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:35:01.671+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:01.671444+0000) 2019-10-23T15:35:01.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:35:01.689+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:01.689728+0000) 2019-10-23T15:35:01.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:01.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:01.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:01.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:02.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:35:02.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:02.684260+0000) 2019-10-23T15:35:02.797 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:02.793+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:02.798 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:02.794+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:03.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:35:03.648+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:03.648692+0000) 2019-10-23T15:35:03.765 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:03.761+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:03.766 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:03.761+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:04.705 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:35:04.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:04.697543+0000) 2019-10-23T15:35:04.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:04.809+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:04.813 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:04.809+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:05.848 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:05.844+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:05.849 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:05.845+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:06.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:06.880+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:06.884 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:06.880+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:07.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:07.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:07.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:07.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:08.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:35:08.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:08.675758+0000) 2019-10-23T15:35:08.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:08.891+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:08.895 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:08.891+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:09.864+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:09.868 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:09.864+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:10.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:10.856+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:10.860 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:10.856+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:11.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:35:11.671+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:11.671539+0000) 2019-10-23T15:35:11.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:35:11.689+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:11.689820+0000) 2019-10-23T15:35:11.833 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:11.829+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:11.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:11.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:12.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:35:12.684+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:12.684356+0000) 2019-10-23T15:35:12.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:12.784+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:12.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:12.785+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:13.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:35:13.648+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:13.648786+0000) 2019-10-23T15:35:13.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:13.736+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:13.740 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:13.736+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:14.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:35:14.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:14.697648+0000) 2019-10-23T15:35:14.747 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:14.743+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:14.748 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:14.743+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:15.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:15.787+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:15.791 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:15.787+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:16.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:16.777+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:16.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:16.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:17.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:17.769+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:17.773 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:17.769+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:18.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:35:18.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:18.675872+0000) 2019-10-23T15:35:18.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:18.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:18.793 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:18.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:19.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:19.824+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:19.829 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:19.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:20.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:20.834+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:20.839 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:20.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:21.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:35:21.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:21.671635+0000) 2019-10-23T15:35:21.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:35:21.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:21.689910+0000) 2019-10-23T15:35:21.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:21.788+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:21.792 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:21.788+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:22.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:35:22.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:22.684453+0000) 2019-10-23T15:35:22.754 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:22.750+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:22.755 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:22.751+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:23.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:35:23.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:23.648882+0000) 2019-10-23T15:35:23.780 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:23.776+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:23.781 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:23.777+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:24.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:35:24.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:24.697755+0000) 2019-10-23T15:35:24.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:24.754+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:24.758 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:24.754+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:25.715 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:25.711+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:25.716 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:25.712+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:26.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:26.721+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:26.725 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:26.721+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:27.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:27.753+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:27.757 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:27.753+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:28.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:35:28.674+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:28.675988+0000) 2019-10-23T15:35:28.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:28.801+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:28.805 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:28.801+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:29.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:29.782+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:29.789 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:29.783+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:30.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:30.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:30.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:30.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:31.674 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:35:31.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:31.671726+0000) 2019-10-23T15:35:31.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:35:31.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:31.690002+0000) 2019-10-23T15:35:31.840 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:31.836+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:31.841 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:31.837+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:32.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:35:32.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:32.684550+0000) 2019-10-23T15:35:32.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:32.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:32.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:32.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:33.651 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:35:33.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:33.648979+0000) 2019-10-23T15:35:33.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:33.823+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:33.827 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:33.824+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:34.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:35:34.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:34.697858+0000) 2019-10-23T15:35:34.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:34.862+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:34.866 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:34.862+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:35.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:35.815+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:35.819 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:35.815+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:36.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:36.797+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:36.801 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:36.797+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:37.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:37.805+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:37.808 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:37.805+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:38.678 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:35:38.676+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:38.676113+0000) 2019-10-23T15:35:38.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:38.828+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:38.832 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:38.829+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:39.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:39.816+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:39.820 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:39.816+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:40.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:40.779+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:40.783 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:40.779+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:41.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:35:41.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:41.671821+0000) 2019-10-23T15:35:41.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:35:41.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:41.690098+0000) 2019-10-23T15:35:41.830 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:41.826+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:41.831 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:41.827+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:42.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:35:42.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:42.684643+0000) 2019-10-23T15:35:42.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:42.843+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:42.847 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:42.843+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:43.650 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:35:43.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:43.649072+0000) 2019-10-23T15:35:43.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:43.830+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:43.834 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:43.830+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:44.700 INFO:tasks.ceph.osd.3.smithi038.stderr:2019-10-23T15:35:44.696+0000 7f4b4c9b5700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:44.697966+0000) 2019-10-23T15:35:44.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:44.806+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:44.810 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:44.806+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:45.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:45.796+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:45.800 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:45.796+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:46.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:46.807+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:46.811 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:46.807+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:47.837 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:47.833+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:47.838 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:47.834+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:48.679 INFO:tasks.ceph.osd.0.smithi038.stderr:2019-10-23T15:35:48.675+0000 7f2d13406700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:48.676231+0000) 2019-10-23T15:35:48.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:48.810+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:48.814 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:48.810+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:49.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:49.860+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:49.864 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:49.860+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:50.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:50.905+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:50.909 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:50.905+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:51.673 INFO:tasks.ceph.osd.4.smithi062.stderr:2019-10-23T15:35:51.670+0000 7fa162985700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:51.671915+0000) 2019-10-23T15:35:51.691 INFO:tasks.ceph.osd.6.smithi062.stderr:2019-10-23T15:35:51.688+0000 7fc3d3132700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:51.690191+0000) 2019-10-23T15:35:51.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:51.910+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:51.914 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:51.910+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:52.686 INFO:tasks.ceph.osd.7.smithi062.stderr:2019-10-23T15:35:52.683+0000 7f9e2253c700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:52.684733+0000) 2019-10-23T15:35:52.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:52.896+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:52.900 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:52.896+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:53.651 INFO:tasks.ceph.osd.5.smithi062.stderr:2019-10-23T15:35:53.647+0000 7f0f50d03700 -1 monclient: _check_auth_rotating possible clock skew, rotating keys expired way too early (before 2019-10-23T14:35:53.649166+0000) 2019-10-23T15:35:53.862 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:53.857+0000 7f6c33db6700 -1 osd.1 30 heartbeat_check: no reply from 172.21.15.38:6814 osd.2 ever on either front or back, first ping sent 2019-10-23T15:32:16.407576+0000 (oldest deadline 2019-10-23T15:32:36.407576+0000) 2019-10-23T15:35:53.863 INFO:tasks.ceph.osd.1.smithi038.stderr:2019-10-23T15:35:53.857+0000 7f6c33db6700 -1 osd.1 30 get_health_metrics reporting 204 slow ops, oldest is osd_op(client.4256.0:29 2.2 2.742eadc2 (undecoded) ondisk+retry+write+known_if_redirected e27) 2019-10-23T15:35:54.039 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-10-23T15:35:54.039 DEBUG:teuthology.task.console_log:Killing console logger for smithi038 2019-10-23T15:35:54.039 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2019-10-23T15:35:54.040 DEBUG:teuthology.task.console_log:Killing console logger for smithi038 2019-10-23T15:35:54.040 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2019-10-23T15:35:54.040 DEBUG:teuthology.exit:Finished running handlers